kaldi icon indicating copy to clipboard operation
kaldi copied to clipboard

make pybind11

Open fuyanzhe opened this issue 4 years ago • 5 comments

g++ -std=c++11 -I.. -isystem /ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/include -O1 -Wno-sign-compare -Wall -Wno-sign-compare -Wno-unused-local-typedefs -Wno-deprecated-declarations -Winit-self -DKALDI_DOUBLEPRECISION=0 -DHAVE_EXECINFO_H=1 -DHAVE_CXXABI_H -DHAVE_MKL -I/ceph/sz_ts80_new/mkl/include -m64 -msse -msse2 -pthread -g -fPIC -DHAVE_CUDA -I/usr/local/cuda/include -fPIC -pthread -isystem /ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/include -I/ceph/sz_ts80_new/fyz/anaconda3/include/python3.7m -I/ceph/sz_ts80_new/fyz/anaconda3/lib/python3.7/site-packages/pybind11-2.5.dev1-py3.7.egg/pybind11/include -O3 -flto -I. -shared -o kaldi_pybind.cpython-37m-x86_64-linux-gnu.so chain/chain_den_graph_pybind.o chain/chain_pybind.o chain/chain_supervision_pybind.o chain/chain_training_pybind.o ctc/ctc_pybind.o cudamatrix/cu_device_pybind.o cudamatrix/cu_matrix_pybind.o cudamatrix/cu_vector_pybind.o cudamatrix/cudamatrix_pybind.o decoder/decodable_matrix_pybind.o decoder/decoder_pybind.o decoder/decoder_wrappers_pybind.o decoder/lattice_faster_decoder_pybind.o dlpack/dlpack_deleter.o dlpack/dlpack_pybind.o dlpack/dlpack_submatrix.o dlpack/dlpack_subvector.o feat/feat_pybind.o feat/feature_pybind.o feat/online_feature_pybind.o feat/wave_reader_pybind.o fst/arc_pybind.o fst/compile_pybind.o fst/fst_pybind.o fst/symbol_table_pybind.o fst/vector_fst_pybind.o fst/weight_pybind.o fstext/fstext_pybind.o fstext/kaldi_fst_io_pybind.o fstext/lattice_weight_pybind.o hmm/hmm_pybind.o hmm/hmm_topology_pybind.o hmm/transition_model_pybind.o itf/context_dep_itf_pybind.o itf/decodable_itf_pybind.o itf/itf_pybind.o itf/options_itf_pybind.o kaldi_pybind.o lat/determinize_lattice_pruned_pybind.o lat/kaldi_lattice_pybind.o lat/lat_pybind.o matrix/compressed_matrix_pybind.o matrix/kaldi_matrix_pybind.o matrix/kaldi_vector_pybind.o matrix/matrix_common_pybind.o matrix/matrix_pybind.o matrix/sparse_matrix_pybind.o nnet3/nnet3_pybind.o nnet3/nnet_chain_example_pybind.o nnet3/nnet_common_pybind.o nnet3/nnet_component_itf_pybind.o nnet3/nnet_convolutional_component_pybind.o nnet3/nnet_example_pybind.o nnet3/nnet_nnet_pybind.o nnet3/nnet_normalize_component_pybind.o nnet3/nnet_simple_component_pybind.o tests/test_dlpack_subvector.o util/kaldi_holder_pybind.o util/kaldi_io_pybind.o util/parse_options_pybind.o util/table_types_pybind.o util/util_pybind.o -Wl,--no-whole-archive -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/src/pybind/../lib -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/lib -rdynamic -flto -fuse-ld=gold -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/src/pybind/../../tools/openfst/lib -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/src/pybind/ctc/warp-ctc/build ../base/libkaldi-base.so ../chain/libkaldi-chain.so ../cudamatrix/libkaldi-cudamatrix.so ../decoder/libkaldi-decoder.so ../feat/libkaldi-feat.so ../fstext/libkaldi-fstext.so ../hmm/libkaldi-hmm.so ../lat/libkaldi-lat.so ../matrix/libkaldi-matrix.so ../nnet3/libkaldi-nnet3.so ../util/libkaldi-util.so ../../tools/openfst/lib/libfstscript.so ctc/warp-ctc/build/libwarpctc.so /ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/lib/libfst.so -L/ceph/sz_ts80_new/mkl/lib/intel64 -Wl,-rpath=/ceph/sz_ts80_new/mkl/lib/intel64 -lmkl_intel_lp64 -lmkl_core -lmkl_sequential -ldl -lpthread -lm -lm -lpthread -ldl ../base/libkaldi-base.so ../chain/libkaldi-chain.so ../cudamatrix/libkaldi-cudamatrix.so ../decoder/libkaldi-decoder.so ../feat/libkaldi-feat.so ../fstext/libkaldi-fstext.so ../hmm/libkaldi-hmm.so ../lat/libkaldi-lat.so ../matrix/libkaldi-matrix.so ../nnet3/libkaldi-nnet3.so ../util/libkaldi-util.so ../../tools/openfst/lib/libfstscript.so ctc/warp-ctc/build/libwarpctc.so /usr/bin/ld.gold: error: ../chain/libkaldi-chain.so: symbol 'kaldi::CuDevice::this_thread_device_' used as both __thread and non-_thread /usr/bin/ld.gold: chain/chain_den_graph_pybind.o: previous definition here /usr/bin/ld.gold: error: ../cudamatrix/libkaldi-cudamatrix.so: symbol 'kaldi::CuDevice::this_thread_device' used as both __thread and non-__thread /usr/bin/ld.gold: chain/chain_den_graph_pybind.o: previous definition here collect2: error: ld returned 1 exit status make: *** [kaldi_pybind.cpython-37m-x86_64-linux-gnu.so] Error 1

fuyanzhe avatar Sep 02 '20 03:09 fuyanzhe

We're not really supporting the pybind11 branch and IDK what would cause this error, I'm afraid.

On Wed, Sep 2, 2020 at 11:06 AM fuyanzhe [email protected] wrote:

g++ -std=c++11 -I.. -isystem /ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/include -O1 -Wno-sign-compare -Wall -Wno-sign-compare -Wno-unused-local-typedefs -Wno-deprecated-declarations -Winit-self -DKALDI_DOUBLEPRECISION=0 -DHAVE_EXECINFO_H=1 -DHAVE_CXXABI_H -DHAVE_MKL -I/ceph/sz_ts80_new/mkl/include -m64 -msse -msse2 -pthread -g -fPIC -DHAVE_CUDA -I/usr/local/cuda/include -fPIC -pthread -isystem /ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/include -I/ceph/sz_ts80_new/fyz/anaconda3/include/python3.7m -I/ceph/sz_ts80_new/fyz/anaconda3/lib/python3.7/site-packages/pybind11-2.5.dev1-py3.7.egg/pybind11/include -O3 -flto -I. -shared -o kaldi_pybind.cpython-37m-x86_64-linux-gnu.so chain/chain_den_graph_pybind.o chain/chain_pybind.o chain/chain_supervision_pybind.o chain/chain_training_pybind.o ctc/ctc_pybind.o cudamatrix/cu_device_pybind.o cudamatrix/cu_matrix_pybind.o cudamatrix/cu_vector_pybind.o cudamatrix/cudamatrix_pybind.o decoder/decodable_matrix_pybind.o decoder/decoder_pybind.o decoder/decoder_wrappers_pybind.o decoder/lattice_faster_decoder_pybind.o dlpack/dlpack_deleter.o dlpack/dlpack_pybind.o dlpack/dlpack_submatrix.o dlpack/dlpack_subvector.o feat/feat_pybind.o feat/feature_pybind.o feat/online_feature_pybind.o feat/wave_reader_pybind.o fst/arc_pybind.o fst/compile_pybind.o fst/fst_pybind.o fst/symbol_table_pybind.o fst/vector_fst_pybind.o fst/weight_pybind.o fstext/fstext_pybind.o fstext/kaldi_fst_io_pybind.o fstext/lattice_weight_pybind.o hmm/hmm_pybind.o hmm/hmm_topology_pybind.o hmm/transition_model_pybind.o itf/context_dep_itf_pybind.o itf/decodable_itf_pybind.o itf/itf_pybind.o itf/options_itf_pybind.o kaldi_pybind.o lat/determinize_lattice_pruned_pybind.o lat/kaldi_lattice_pybind.o lat/lat_pybind.o matrix/compressed_matrix_pybind.o matrix/kaldi_matrix_pybind.o matrix/kaldi_vector_pybind.o matrix/matrix_common_pybind.o matrix/matrix_pybind.o matrix/sparse_matrix_pybind.o nnet3/nnet3_pybind.o nnet3/nnet_chain_example_pybind.o nnet3/nnet_common_pybind.o nnet3/nnet_component_itf_pybind.o nnet3/nnet_convolutional_component_pybind.o nnet3/nnet_example_pybind.o nnet3/nnet_nnet_pybind.o nnet3/nnet_normalize_component_pybind.o nnet3/nnet_simple_component_pybind.o tests/test_dlpack_subvector.o util/kaldi_holder_pybind.o util/kaldi_io_pybind.o util/parse_options_pybind.o util/table_types_pybind.o util/util_pybind.o -Wl,--no-whole-archive -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/src/pybind/../lib -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/lib -rdynamic -flto -fuse-ld=gold -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/src/pybind/../../tools/openfst/lib -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/src/pybind/ctc/warp-ctc/build ../base/libkaldi-base.so ../chain/libkaldi-chain.so ../cudamatrix/libkaldi-cudamatrix.so ../decoder/libkaldi-decoder.so ../feat/libkaldi-feat.so ../fstext/libkaldi-fstext.so ../hmm/libkaldi-hmm.so ../lat/libkaldi-lat.so ../matrix/libkaldi-matrix.so ../nnet3/libkaldi-nnet3.so ../util/libkaldi-util.so ../../tools/openfst/lib/libfstscript.so ctc/warp-ctc/build/libwarpctc.so /ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/lib/libfst.so -L/ceph/sz_ts80_new/mkl/lib/intel64 -Wl,-rpath=/ceph/sz_ts80_new/mkl/lib/intel64 -lmkl_intel_lp64 -lmkl_core -lmkl_sequential -ldl -lpthread -lm -lm -lpthread -ldl ../base/libkaldi-base.so ../chain/libkaldi-chain.so ../cudamatrix/libkaldi-cudamatrix.so ../decoder/libkaldi-decoder.so ../feat/libkaldi-feat.so ../fstext/libkaldi-fstext.so ../hmm/libkaldi-hmm.so ../lat/libkaldi-lat.so ../matrix/libkaldi-matrix.so ../nnet3/libkaldi-nnet3.so ../util/libkaldi-util.so ../../tools/openfst/lib/libfstscript.so ctc/warp-ctc/build/libwarpctc.so /usr/bin/ld.gold: error: ../chain/libkaldi-chain.so: symbol 'kaldi::CuDevice::this_thread_device_' used as both _thread and non-

thread /usr/bin/ld.gold: chain/chain_den_graph_pybind.o: previous definition here /usr/bin/ld.gold: error: ../cudamatrix/libkaldi-cudamatrix.so: symbol 'kaldi::CuDevice::this_thread_device' used as both __thread and non-__thread /usr/bin/ld.gold: chain/chain_den_graph_pybind.o: previous definition here collect2: error: ld returned 1 exit status make: *** [kaldi_pybind.cpython-37m-x86_64-linux-gnu.so] Error 1

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/kaldi-asr/kaldi/issues/4253, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAZFLOZLQ6NIIJ554QE7HYDSDWZEJANCNFSM4QSQABFQ .

danpovey avatar Sep 02 '20 03:09 danpovey

This issue has been automatically marked as stale by a bot solely because it has not had recent activity. Please add any comment (simply 'ping' is enough) to prevent the issue from being closed for 60 more days if you believe it should be kept open.

stale[bot] avatar Nov 01 '20 04:11 stale[bot]

The same error?

kaldi/src/pybind# g++ -c -std=c++11 -I.. -isystem /home/kaldi_/kaldi/tools/openfst-1.6.7/include -O1 -Wno-sign-compare -Wall -Wno-sign-compare -Wno-unused-local-typedefs -Wno-deprecated-declarations -Winit-self -DKALDI_DOUBLEPRECISION=0 -DHAVE_EXECINFO_H=1 -DHAVE_CXXABI_H -DHAVE_MKL -I/opt/intel/compilers_and_libraries_2020.0.166/linux/mkl/include -m64 -msse -msse2 -pthread -g -fPIC -DHAVE_CUDA -I/usr/local/cuda/include -fPIC -pthread -isystem /home/kaldi_/kaldi/tools/openfst-1.6.7/include -I/opt/conda/include/python3.6m -I/root/.local/include/python3.6m -O3 -flto -I. -o chain/chain_den_graph_pybind.o chain/chain_den_graph_pybind.cc In file included from ./chain/chain_pybind.h:22:0, from chain/chain_den_graph_pybind.cc:18: ../pybind/kaldi_pybind.h:31:36: error: ‘overload_cast_impl’ in namespace ‘pybind11::detail’ does not name a template type using overload_cast_ = py::detail::overload_cast_impl<Args...>; ^ In file included from chain/chain_den_graph_pybind.cc:21:0: ./fst/vector_fst_pybind.h: In function ‘void pybind_vector_fst_impl(pybind11::module&, const string&, const string&)’: ./fst/vector_fst_pybind.h:115:13: error: ‘overload_cast_’ was not declared in this scope overload_cast_<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:115:40: error: expected primary-expression before ‘&’ token overload_cast_<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:115:41: error: expected primary-expression before ‘,’ token overload_cast_<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:115:43: error: expected primary-expression before ‘const’ overload_cast_<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:121:42: error: expected primary-expression before ‘const’ .def_static("Read", overload_cast_<const fst::string&>()(&PyClass::Read),

cding-nv avatar Nov 23 '20 03:11 cding-nv

Probably has to do with newer version of pybind, if you can find the fix we'll merge it but we are not really working on that right now.

On Mon, Nov 23, 2020 at 11:00 AM ChrisD [email protected] wrote:

The same error?

kaldi/src/pybind# g++ -c -std=c++11 -I.. -isystem /home/kaldi_/kaldi/tools/openfst-1.6.7/include -O1 -Wno-sign-compare -Wall -Wno-sign-compare -Wno-unused-local-typedefs -Wno-deprecated-declarations -Winit-self -DKALDI_DOUBLEPRECISION=0 -DHAVE_EXECINFO_H=1 -DHAVE_CXXABI_H -DHAVE_MKL -I/opt/intel/compilers_and_libraries_2020.0.166/linux/mkl/include -m64 -msse -msse2 -pthread -g -fPIC -DHAVE_CUDA -I/usr/local/cuda/include -fPIC -pthread -isystem /home/kaldi_/kaldi/tools/openfst-1.6.7/include -I/opt/conda/include/python3.6m -I/root/.local/include/python3.6m -O3 -flto -I. -o chain/chain_den_graph_pybind.o chain/chain_den_graph_pybind.cc In file included from ./chain/chain_pybind.h:22:0, from chain/chain_den_graph_pybind.cc:18: ../pybind/kaldi_pybind.h:31:36: error: ‘overload_cast_impl’ in namespace ‘pybind11::detail’ does not name a template type using overload_cast_ = py::detail::overload_cast_impl<Args...>; ^ In file included from chain/chain_den_graph_pybind.cc:21:0: ./fst/vector_fst_pybind.h: In function ‘void pybind_vector_fst_impl(pybind11::module&, const string&, const string&)’: ./fst/vector_fst_pybind.h:115:13: error: ‘overload_cast_’ was not declared in this scope overload_cast_<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:115:40: error: expected primary-expression before ‘&’ token overload_cast_<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:115:41: error: expected primary-expression before ‘,’ token overload_cast_<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:115:43: error: expected primary-expression before ‘const’ overload_cast_<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:121:42: error: expected primary-expression before ‘const’ .def_static("Read", overload_cast_<const fst::string&>()(&PyClass::Read),

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/kaldi-asr/kaldi/issues/4253#issuecomment-731902487, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAZFLO4R6377AY5A2KDCJJDSRHF4TANCNFSM4QSQABFQ .

danpovey avatar Nov 23 '20 03:11 danpovey

This issue has been automatically marked as stale by a bot solely because it has not had recent activity. Please add any comment (simply 'ping' is enough) to prevent the issue from being closed for 60 more days if you believe it should be kept open.

stale[bot] avatar Jan 22 '21 04:01 stale[bot]