woskii

When I build from source, there is an error: `[ 75%] Linking CUDA device code CMakeFiles/lightseq.dir/cmake_device_link.o [ 76%] Linking CXX shared module lightseq/inference.cpython-36m-x86_64-linux-gnu.so /opt/rh/devtoolset-8/root/usr/libexec/gcc/x86_64-redhat-linux/8/ld: cannot open output file lightseq/inference.cpython-36m-x86_64-linux-gnu.so: No...

I have this question too. Have you figured out the necessary to build from source?

> > I have this question too. Have you figured out the necessary to build from source? > > no, I haven't, the author implements the code in official Pytorch...

ImportError: /usr/local/lib/python3.10/dist-packages/tensorrt_llm/libs/libth_common.so: undefined symbol: _ZN5torch6detail10class_baseC2ERKSsS3_SsRKSt9type_infoS6_ FATAL: Decoding operators failed to load. This may be caused by the incompatibility between PyTorch and TensorRT-LLM. Please rebuild and install TensorRT-LLM. =================================================================== I solved...