dongteng comments

Repositories
Issues
Comments

Results 3 comments of


                                            dongteng

ner例子去除CRF层，出现：维度不一致错误

请问您这个去掉crf层的问题解决了吗?去掉crf层后面的回调函数什么的也需要改吧

GRPC: unable to provide 'prob' in GPU, will use CPU

> using CUDA shared memory to put the tensors into GPU. can you give some examples for "using CUDA shared memory to put the tensors into GPU." Thanks!

"Import Error: /libs/libth_common.so: Undefined Symbol" While Building

> ImportError: /usr/local/lib/python3.10/dist-packages/tensorrt_llm/libs/libth_common.so: undefined symbol: _ZN5torch6detail10class_baseC2ERKSsS3_SsRKSt9type_infoS6_ FATAL: Decoding operators failed to load. This may be caused by the incompatibility between PyTorch and TensorRT-LLM. Please rebuild and install TensorRT-LLM. > >...