Jiarui Xu

icon indicating an email [email protected]

icon company University of Sydney icon location Sydney icon location Strive to thrive. An open-source contributor in AI community.

Results 3 comments of Jiarui Xu

ImportError and OSError When Importing tensorrt_llm in Python 3.10 Environment

Thank you for your response. Yes, I did run in the Docker image built by the Docker file provided. I believe I've installed `tensorrt_llm` successfully in this environment. However, I...

lac 默认使用最新paddle 会有兼容性问题，建议固定版本范围

@zhang19523zhao ```bash $ pip uninstall paddlepaddle $ pip install paddlepaddle==2.5.2 ```

[Usage]: Do I need to specify chat-template for Qwen model?

https://qwen.readthedocs.io/zh-cn/latest/deployment/vllm.html