shaoyanguo
Results
1
comments of
shaoyanguo
@xiaonans How to deploy this model（[Qwen/Qwen2-1.5B-Instruct-AWQ · Hugging Face](https://huggingface.co/Qwen/Qwen2-1.5B-Instruct-AWQ).） on TensorRT-LLM? because TensorRT-LLM only support fp16 transformer models. Thank you!