Yun Zhao

### Your current environment ```text The output of `python collect_env.py` ``` ### How would you like to use vllm I want to run inference of a [specific model](put link here)....

How to test the benchmark of Llama3 and Vicuna2 of TensorRT-LLM by benchmark.py

4

I need to test the benchmark of different models, but it does not in the allowed_configs.py. How to do it? Thanks