hyyuananran

Results 2 issues of hyyuananran

### Your current environment ```text The output of `python collect_env.py` ``` ### How would you like to use vllm I want to run inference of a [specific model](put link here)....

usage

### Your current environment python -m vllm.entrypoints.api_server --host 0.0.0.0 --port 8088 --model /app/minicpmo26 --dtype auto --tensor-parallel-size 1 --gpu-memory-utilization 0.9 --trust-remote-code video: {"model":"minicpmo26", "messages":[{ "role": "user", "content": [ { "type": "text",...

bug