IvanDeng0

Deploy EAGLE-Qwen2 in vllm

8

Thanks for your great work, I would like deploy Qwen2-7B-Instruct in vllm, my current command is: `python3 -m vllm.entrypoints.openai.api_server \ --host 0.0.0.0 \ --trust-remote-code \ --dtype half \ --max-model-len 32768...