CrownZ

VLLM does not support EAGLE Spec Decode when deploying EAGLE-Qwen2-7B-Instruct model

1

I can successfully deploy llama3-8b-instruct with EAGLE. But there is a problem when deploying qwen2-7b-instruct with EAGLE. I have converted the EAGLE-Qwen2-7B-Instruct model according to[vllm/model_executor/models/eagle.py:L126](https://github.com/vllm-project/vllm/blob/8fae5ed7f6bfd63b81310fcb24b310d9205c9687/vllm/model_executor/models/eagle.py#L126). I encountered another error below:...