ydy

SGLang Launch error with Qwen2.5-14B draft model, need help

8

My target model is Qwen-2.5-14B I Use default config train a draft model, the train_eagle3_online.py generated a eagle3-config.json， content is: { "architectures": [ "LlamaForCausalLMEagle3" ], "bos_token_id": 151643, "eos_token_id": 151645, "hidden_act":...