Abigbigbig

Results 5 comments of Abigbigbig

I trained qwen2.5-vl-7B-eagle3 using the latest specforge 0.1.1 and sglang 0.5.5, and encountered ”AttributeError: 'Qwen2_5_VLForConditionalGeneration' object has no attribute 'set_aux_hidden_states_layers'“. I didn't have this issue when using the version before...

> was this using sglang for target backend or huggingface? I didn't modify the specforge source code, I trained directly using “examples/run_qwen2_5-vl_eagle3_online.sh”,“#!/bin/bash SCRIPT_DIR=$( cd -- "$( dirname -- "${BASH_SOURCE[0]}" )"...

> > was this using sglang for target backend or huggingface? > > I didn't modify the specforge source code, I trained directly using “examples/run_qwen2_5-vl_eagle3_online.sh”,“#!/bin/bash > > SCRIPT_DIR=$( cd --...

> Can you try the following: > > Remove the following code: > > ``` > if is_online: > if ( > args.is_vlm > and draft_model_config.target_model_type == "qwen2_5_vl" > and...

> > Can you try the following: > > Remove the following code: > > ``` > > if is_online: > > if ( > > args.is_vlm > > and...