EAGLE

EAGLE copied to clipboard

How to train eagle3 and support qwen2

7

How can we train eagle3 and support qwen2? We want to implement it in our business, but we didn't find any code for training eagle3 in the project.

skylee-01

Eagle Training Parameters and Hardware Requirements

1

Thank you for your work! I'm currently trying to reproduce your Eagle-1 and Eagle-3 training. Could you please share what hardware was used for training, the batch size used, number...

idankinderman

Acceptance rate is extremely low when runing the speculative decoding process.

1

I'm having a problem in model training and acceptance rate testing process. Here's the steps I followed. 1、Runing EAGLE/eagle/train/main.py to train the llama-2-7b-chat-hf model on full_hh_rlhf dataset. Below are the...

lxnlxnlxnlxnlxn

Clarification on d2t and t2d Mapping Logic in EAGLE-3 Draft Model

5

Hi, thank you for the great work on this project. I was reviewing the Model class in model/cnets.py and noticed that d2t and t2d are declared within the class. Since...

junghye01

How to train eagle3 with the new loss?

25

Hello Eagle team, I am checking the new [EAGLE3 PR]((https://github.com/SafeAILab/EAGLE/commit/f2f2366485f092f9d0ffb0bc0c6bd174e69083bf) and can't locate the loss function change. Not sure how to train the model using EAGLE3 that 1) removes the...

carlbunny

Potential Ablation Studies on Architectural Changes in EAGLE3

3

Dear EAGLE authors, Congrats on a great series of work! I have a suggestion on performing an additional ablation study to understand the impact of architectural changes, in particular, adding...

luyuzhe111

Inconsistent response of Qwen2-7B-Instruct and LLaMA3-8B-Instruct in EAGLE and transformers

3

The response are consistent of `Llama-2-7b-chat-hf` in `EAGLE` and `transformers`, but the inference results of `Qwen2-7B-Instruct` and `LLaMA3-8B-Instruct` are inconsistent. ## Prompt This is a prompt from `gpqa` benchmark. ```json...

FuryMartin

No module named 'eagle.ge_data'

4

Follow readme train start comman: `python -m eagle.ge_data.allocation --outdir [path of data]` got error: ``` Error while finding module specification for 'eagle.ge_data.allocation' (ModuleNotFoundError: No module named 'eagle.ge_data') ```

Lzhang-hub

Questions on EAGLE-3 training-time test and request for training code release

1

Hi, Thank you for your great work on EAGLE-3. I am writing to ask a few questions regarding the training process, especially the **training-time test technique**, and to inquire about...

junghye01

GPU specification used for EAGLE-3 training and inference?

1

Hello, I'm currently studying your work and would like to reproduce your experiments more precisely. Could you please share the GPU specifications (e.g., model type, number of GPUs, memory capacity)...

junghye01