Luucy

icon company Xiamen University icon location Xiamen,China icon location I am luxi lin，a student in Xiamen University, I am eager to learn on GitHub and contribute my part to this community.

Results 2 comments of Luucy

[Question] Modified the usecache parameter without changing it

```python # 4. Define other model kwargs model_kwargs["output_attentions"] = generation_config.output_attentions model_kwargs["output_hidden_states"] = generation_config.output_hidden_states # decoder-only models with inputs_embeds forwarding must use caching (otherwise we can't detect whether we are #...

Inconsistent response of Qwen2-7B-Instruct and LLaMA3-8B-Instruct in EAGLE and transformers

I also encountered the same problem.