Adamyangs

> It's [in the `original` folder.](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/blob/main/original/tokenizer.model) Because the `transformers` compatible version only needs `tokenizer.json` 🤗 It seems the `tokenizer.model` within the provided directory is encountering issues and fails to load...

Hello, @YTianZHU , I tried implementing a diff transformer using huggingface. But I can't reproduce your experimental results. In the experiment, the ordinary transformer performed better than the diff transformer....

Thank you for your response. My setting seems like a fair method of comparison. If the Diff model only surpasses a regular transformer under the condition of having the same...

Hi, @YTianZHU Thank you so much for your thoughtful and detailed responses to my questions. I truly appreciate the time and effort you took to assist me. Your insights have...