zi

I modified some of the Pythia models to use LLaMAMoE. However, it didn't run properly. I attached the the full log below, but in short, the line ` token_idx, expert_idx...