[Feature] I try to use instruction tuning to fine-tune llama model and get a new alpaca model. How to use compass to evaluate the local alpaca model on MMLU and other datasets

[sglucas]

Describe the feature

How to use compass to evaluate the local alpaca model on MMLU and other datasets

Will you implement it?

• [ ] I would like to implement this feature and create a PR!

[tonysy]

LLama format or huggingface format?

[sglucas]

Hi,

huggingface format