mistral.rs icon indicating copy to clipboard operation
mistral.rs copied to clipboard

Tracking issue for AnyMoE

Open EricLBuehler opened this issue 7 months ago • 0 comments

This is a tracking issue for the development of AnyMoE, which will be broken up into several PRs.

  • [x] Core functionality, plain models, all APIs: #476
  • [x] Support for vision models: #515
  • [ ] Support saving and loading gating layer: #519
  • [ ] Generate graph of loss
  • [ ] Read dataset from parquet instead of CSV

EricLBuehler avatar Jul 01 '24 13:07 EricLBuehler