mistral.rs
mistral.rs copied to clipboard
Implement the Starcoder 2 model architecture
- [x] Loader and model
- [ ] ISQ
- [ ] AnyMoE
- [ ] Device Mapping
- [ ] X-LoRA/LoRA
- [ ] Adapter activation