SicariusSicariiStuff

FSDP with Mistral

3

### What piece of documentation is affected? https://github.com/OpenAccess-AI-Collective/axolotl/tree/main/examples/mistral ### What part(s) of the article would you like to see updated? There's FSDP example with mixtral (which is awesome!) but no...

New Optimizer: Implement Adam-Mini optimizer

1

### ⚠️ Please check that this feature request hasn't been suggested before. - [X] I searched previous [Ideas in Discussions](https://github.com/OpenAccess-AI-Collective/axolotl/discussions/categories/ideas) didn't find any similar feature requests. - [X] I searched...

Unable to load ORPO dataset in a *.json file

1

### Please check that this issue hasn't been reported before. - [X] I searched previous [Bug Reports](https://github.com/axolotl-ai-cloud/axolotl/labels/bug) didn't find any similar reports. ### Expected Behavior Local dataset to work the...

### Please check that this issue hasn't been reported before. - [X] I searched previous [Bug Reports](https://github.com/axolotl-ai-cloud/axolotl/labels/bug) didn't find any similar reports. ### Expected Behavior To work the same as...