FSDP with Mistral

[SicariusSicariiStuff]

What piece of documentation is affected?

https://github.com/OpenAccess-AI-Collective/axolotl/tree/main/examples/mistral

What part(s) of the article would you like to see updated?

There's FSDP example with mixtral (which is awesome!) but no example with Mistral. (It uses a different decode layer)

Additional Information

Can you please include and example for Mistral with FSDP offload?

Acknowledgements

• [X] My issue title is concise, descriptive, and in title casing.
• [X] I have searched the existing issues to make sure this feature has not been requested yet.
• [X] I have provided enough information for the maintainers to understand and evaluate this request.