Support for Aya 23 models.

[Respaired]

⚠️ Please check that this feature request hasn't been suggested before.

• [X] I searched previous Ideas in Discussions didn't find any similar feature requests.
• [X] I searched previous Issues didn't find any similar feature requests.

🔖 Feature description

This model is one of the Decoder-only LLMs (unlike the previous Aya model which was seq2seq) has some of the best multilingual capabilities I've ever seen. probably one of the best options for further fine tuning.

✔️ Solution

it'd be amazing if we can have a training script and support added for this family of models in Axolotl.

❓ Alternatives

No response

📝 Additional Context

No response

Acknowledgements

• [X] My issue title is concise, descriptive, and in title casing.
• [X] I have searched the existing issues to make sure this feature has not been requested yet.
• [X] I have provided enough information for the maintainers to understand and evaluate this request.