Integrate experiment tracker(s) with llama-recipes

[dushyantbehl]

🚀 The feature, motivation and pitch

We've been utilizing llama-recipes to fine-tune Llama 7B and 13B models for various scenarios and have recognized the need for incorporating a tracking system to monitor our diverse experimental runs. In our repository fork, we've already integrated Aimstack (https://aimstack.io/) as a sample tracker alongside the codebase.

We're now contemplating whether this feature would be welcomed by the broader upstream community. If there is interest from the community, we're more than willing to submit a pull request to this repository.

Our PR will involve a generic tracker API with AIMstack as one of the first modules integrated with the codebase.

Please let me know your feedback.

Alternatives

No response

Additional context

No response

[nairbv]

cc @chauhang @HamidShojanazeri we're happy to submit a PR, but would like confirmation that aimstack integration would be welcome in this codebase.

I believe we can add it in a way that users without an aimstack account/server wouldn't be affected.

[HamidShojanazeri]

Thanks @dushyantbehl @nairbv for the interest in recipe, for sure the feature seems very much needed, will review and get back to you.

[dushyantbehl]

Thanks @HamidShojanazeri we are working on it and will raise it in a few days. Looking forward to it 🙂

[kiamesdavies]

@dushyantbehl do you have a sample incorporation of https://aimstack.io/ alongside this codebase

[dushyantbehl]

Yes I will share the code in a few days as I had been busy with some work @kiamesdavies Sorry for the delay if it is affecting any work.

[kiamesdavies]

@dushyantbehl thank you

[dushyantbehl]

@kiamesdavies long time but you can test the code present in the PR as it has the integration set now.