When will the trained model be released?

[chenxshuo]

Hi there,

thank you very much for this awesome project! I wonder whether you are going to release the model that is trained on this dataset in the near future. If yes, when will it be?

Best regards

[vishaal27]

I have this same question too. I see that some of these model links are public: https://huggingface.co/HuggingFaceM4, however upon clicking them it shows a 404. Is there a planned release date for making them public?

[VictorSanh]

Hey @chenxshuo & @vishaal27 , thanks for your interest! We will be announcing officially around mid-week. The link will all become public at this time :)

[vishaal27]

@VictorSanh Thanks for the model release, looks super exciting. I just was wondering if you had a profiling table of the load times, inference times for a single moderately sized sequence, and necessary GPU memory for both the 9B and 80B models. On how many GPUs (and their specs) did you run the 80B evals? And were all the evals done in fp16/bf16?