Will there be a Codellama based on Llama 3?

[PhilKes]

Is there going to be an updated version of Codellama based on Meta's new LLaMa 3 ?

[hyperbolic-c]

Same question！Looking forward to the model based on llama3!

[bgruszka]

It would be great to have it based on llama 3 😄

[bmaciag]

Same question.

[TheLapinMalin]

Apparently Llama 3 has already been trained on a lot more code than Llama 2.

So, do we need a full blown Codellama 3 model, or do you think a FIM fine-tune of Llama 3 would be sufficient?

[PhilKes]

Apparently Llama 3 has already been trained on a lot more code than Llama 2.

So, do we need a full blown Codellama 3 model, or do you think a FIM fine-tune of Llama 3 would be sufficient?

Would love to see a FIM fine-tune of Llama 3, I dont have any insights on how the training process differed from Llama 2. Is there anyone working on a FIM fine-tune? Haven't seen one yet on HF

[reneleonhardt]

Would love to see a FIM fine-tune of Llama 3, I dont have any insights on how the training process differed from Llama 2. Is there anyone working on a FIM fine-tune? Haven't seen one yet on HF

Supposedly StarCoder2 should be perfect for FIM 😅

[hschaeufler]

Would also love to see a Code Llama Version based on LLama 3. Llama 3 70b seems to perform better on coding-Tasks than Code Llama 70b.

[DevopsDood]

3.1:70b will be :fire:

[ShahNewazKhan]

+1