open_llama icon indicating copy to clipboard operation
open_llama copied to clipboard

Any plans to do openLlama2?

Open djaym7 opened this issue 2 years ago • 3 comments
trafficstars

Use Llama2 model and train on all latest and more efficient (like SlimPajama vs redpajama) open datasets ? Just for the base model, then maybe open-assistant team can rlhf it

djaym7 avatar Aug 10 '23 07:08 djaym7

i have the same question. Do you have plans for openllama2?

shaileshj2803 avatar Sep 04 '23 02:09 shaileshj2803

Same question

zkqiu avatar Sep 04 '23 09:09 zkqiu

It makes sense to train on RedPajama v2

ilyalasy avatar Dec 12 '23 11:12 ilyalasy