Open-Llama
Open-Llama copied to clipboard
The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.
Results
16
Open-Llama issues
Sort by
recently updated
recently updated
newest added
这种重复生成的问题是什么原因导致的,好像每次当inputs长度比较长的时候就容易触发重复生成,这个问题可以怎么解决?
Hi @s-JoL, thank you very much for your efforts making llama open to the community. I got some question when benchmarking the training speed: My environment: One node with 8...
v2的模型使用了RLHF吗,为什么效果提升了这么多
![image](https://github.com/s-JoL/Open-Llama/assets/21303438/8d7a30b8-be46-4a0a-a4b9-abf6af702d85)
您好,我在多机多卡训练启动时遇到了一些报错,请问您多机训练时ds_stage3_offload中的参数具体是怎么设置的?