NEU-rzh issues

Repositories
Issues
Comments

Results 1 issues of


                                            NEU-rzh

[QUESTION] add_position_embedding=False in checkpoint_args during Llama3 8B training

**Your question** The error message during the execution of the llama3 training .sh is as follows: ``` [rank0]: Traceback (most recent call last): [rank0]: File "/workspace/wangws/Megatron-LM/pretrain_gpt.py", line 243, in [rank0]:...