Esperanto-mega

When simply replacing 'llama-2 7b' with 'llama-3 8b' in a finished repo, a NCCL error occurs, with traceback as follows. > Traceback (most recent call last): File "pre-train.py", line 124,...

Original Traceback (most recent call last): File "/home/data/yh/miniconda/envs/nudt/lib/python3.8/site-packages/torch/utils/data/_utils/worker.py", line 302, in _worker_loop data = fetcher.fetch(index) File "/home/data/yh/miniconda/envs/nudt/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 32, in fetch data.append(next(self.dataset_iter)) File "/home/data/yh/nudt/graph_weather-main/train/run.py", line 428, in __iter__ day_of_year =...