Mingxiaoli

run example error

1

When I went to the trouble of installing it, I found a bug that I couldn't fix(the code is your example): Traceback (most recent call last): File "C:/Users/mingxiaoli/PycharmProjects/rl_v1/main.py", line 9,...

NET/IB : Got completion from peer 11.214.147.122<39138> with error 12, opcode 0, len 0, vendor err 129

1

[E ProcessGroupNCCL.cpp:455] Some NCCL operations have failed or timed out. Due to the asynchronous nature of CUDA kernels, subsequent GPU operations might run on corrupted/incomplete data. [E ProcessGroupNCCL.cpp:460] To avoid...

当我使用DeepSpeed试图多卡训练时，出现错误Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cuda:0!

9

Cupy Buffers Initialized Successfully. Pop out errors Finished the initialization step at rank 0 Pop out errors Finished the initialization step at rank 1 Using /root/.cache/torch_extensions/py310_cu116 as PyTorch extensions root......

### Is there an existing issue for this? - [X] I have searched the existing issues ### Current Behavior from transformers import AutoModel, AutoTokenizer import sys local_model_path = "my_local_checkpoint_path" #...

How to reproduce the result of 59.8 on humaneval with your wizardcoder? The result I reproduced is only 47.

3

I downloaded the model weight of wizardcoder on huggingface, and tested N=200 on humaneval. The test script is your humaneval_gen.py. temperature=0.2 top_p=0.95 is the same as that mentioned in your...

CentOs 7 distutils.errors.CompileError: command '/usr/bin/gcc' failed with exit code 1

2

Python 3.7.13 (default, Mar 29 2022, 02:18:16) [GCC 7.5.0] :: Anaconda, Inc. on linux Type "help", "copyright", "credits" or "license" for more information. >>> import mujoco_py running build_ext building 'mujoco_py.cymj'...

[root@xxxx Open-Sora]# python3 gradio/app.py /opt/miniconda/lib/python3.10/site-packages/colossalai/pipeline/schedule/_utils.py:19: UserWarning: torch.utils._pytree._register_pytree_node is deprecated. Please use torch.utils._pytree.register_pytree_node instead. _register_pytree_node(OrderedDict, _odict_flatten, _odict_unflatten) /opt/miniconda/lib/python3.10/site-packages/torch/utils/_pytree.py:254: UserWarning: is already registered as pytree node. Overwriting the previous registration. warnings.warn( /opt/miniconda/lib/python3.10/site-packages/colossalai/shardformer/layer/normalization.py:45:...