ldh127

使用readme 里的docker 镜像跑LLMPreProj 这个工程,会报这个错误呢，辛苦帮忙看啥为啥呢？

1

[2023-10-08 14:58:00,215] [INFO] [launch.py:162:main] dist_world_size=1 [2023-10-08 14:58:00,215] [INFO] [launch.py:164:main] Setting CUDA_VISIBLE_DEVICES=0 [2023-10-08 14:58:01,975] [INFO] [comm.py:652:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl > initializing model parallel with size 1 Traceback...

XX

2

docker 报错了

when i use trlx ppotrainer train a model llama 13b model, but saved huggingface mode ,but when it inference , it has some strange keys ,and the inference result did not show ,it also have no error , it seems the result disapper

1

### 🐛 Describe the bug trainer = trlx.train( reward_fn=reward_fn, prompts=prompts, eval_prompts=["习近平女儿"] * 4, config=config, ) trainer.save_pretrained('./rl_saved_finished_hf_1202', safe_serialization=False, heads_only=True) the model can not inference right, it has no error ,but the...