nebuly icon indicating copy to clipboard operation
nebuly copied to clipboard

[Chatllama] error when load dataset when use deepspeed

Open bino282 opened this issue 1 year ago • 5 comments

hi, when I use deepspeed , I encountered this error: [2023-03-09 10:46:33,647] [INFO] [logging.py:77:log_dist] [Rank 0] DeepSpeed Flops Profiler Enabled: False Traceback (most recent call last): File "/datahdd/nhanv/Projects/NLP/chatllama/artifacts/main.py", line 50, in actor_trainer = ActorTrainer(config.actor) File "/home/ntq/miniconda3/envs/textgen/lib/python3.10/site-packages/chatllama/rlhf/actor.py", line 324, in init ) = deepspeed.initialize( File "/home/ntq/miniconda3/envs/textgen/lib/python3.10/site-packages/deepspeed/init.py", line 125, in initialize engine = DeepSpeedEngine(args=args, File "/home/ntq/miniconda3/envs/textgen/lib/python3.10/site-packages/deepspeed/runtime/engine.py", line 319, in init self.training_dataloader = self.deepspeed_io(training_data) File "/home/ntq/miniconda3/envs/textgen/lib/python3.10/site-packages/deepspeed/runtime/engine.py", line 1674, in deepspeed_io raise ValueError("Training data must be a torch Dataset") ValueError: Training data must be a torch Dataset How can I fix it?

bino282 avatar Mar 09 '23 03:03 bino282