DeepSpeedExamples icon indicating copy to clipboard operation
DeepSpeedExamples copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

when I am running RLHF script, I encountered a error

Open liuzhiyong01 opened this issue 1 year ago • 1 comments

image image My environments setting: deepspeed==0.9.0, torch==2.0.0+cu117 CUDA Version: 11.0 pretrained model is facebook/opt-350m

Who can help me solve this problem? Thanks

liuzhiyong01 avatar Apr 15 '23 09:04 liuzhiyong01

when I set enable_hybrid_engine=False, it's solved, what is the reason?

liuzhiyong01 avatar Apr 15 '23 10:04 liuzhiyong01

+1, same issue

nbl97 avatar Apr 26 '23 11:04 nbl97

+1

geldarr avatar May 06 '23 11:05 geldarr