RL4LMs icon indicating copy to clipboard operation
RL4LMs copied to clipboard

Published 20 hours ago • verified publisher icon allenai

Any plans for Deepspeed/Accelerate integration?

Open Breakend opened this issue 1 year ago • 9 comments

Hi, great library! I'm wondering if you have any plans for deepspeed or accelerate integration to train larger models (e.g., GPT-J)?

Breakend avatar Oct 18 '22 07:10 Breakend