trlx icon indicating copy to clipboard operation
trlx copied to clipboard

Published 20 hours ago • verified publisher icon CarperAI

Colab + Accelerate Integration issue

Open steventkrawczyk opened this issue 2 years ago • 1 comments

🐛 Describe the bug

Running into the following on colab notebook: AttributeError: 'AccelerateSFTTrainer' object has no attribute 'make_experience'

Screen Shot 2023-02-19 at 10 11 21 PM

Which trlX version are you using?

Pulled from git and installed

Additional system and package information

3.8, using colab

steventkrawczyk avatar Feb 20 '23 06:02 steventkrawczyk

Hi, are you using some of our existing examples? If not, if you wish to use AccelerateSFTTrainer can you please try removing rewards argument from the trlx.train call and see if this would get resolved?

maxreciprocate avatar Feb 20 '23 10:02 maxreciprocate