transformerlab-app icon indicating copy to clipboard operation
transformerlab-app copied to clipboard

Error running llama trainer if no NVIDIA GPU

Open dadmobile opened this issue 11 months ago • 0 comments

al-sadr and dadmobile both got:

ImportError: Using load_in_8bit=True requires Accelerate: pip install accelerate and the latest version of bitsandbytes pip install -i https://test.pypi.org/simple/ bitsandbytes or pip install bitsandbytes`

Can be "fixed" by downgrading transformers to 4.30 although you gotta work through other errors. It looks like probably this:

https://stackoverflow.com/questions/76924239/accelerate-and-bitsandbytes-is-needed-to-install-but-i-did

But details at bottom worked for me.

dadmobile avatar Mar 11 '24 18:03 dadmobile