transformerlab-app
transformerlab-app copied to clipboard
Error running llama trainer if no NVIDIA GPU
al-sadr and dadmobile both got:
ImportError: Using
load_in_8bit=True
requires Accelerate:pip install accelerate
and the latest version of bitsandbytespip install -i https://test.pypi.org/simple/ bitsandbytes
or pip install bitsandbytes`
Can be "fixed" by downgrading transformers to 4.30 although you gotta work through other errors. It looks like probably this:
https://stackoverflow.com/questions/76924239/accelerate-and-bitsandbytes-is-needed-to-install-but-i-did
But details at bottom worked for me.