Priyanka

@ItsLogic I get the error while fine-tuning 13B on 2 quadro 24GB. Setting the micro_batch_size to 2 does not help either. What are your training params? the same code works...

Update. bitsandbytes==0.37.2 solved the problem. I had bitsandbytes==0.39.0 previously.

Changing bitsandbytes==0.37.2 fixed the problem for me. I had bitsandbytes==0.39.0 earlier.