Leonard Ritter
Results
12
comments of
Leonard Ritter
any news on this one?
> Right now I am forcing device_map to use only the GPU, ie adding `device_map={'': 0}` to `PeftModel.from_pretrained`, which worked. had the same problem with the stock generate.py, this fixed...