Leonard Ritter

Results 12 comments of Leonard Ritter

> Right now I am forcing device_map to use only the GPU, ie adding `device_map={'': 0}` to `PeftModel.from_pretrained`, which worked. had the same problem with the stock generate.py, this fixed...