Håkon Olav Torvik comments

Repositories
Issues
Comments

Results 2 comments of


                                            Håkon Olav Torvik

Lora initialisation with olora and pissa not working with quantisation.

I poked around in the olora_init-function in `peft/src/peft/tuners/lora/layer.py`. As @BenjaminBossan mentions, the difference between my script and the olora-example script is the `bnb_4bit_quant_storage`-flag in the BitsAndBytesConfig. Both scripts crash because...

Lora initialisation with olora and pissa not working with quantisation.

Finally had a chance to look at it now. This does indeed work. I noticed the solution only covers olora, not pissa. It was straight forward to copy the code...