About lora_vit.head bias

[zhongtao93]

Thank you for opensource code! I have a question about lora_vit.head. It seems when save lora fc weight(https://github.com/JamesQFreeman/LoRA-ViT/blob/45be249c6110c0c5686844aea073813eb1402e47/lora.py#L100) and switch lora fc weight(https://github.com/JamesQFreeman/LoRA-ViT/blob/45be249c6110c0c5686844aea073813eb1402e47/lora.py#L497), only save and load linear weight but no bias. But when using lora_vit, it seems bias=True in melo.lora_vit.head (examples.ipynb) , which cause a random init for head.bias. Is this a bug or what? Hoping for your reply~