LoRA-ViT
LoRA-ViT copied to clipboard
JamesQFreeman
Low rank adaptation for Vision Transformer
Thank you for opensource code! I have a question about lora_vit.head. It seems when save lora fc weight(https://github.com/JamesQFreeman/LoRA-ViT/blob/45be249c6110c0c5686844aea073813eb1402e47/lora.py#L100) and switch lora fc weight(https://github.com/JamesQFreeman/LoRA-ViT/blob/45be249c6110c0c5686844aea073813eb1402e47/lora.py#L497), only save and load linear weight but...
Excuse me, I know lora a little, I use your method and I find it powerful in training. In my method, I save model as ".pth" after training and I...
Hello @JamesQFreeman, Thanks for your great code for easy re-implementation of LoRA in ViT. It's very useful for us to adapt to our own task. However, I have observed that...
