Alex McKinney

Results 71 comments of Alex McKinney

I think LoRA can be applied to arbitrary layers, but maybe the default is cross attention only. It is a good observation though that maybe more than that is needed.