FunASR icon indicating copy to clipboard operation
FunASR copied to clipboard

LoRA模块有bug

Open fclearner opened this issue 1 year ago • 0 comments

https://github.com/alibaba-damo-academy/FunASR/blob/4854d398708594a13e3043daf1a19adfde970ea2/funasr/modules/lora/layers.py#L216

参考loralib的issue: https://github.com/microsoft/LoRA/issues/34 推理的时候没有用到eval(),所以权重没有合并进去

可以用他们的分支代码:https://github.com/microsoft/LoRA/tree/bugfix_MergedLinear

顺带着再贴个苏神的博客:https://kexue.fm/archives/9590

fclearner avatar Sep 27 '23 03:09 fclearner