Akshara Prabhakar

icon indicating a website link https://aksh555.github.io icon indicating an email [email protected]

icon company Salesforce Research icon location ca, usa icon location @SalesforceAIResearch | @princeton-nlp '24

Results 1 issues of Akshara Prabhakar

LoRA MoE with k_proj, up_proj, down_proj

5 comment

Hi, thanks for the library! When we try to compose LoRA experts that have k_proj, up_proj, down_proj in the target_modules, we face a shape mismatch error. Everything works fine when...

bug