Chen Cui comments

Repositories
Issues
Comments

Results 19 comments of


                                            Chen Cui

Add LoRA support to all linear layers

jenkins

Add LoRA support to all linear layers

jenkins

Add LoRA support to all linear layers

jenkins

Add LoRA support to all linear layers

jenkins

Add LoRA support to all linear layers

jenkins

Handle in HF AutoTokenizer with pad_token=None

jenkins

Fix nemo_llama_to_hf conversion

jenkins

Multi-GPU QLoRA?

Thanks for the fast response! Looking forward to it :)

Multi-GPU QLoRA?

Hi @kartikayk, I'm currently doing some exploratory studies on QLoRA vs LoRA, so I was looking for a more apples-to-apples comparison because LoRA for a larger model like 34B or...