Chen Cui

icon company NVIDIA icon location Santa Clara, CA

Results 19 comments of Chen Cui

Sequence Parallel for LoRA

jenkins

Sequence Parallel for LoRA

jenkins

Sequence Parallel for LoRA

jenkins

Sequence Parallel for LoRA

jenkins

Sequence Parallel for LoRA

Known issue: `model.ub_tp_comm_overlap=True` is not supported for LoRA + SP

Sequence Parallel for LoRA

jenkins

Add LoRA support to all linear layers

jenkins

Add LoRA support to all linear layers

jenkins

Add LoRA support to all linear layers

i think CI issue is blocked by #8342

Add LoRA support to all linear layers

jenkins