Austin Veselka

Lighton Toward AGI. LLM R&D Engineer at Lighton.

Results 2 comments of


                                            Austin Veselka

[Bugfix] Fixed error in slice_lora_b for MergedQKVParallelLinearWithLora

Ping @Yard1.

[Bugfix] Fixed error in slice_lora_b for MergedQKVParallelLinearWithLora

Good point, it is done. Also updated the fully sharded layers to match.