Zai Thottakath issues

Repositories
Issues
Comments

Results 2 issues of


                                            Zai Thottakath

Allow the entire model to be targed for LoRA and DoRA fine tuning: LoRA and DoRA embeddings with small DoRALinear bug fix

- Added in `LoRAEmbedding` and `DoRAEmbedding` with tests so that embeddings can be targeted for fine tuning. - Added in the ability to target all `Linear` and `Embedding` modules regardless...

Feature: QDoRA

- Made the `DoRALinear` layer work with `QuantizedLinear` - Tests for `DoRALinear` - bug fix for recalculating the magnitude (`self.m`) when changing the linear layer of the `DoRALinear` instance