thanhnew2001
thanhnew2001
Hello all, I am trying to fine tune Falcon-7b for instruction related to code generation. The code I want to generate is Taipy format (https://www.taipy.io/) Here is a sample of...
Qlora requires much less GPU, currently lit-parrot only supports lora. Is there any plan for supporting qlora as well? It would be a huge advantage for users like us.
Hello, I tried your script and the resulting model took about 10 hours to train on single 3060 but the quality is still not very good. How could I improve...