araleza

Results 5 issues of araleza

Hey, thanks for providing this super resolution network, it's produced some great output for me. I do have an issue to report though. As well as upsampling the image, the...

### Describe the bug Hi, I 'git clone'd a fresh checkout of webui, and then ran ./start_linux.sh. It installed some stuff, but then failed with: ``` ******************************************************************* * WARNING: You...

bug

So I have a GPTQ llama model I downloaded (from TheBloke), and it's already 4 bit quantized. I have to pass in False for the load_in_4bit parameter of: ``` model,...

on roadmap
help wanted

Looking at the DoRA paper, it seemed to get impressive results: ![image](https://github.com/unslothai/unsloth/assets/70412719/ece56d8b-6dcb-4e09-9af4-24ac0ad1e57b) From: https://arxiv.org/pdf/2402.09353 There even seemed to be some indications that QDoRA could outperform full fine tuning: ![image](https://github.com/unslothai/unsloth/assets/70412719/4bae1187-5f66-4911-b655-41a26971a465) Is...

If you finetune SDXL base with: ``` --train_text_encoder --learning_rate_te1 1e-10 --learning_rate_te2 1e-10 --fused_backward_pass ``` Then it will train fine. But if you stop training and restart by training from the...