sujankarki269

Can you show me training result and hyperparameters? Did you fine tune using UNSLOTH?

phi-3.5-mini-instruct model have o_proj and qkv_proj so why are you adding ["q_proj", "k_proj", "v_proj", "o_proj", "gate_proj", "up_proj", "down_proj",] in targeted modules? see the layers in below image and see what...

 when i fine tune like this only o_proj is adjusted by lora  this is because there is a single qkv_proj layer.

> I just debricked mi 4a gigabit here are the notes I wrote while doing it > > 1. Download firmware from https://mirom.ezbox.idv.tw/en/miwifi/R4A/roms-stable/ > 2. Download debrick tool from https://hoddysguides.com/xiaomi-debrick-tools-all/...