yeppp27

Hello! Thanks for your interesting work! I have some doubt about the mask in relative bias table: if we already have attn+mask, why still need to multiply mask and res_pos:...

Script about qlora.

7

Hi! Thanks for your great work. Can you provide the script with Qlora fine-tuning?