guokan

Hi, I have a question: we utilze GCN with A*X*W, but in your model.py, I find it become W*X*A, Why?

code: result_dora = (mag_norm_scale - 1) * (F.linear(x, transpose(weight, self.fan_in_fan_out)) ) + mag_norm_scale * lora_B(lora_A(x)) * scaling Question: what is the effect of (mag_norm_scale - 1) and mag_norm_scale ? And,...