support LORA-GA

[AlexYoung757]

Reminder

• [X] I have read the README and searched the existing issues.

System Info

None

Reproduction

None

Expected behavior

Support LORA-GA algorithm: https://arxiv.org/pdf/2407.05000

Others

None

[Cloopen-ReLiNK]

+1

[oscarhscc]

+1 非常棒的lora改造，期待支持

[pengxia24]

+1

[13613979212]

+1

[qet2211pm]

+1

[liuzhi136]

期待支持，这个确实厉害

[Green-li]

+1 mark

[gotzmann]

+1

[cipolee]

+1

[SlightwindSec]

+1

[llm172]

+1

[sickerin]

+1