LLaMA-Factory icon indicating copy to clipboard operation
LLaMA-Factory copied to clipboard

Can lora_target have more detailed options and documentation?

Open xsq2023 opened this issue 10 months ago • 1 comments

Reminder

  • [x] I have read the above rules and searched the existing issues.

Description

Can lora_target have more detailed options and documentation?

Pull Request

No response

xsq2023 avatar Apr 08 '25 01:04 xsq2023

Maybe you can check the test code here. I thought the test code described enough.

https://github.com/hiyouga/LLaMA-Factory/blob/52f25651a2016ddede2283be17cf40c2c1b906ed/tests/model/test_lora.py#L73

def test_lora_train_all_modules(): model = load_train_model(lora_target="all", **TRAIN_ARGS) linear_modules, _ = check_lora_model(model) assert linear_modules == {"q_proj", "k_proj", "v_proj", "o_proj", "up_proj", "gate_proj", "down_proj"}

PatrickWong-China avatar May 06 '25 08:05 PatrickWong-China