LLaMA-Factory
LLaMA-Factory copied to clipboard
Can lora_target have more detailed options and documentation?
Reminder
- [x] I have read the above rules and searched the existing issues.
Description
Can lora_target have more detailed options and documentation?
Pull Request
No response
Maybe you can check the test code here. I thought the test code described enough.
https://github.com/hiyouga/LLaMA-Factory/blob/52f25651a2016ddede2283be17cf40c2c1b906ed/tests/model/test_lora.py#L73
def test_lora_train_all_modules(): model = load_train_model(lora_target="all", **TRAIN_ARGS) linear_modules, _ = check_lora_model(model) assert linear_modules == {"q_proj", "k_proj", "v_proj", "o_proj", "up_proj", "gate_proj", "down_proj"}