LLaMA-Factory icon indicating copy to clipboard operation
LLaMA-Factory copied to clipboard

Published 20 hours ago • verified publisher icon hiyouga

Support 8 bit sft for fsdp+qlora

Open mces89 opened this issue 9 months ago • 0 comments

Reminder

  • [X] I have read the README and searched the existing issues.

Reproduction

Currently the fsdp+qlora only supports int4, is there any reason not supporting int8 too?

Expected behavior

No response

System Info

No response

Others

No response

mces89 avatar May 01 '24 22:05 mces89