fsdp_qlora icon indicating copy to clipboard operation
fsdp_qlora copied to clipboard

Published 20 hours ago • verified publisher icon AnswerDotAI

Torch Compile?

Open jzhang38 opened this issue 11 months ago • 0 comments

Thanks for such wonderful work! I see you comment out this line:

https://github.com/AnswerDotAI/fsdp_qlora/blob/d7818ec86d17f37db4beef36f80870cbcac37957/train.py#L722

May I ask what is the rationale behind it? Is fsdp_qlora compatible with torch compile?

jzhang38 avatar Mar 19 '24 10:03 jzhang38