Jeremy Irvin

icon location PhD candidate in ML at Stanford University

Results 1 issues of Jeremy Irvin

Cannot resume from checkpoint when 8-bit LoRA fine-tuning with deepspeed zero2_offload

3 comment

### Describe the issue Issue: The error below occurs when trying to resume 8-bit LoRA fine-tuning using deepspeed zero2_offload. Any help to resolve this would be really appreciated. Note that...