aabhasgupta issues

Repositories
Issues
Comments

Results 1 issues of


                                            aabhasgupta

DataCollatorForCompletionOnlyLM does not work with FSDP

[fsdp_qlora.txt](https://github.com/user-attachments/files/15917513/fsdp_qlora.txt) The loss is returned as NaN when using DataCollatorForCompletionOnlyLM with the FSDP pipeline (attached for reference) _"could not find instruction key `[882]` in the following instance: user "_ Upon...