JsingMog

icon indicating a website link https://www.jsingmog.top/

icon company University of Science and Technology of China icon location China icon location Artificial Intelligence, MLLM, RLHF, OCR

Results 3 comments of JsingMog

Only the first three lines of the input.flowchart are created as.svg

I have also encountered the same problem, have you solved it? How did you solve it?

While training GRPO, I noticed that my model crashes. Its loss is 0, its grad_norm and kl are both Nan, and it completes as “!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!””

My swfit version is 3.3.0 dev0, same problem, the grad clip seems not work. I use deepspeed zero2. ![Image](https://github.com/user-attachments/assets/f608b9c1-c00e-40b3-af16-8875ecdc5323)

My anonymous GitHub link generated by [https://anonymous.4open.science/](https://anonymous.4open.science/) cannot be opened.

I have the same question.