Fan Xiao

https://github.com/victorShawFan

Fudan University Shanghai A gradStudent of FDU_ major in computer science_ interested in knowledge graph and natural language processing 知乎名：蜡笔小熊猫

Results 3 issues of


                                            Fan Xiao

PPO采用zero 3 stage后产生time out error

5

comment

脚本修改如下，ckpt换为Qwen：

可以增加支持SimPO吗

3

comment

SimPO https://arxiv.org/html/2405.14734v1 https://github.com/princeton-nlp/SimPO/tree/main

使用Deepseek-lite训练DPO，显示expected mat1 and mat2 to have the same type, but got: float != c10: : BFLoat16

3

comment