Bugs that cannot support fp16 training

[RoboticsZhang]

After setting use_fp16 = True, some bugs occur: It seems that not all of the models and weights are converted to fp16? Looking forward to your reply, thank you