wili comments

Repositories
Issues
Comments

Results 1 comments of


                                            wili

ChatGLMHeadModel/layers/0/pre_norm/PLUGIN_V2_Rmsnorm_0: could not find any supported formats consistent with input/output data types

Thank you for coming up with this usage! In fact, all plugins (rmsnorm/layernorm, gemm, apt_attention) are set in FP16 in default even though building with `--dtype=float32`. If you need FP32...