Tim Moon comments

Results 227 comments of


                                            Tim Moon

Fp8 model init factory

I think initializing FP8 weights with a constructor kwarg makes a lot of sense. In effect, the `fp8_model_init` context is an indirect way of passing a boolean arg to the...

Can't build the TE wheel via pip (1 error detected in the compilation of "transformer_engine/pytorch/csrc/userbuffers/userbuffers.cu")

Are you building the 1.9 release or the main branch? This looks like an error that was fixed with https://github.com/NVIDIA/TransformerEngine/pull/949. If that doesn't fix it, perhaps it's something with the...