yeontaek.oh issues

Repositories
Issues
Comments

Results 1 issues of


                                            yeontaek.oh

[QUESTION] Is pretraining possible in Megatron using this method?

I've tried several approaches, but due to compatibility issues between the Transformer Engine (TE) version and the PyTorch version, I had difficulty getting Flux to work properly.