oecompmind comments

Repositories
Issues
Comments

Results 1 comments of


                                            oecompmind

When can we have a the MOE checkpoint convert script.

Here is some information about converting Huggingface checkpoints to Nemo. It seems there is a conversion script available on GitHub. Although I haven't confirmed it, it might be useful. https://medium.com/karakuri/train-moes-on-aws-trainium-a0ebb599fbda...