joeynmt icon indicating copy to clipboard operation
joeynmt copied to clipboard

Sharing pre-trained models through Hugging Face

Open osanseviero opened this issue 4 years ago • 10 comments

Hi there! This project is awesome 🚀

Would you be interested in sharing your pre-trained models in the Hugging Face Hub? The Hub offers free hosting of over 25K models, and it would make your work more accessible and visible to the rest of the ML community. We can help you set up a joeynmt organization or filter for people to easily discover all joeynmt models and enable the community to easily share their own models.

Some of the benefits of sharing your models through the Hub would be:

  • versioning, commit history and diffs
  • repos provide useful metadata about their tasks, languages, metrics, etc that make them discoverable
  • multiple features from TensorBoard visualizations, PapersWithCode integration, and more
  • wider reach of your work to the ecosystem

Creating the repos and adding new models should be a relatively straightforward process if you've used Git before. This is a step-by-step guide explaining the process in case you're interested. There's also a Python library for programmatic access to models in the Hub.

Please let us know if you would be interested and if you have any questions.

Happy to hear your thoughts, Omar and the Hugging Face team

osanseviero avatar Oct 18 '21 12:10 osanseviero

This is awesome! I think Chris Emezue has already done that for the Masakhane JoeyNMT models.

juliakreutzer avatar Oct 21 '21 19:10 juliakreutzer

https://huggingface.co/spaces/chrisjay/masakhane-benchmarks

juliakreutzer avatar Jan 20 '22 23:01 juliakreutzer

Hi! Yes, Chris was able to do this integration but using a fork of this repo (https://github.com/chrisemezue/joeynmt). Would be cool to get this integrated/merged here :) cc @chrisemezue

osanseviero avatar Jan 21 '22 08:01 osanseviero

I am down to help with the merging @juliakreutzer

chrisemezue avatar Jan 21 '22 15:01 chrisemezue

Awesome, thank you @chrisemezue! Can you send a PR?

juliakreutzer avatar Jan 24 '22 23:01 juliakreutzer

Awesome, thank you @chrisemezue! Can you send a PR?

Okay. On it.

chrisemezue avatar Jan 25 '22 01:01 chrisemezue

#164 Done

chrisemezue avatar Jan 26 '22 16:01 chrisemezue

Thanks! I requested some changes, once they are resolved we can merge.

juliakreutzer avatar Feb 08 '22 19:02 juliakreutzer

Hi I am getting an error "No module named 'torchtext.legacy". I can't fix it. Please help me

ShadowVicky avatar May 10 '22 20:05 ShadowVicky

@ShadowVicky this was talked about here. TLDR: install these specific versions (it's a temporary fix):

torchtext==0.9.0
torch==1.8.0

chrisemezue avatar May 10 '22 20:05 chrisemezue

See #213

may- avatar Sep 04 '23 01:09 may-