transformers icon indicating copy to clipboard operation
transformers copied to clipboard

Add more model resources

Open stevhliu opened this issue 3 years ago β€’ 7 comments

A continuation of #19767 to add existing official resources (blog posts, notebooks, scripts, etc.) directly to the model docs for 20 of the most popular architectures based on last month's pageviews. I'm not sure whether there are existing resources for all of these models, but I'll check it out, and if not we can either:

  • Move to the next most popular model
  • Or it could be a good opportunity to create some resources for it

Tracking model progress and updates:

  • [x] BERT (see #19852)
  • [x] T5 (see #19878)
  • [x] RoBERTa (see #19911)
  • [x] GPT2 (see #19879)
  • [x] BLOOM (see #19881)
  • [x] BART (see #19928)
  • [x] ViT (assigned to @stanleycai95)
  • [x] DistilBERT (see #19930)
  • [x] Wav2Vec2 (see #19931)
  • [x] LayoutLMV3 (see #19932)
  • [x] CLIP (assigned to @ambujpawar, see #20190)
  • [ ] LayoutLM
  • [ ] GPT-J (assigned to @adit299)
  • [ ] TrOCR
  • [ ] LayoutLMV2
  • [ ] ALBERT (assigned to @JuheonChu)
  • [ ] OPT
  • [x] DeBERTa (assigned to @Saad135, see #20155)
  • [x] OpenAI GPT (assigned to @shogohida, see #20084)
  • [x] XLM-RoBERTa (assigned to @hazrulakmal)

stevhliu avatar Oct 24 '22 17:10 stevhliu

@stevhliu @NielsRogge is there a plan to add the additional vision tasks we currently support to this page? For example object detection, segmentation, video classification. Then there seems to be an entire section missing on multimodal models.

I understand for these tasks, we don't have pipelines yet. But I believe we can still enlist these tasks with our existing resources (notebooks, blog posts, scripts, etc.).

Another suggestion is to provide consolidated model links for each of the tasks enlisted in that page. For example, for image classification, it could be https://huggingface.co/models?pipeline_tag=image-classification.

WDYT?

Cc: @osanseviero @nateraw

sayakpaul avatar Nov 01 '22 04:11 sayakpaul

@stevhliu @NielsRogge is there a plan to add the additional vision tasks we currently support to this page?

Yes I've pinged @stevhliu yesterday about this ;) he's working on it

NielsRogge avatar Nov 01 '22 06:11 NielsRogge

Amazing! @stevhliu, if possible could tag me in the PR when you open it? Would love to take a look.

sayakpaul avatar Nov 01 '22 07:11 sayakpaul

For sure @sayakpaul! I'm working on a proposal to reorganize/update the tasks summary docs a bit to include the additional vision/multimodal tasks you mentioned.

Also great suggestion to link to the models; we can use these recently added icons in the docs :)

stevhliu avatar Nov 01 '22 19:11 stevhliu

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Jan 13 '23 15:01 github-actions[bot]

Hi, I am a newbie to open source and would like to contribute. @NielsRogge can I contribute to this issue?

avisinghal6 avatar Jan 27 '23 07:01 avisinghal6

Welcome @avisinghal6, we'd be more than happy for you to make a contribution! πŸ€—

The remaining models available are LayoutLM, LayoutLMV2, TrOCR, and OPT. Let me know which model you'd like to take on, and any questions you might have!

stevhliu avatar Jan 27 '23 17:01 stevhliu

@stevhliu, I can start working on LayoutLM model. So I need to search for existing official resources on hugging face website and attach relevant ones to the documentation of LayoutLM model ?

avisinghal6 avatar Jan 27 '23 19:01 avisinghal6

Yup, check out issue #20055 for a list of resources to search from and the BERT resources section for an example of what it should look like!

stevhliu avatar Jan 27 '23 20:01 stevhliu

@stevhliu, I have added the resources for LayoutLM. Commit : d360021d9caef517854e371f8ac286f1c0a4f802

avisinghal6 avatar Jan 28 '23 02:01 avisinghal6

Hi @avisinghal6, would you mind opening a pull request on the Transformers repository for your contribution? You can check out this guide for more details how. Thanks! πŸ˜„

stevhliu avatar Jan 30 '23 17:01 stevhliu

Hi @stevhliu, I have created the PR#21377

avisinghal6 avatar Jan 30 '23 22:01 avisinghal6

Hi @stevhliu - I want to add resources for LayoutLMv2. Will submit a PR soon.

SarangShrivastava avatar Feb 10 '23 09:02 SarangShrivastava

Looking forward to your contribution @SarangShrivastava!

stevhliu avatar Feb 10 '23 18:02 stevhliu

hey, @stevhliu I want to work on any of the model if its available

rajveer43 avatar Apr 07 '23 05:04 rajveer43

Hey @SarangShrivastava , just checking to see if you're still interested in making a model contribution. Totally cool if you aren't available anymore, I'll unassign you from the model you claimed and let someone else take a stab at it. Thanks!

@rajveer43 thanks for your interest! If any of the models free up, I'll let you know πŸ€—

stevhliu avatar Apr 20 '23 18:04 stevhliu

Hello @stevhliu I would like to make my first contribution to transformers and this looks like a great place to startπŸ˜„. Is there any way I can help? I can see all the models have been assigned is it possible to work on a model already assigned? Thanks in advance

y3sar avatar May 01 '23 07:05 y3sar

Thanks for the interest; ~TrOCR~, ~LayoutLMV2~, and ~ALBERT~ are now available!

stevhliu avatar May 01 '23 17:05 stevhliu

@stevhliu I would like to start working on LayoutLMV2.

y3sar avatar May 02 '23 03:05 y3sar

@stevhliu I have a question regarding 🌎 emoji. Exactly which resources should be marked by it? Thanks in advance

y3sar avatar May 02 '23 16:05 y3sar

🌎 is for unofficial Hugging Face resources, such as community-created ones. For example, if you look at the GPT2 resources, there are links to notebooks for generating lyrics and tweets from contributors :)

stevhliu avatar May 02 '23 16:05 stevhliu

@stevhliu thanks for the response. I noticed in BERT resources under text-classification a notebook by NielsRogge is not marked 🌎. Are these notebooks considered official?

y3sar avatar May 02 '23 17:05 y3sar

Hello @stevhliu I would like to make my first contribution to open source transformers and this looks like a great place to start. Is there any way I can help? Thanks in advance

unitinguncle avatar May 11 '23 17:05 unitinguncle

Hi, thanks for your interest @unitinguncle! Currently, all the models are taken but I'll let you know if something is available. In the meantime, feel free to also take a look at some of the Good First Issue's to see if there is anything else you may be interested in!

stevhliu avatar May 11 '23 18:05 stevhliu

Hello @stevhliu I would like to make my first contribution to transformers and this looks like a great place to startπŸ˜„. Is there any way I can make a contribution here? Thanks in advance

raj-pandey55 avatar Sep 24 '23 18:09 raj-pandey55

Thanks for your interest @raj-pandey55! It looks like ALBERT is the only model left to complete. @ENate, are you still interested in making a contribution? If not, I'll reassign it to @raj-pandey55 πŸ™‚

stevhliu avatar Sep 25 '23 16:09 stevhliu

@stevhliu I am still interested and hope to finish up the doc and open a pull request soon. Sorry for the delay (I am available again after some pause). I actually noticed that there is an issue with building the doc and commented already. Will do so soon.

ENate avatar Sep 25 '23 17:09 ENate

I commented about the issue under the link

https://github.com/PyAV-Org/PyAV/issues/1140 and will hope to at least the get the doc build. Thanks

ENate avatar Sep 25 '23 17:09 ENate

Thanks for letting me know @ENate . @stevhliu if any new opportunity comes up, please let me knowπŸ€—. Thanks in advance

raj-pandey55 avatar Sep 26 '23 06:09 raj-pandey55

Hi there! πŸ‘‹

Hello @stevhliu, I'm new to open source contributions, and I'm excited to start my journey by helping out here. I'm eager to learn and collaborate with the community. If there are any specific areas in the documentation that need attention, please let me know, and I'd be happy to take them on.

divyam-prajapati avatar Sep 26 '23 23:09 divyam-prajapati