transformers icon indicating copy to clipboard operation
transformers copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Adding resource section to GPT-J docs

Open adit299 opened this issue 2 years ago • 3 comments

What does this PR do?

Adds resources section to the GPT-J documents.

Fixes #20055 (issue)

Before submitting

  • [X] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • [ ] Did you read the contributor guideline, Pull Request section?
  • [ ] Was this discussed/approved via a Github issue or the forum? Please add a link to it if that's the case.
  • [ ] Did you make sure to update the documentation with your changes? Here are the documentation guidelines, and here are tips on formatting docstrings.
  • [ ] Did you write any new necessary tests?

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag members/contributors who may be interested in your PR.

@sgugger @stevhliu @MKhalusova

adit299 avatar Jan 23 '23 20:01 adit299

The documentation is not available anymore as the PR was closed or merged.

HuggingFaceDocBuilderDev avatar Jan 23 '23 21:01 HuggingFaceDocBuilderDev

Hello,

I have been currently working on finding resources for GPT-J, and mainly I have been using the links mentioned in #20055 and searching GPT-J in each of the links. I found a few links, but I feel this is not the best way to find the resources. Can you share some tips for how you were able to find more resources? @stevhliu

What I have so far:

GPT-J Description:

  • https://huggingface.co/EleutherAI/gpt-j-6B

Blog Posts:

  • https://huggingface.co/blog/gptj-sagemaker
  • https://www.philschmid.de/gptj-deepspeed-inference

NielsRogge's Transformers Tutorials:

  • https://github.com/kingoflolz/mesh-transformer-jax

adit299 avatar Jan 26 '23 17:01 adit299

Thanks for your work, that's a great start and I think you have most of them! You can also add:

  • This GPT-J notebook from Niels Transformers Tutorials for inference.
  • A chapter in the Hugging Face Course for causal language modeling.
  • The example scripts and notebooks for causal language modeling and text generation (see the last three bullet points under the Resource section here for GPT-2).

stevhliu avatar Jan 26 '23 18:01 stevhliu

It looks like the formatting for the docs is still not correct..the bulletpoints are all jumbled up. Looking into this...

adit299 avatar Jan 28 '23 23:01 adit299

I have marked the pull request as ready to review 👍 @stevhliu

adit299 avatar Jan 30 '23 20:01 adit299