[Help wanted] RoBERTa: A Robustly Optimized BERT Pretraining Approach

[jaeyounkim]

Help wanted: Research paper code and models

Please help us to implement the following research paper using TensorFlow 2.

If you want to contribute, please leave a comment to express your interest.

Research paper

• RoBERTa: A Robustly Optimized BERT Pretraining Approach

Status

• Need contribution

Contributor(s)

• Waiting for contributions

Tasks

• Implement a paper in TensorFlow 2
• Reproduce the paper results
• Publish documentation
• Publish pre-trained SavedModel files at TensorFlow Hub

Development environment

• Target
  • Repository: Official NLP directory
  • Directory: https://github.com/tensorflow/models/tree/master/official/nlp/roberta

Requirements

• Follow our contribution guidelines

License

By contributing, you agree that your contributions will be licensed under Apache License 2.0.

[PradipNichite]

Hi, @jaeyounkim is it still open for contribution. I would like to contribute, please let me know.

[Harsh188]

I'm currently working on implementing BERT for a personal project. I'm open to contribute!

[guptadhaval18]

@jaeyounkim I was looking to contribute. But I this the code is already provided here. Please see and let me know if I can somehow help.

[pankajrajput0312]

@jaeyounkim If no one is working on this paper implementation I can start working on it. I'm open to contribute

[rutvij-25]

I'm open to contributing I am familiar with transformers and BERT, let me know if I can start my work. Would love to contribute!

[ARGF0RCE]

I wish to contribute to this implementation. Please assign me this issue.