Natural Language Processing

This is the Natural Language Processing repository of IvLabs and contains implementation of various architectures, starting from "Character Level RNN(s)" built from scratch, up to and including the almighty "Transformer" architecture. Further, we have also included a rough roadmap for enthusiasts with basic knowledge of Machine/Deep Learning.

We have implemented and compared the following architectures:

• [x] Character Level RNN (Char RNN)

  • [x] From scratch
  • [x] Vanilla RNN
  • [x] LSTM
  • [x] GRU

• [x] Language Models (Word RNN)

  • [x] Vanilla RNN
  • [x] LSTM
  • [x] GRU

• [x] Neural Machine Translation
  For Neural Machine Translation, we have implemented the following papers.

  • [x] Sequence to Sequence Learning with Neural Networks
  • [x] Neural Machine Translation by Jointly Learning to Align and Translate
  • [x] Convolutional Sequence to Sequence Learning
  • [x] Attention Is All You Need

The pending tasks and resources for studying and understading the required concepts will be added soon.

Contributors:

• Rishika Bhagwatkar
• Khurshed P. Fitter
• Aneesh A. Shetye
• Diksha Bagade
• Kshitij Ambilduke
• Ajinkya Deshpande
• Prayash Swain
• Thanmay Jayakumar
• Fauzan Farooqui