Text-Classification-with-BERT-PyTorch-Implementation

A text classifier by fine tuning on pre-trained BERT for Sarcasm Detection in News Headlines (PyTorch Implementation)

Kaggle Notebook

Transfer Learning for Text Data In Pytorch (BERT)

Dataset

News Headlines Dataset For Sarcasm Detection

Pre Requisite

• python 3.7
• torch 1.1.0
• pytorch-transformers
• pandas
• numpy
• tqdm

Results (Train Accuracy / Validation Accuracy)

• Epoch 1 (69.89 / 81.16)
• Epoch 2 (83.52 / 83.64)
• Epoch 3 (87.21 / 82.70)
• Epoch 4 (89.38 / 85.23)
• Epoch 5 (91.09 / 85.54)
• Epoch 6 (92.23 / 85.86)