bert_quora_question_pairs

bert_quora_question_pairs copied to clipboard

BERT Fine-tuning on Quora Question Pairs

This repo contains google colab notebooks for finetuning BERT model on Quora Question Pairs dataset. We use colab TPU runtime for faster training. Medium post on this repo can be found here.

If you are not familiar with BERT, please visit The Illustrated BERT, BERT Research Paper and BERT Github Repo.

For experimenting with latest notebook and more details visit colab notebook.

Run in Google Colab

Evaluation Results

Evaluation results are on BERT base uncased model. We have used train and dev set from GLUE Quora Question Pairs Task.

Due to limited resources, It was not possible to finetune on BERT Large model and do hyperparamter tuning.