Fine tune on SQuAD 2.0: no prediction.json output

[luke4u]

Hi Ken,

I retrained the model on SQuAD 2.0. But there is no output file (prediction.json) for the initial dev set predictions. See below image. As such, I couldn't run the script: python $SQUAD_DIR/evaluate-v2.0.py $SQUAD_DIR/dev-v2.0.json ./squad/predictions.json --na-prob-file ./squad/null_odds.json

Any chance you can share some insights?

Thanks a lot. Luke

[mittalpatel]

Hello @luke4u , Can you confirm you have set "--do_predict=true" while executing run_squad.py command?

Check our NLP Tutorial: Question Answering System Using BERT + SQuAD On Colab TPU which might provide you further insights on fine-tuning and generating predictions successfully using Colab.