fibber icon indicating copy to clipboard operation
fibber copied to clipboard

Model Saving Directory Not Existing

Open superctj opened this issue 4 years ago • 0 comments

  • fibber version: 0.2.5
  • Python version: 3.7
  • Operating System: Linux

Description

I wanted to train a Bert classifier on the IMDB dataset with the setup in fibber.metrics.bert_classifier. When the program executes model.save_pretrained(ckpt_path) in load_or_train_bert_clf, it triggers an assertion error in transformers library and I believe it is because ckpt_path does not exist.

A screenshot of the traceback is attached for your reference. Screen Shot 2021-05-02 at 3 01 00 PM

What I Did

To replicate the error, simply load the IMDB dataset from fibber and train a Bert classifier as shown below Screen Shot 2021-05-02 at 3 14 06 PM

My workaround is to create ckpt_path when it is not detected. Screen Shot 2021-05-02 at 8 35 41 PM

superctj avatar May 02 '21 22:05 superctj