pytorch-transformers-classification icon indicating copy to clipboard operation
pytorch-transformers-classification copied to clipboard

Published 20 hours ago • verified publisher icon ThilinaRajapakse

Eval results outputs

Open Azamat25 opened this issue 5 years ago • 2 comments

I am trying to reproduce the code with smaller subset : 100K train; 5K dev examples Getting this result:

INFO:main:***** Eval results outputs ***** INFO:main: fn = 0 INFO:main: fp = 2529 INFO:main: mcc = 0.0 INFO:main: tn = 0 INFO:main: tp = 2471

How to interpret it? What possibly can went wrong? Thank you.

Azamat25 avatar Nov 11 '19 06:11 Azamat25

by the way I am using XLM model. The model and data size are only differences from your code

azamatolegen avatar Nov 13 '19 10:11 azamatolegen

Hard to say. 100k samples should be enough to train the model. Can you try with the Simple Transformers library linked in the readme as this repo is out of date?

ThilinaRajapakse avatar Nov 13 '19 10:11 ThilinaRajapakse