scibert icon indicating copy to clipboard operation
scibert copied to clipboard

Validation Loss as well as validation F1 increasing

Open kuldeep7688 opened this issue 5 years ago • 0 comments

Hi, While finetuning scibert on JNLPBA and bc5cdr dataset, I observed very strange phenomenon. The validation loss is increasing whereas the validation F1 in either increasing or staying the same.

Please let me know because I have faced a similar issue when I used pytorch-crf over scibert. There also for ner (JNLPBA and bc5cdr) validation loss anf validation f1 are increasing.

kuldeep7688 avatar Dec 16 '19 11:12 kuldeep7688