automated-essay-grading icon indicating copy to clipboard operation
automated-essay-grading copied to clipboard

Published 20 hours ago • verified publisher icon siyuanzhao

kappa scores of 0

Open danielduckworth opened this issue 7 years ago • 3 comments

I've come back to this repo after some time and started testing again.

Some epoch folds are resulting in kappa scores of 0.

Is this know or expected?

danielduckworth avatar Sep 19 '18 09:09 danielduckworth

@danielduckworth or @siyuanzhao , did you manage to solve this issue? I'm just checking out this project now and have run into the same issue.

robert1ridley avatar Apr 20 '19 01:04 robert1ridley

I also encountered the same problem. The result of all epoch training is kappa scores of 0. Is it wrong to set it up? Also, when importing the game model, the author is not feeding a list into it, and an error occurs.

Dammy159753 avatar Aug 22 '19 09:08 Dammy159753

I noticed that a small learning rate (0.0001) can potentially avoid kappa 0.

siyuanzhao avatar Aug 30 '19 05:08 siyuanzhao