QWK generates runtime warning

Open aloukina opened this issue 5 years ago • 1 comments

There are edge cases where QWK function generates runtime warning:

  kappa = numerator / denominator
/opt/python/rsmtool/lib/python3.6/site-packages/rsmtool/utils/metrics.py:471: RuntimeWarning: invalid value encountered in double_scalars
  kappa = numerator / denominator

Might be related to https://github.com/EducationalTestingService/rsmtool/issues/365

May 18 '20 14:05 aloukina

I am getting this with subgroups of size 1; this is common in some datasets. It'd be helpful to have a message/warning given with that explanation.

Feb 28 '23 16:02 bwriordan