Nitin Madnani

Results 127 comments of Nitin Madnani

Makes sense. Thank you so much!

> if the range is greater than certain threshold. what does `range` refer to exactly? The range of the predicted scores?

Ah, I see. And what sort of threshold would you use?

I don't think we want to go for the worst case number like that since that can still lead to memory errors. I feel like this threshold should depend on...

Is there a realistic scenario where the ranges diverge by more than that and kappa will still be meaningful?

Actually, now that I think a bit more about it, I think we should strive for consistency. So, here's an alternative I'd prefer: - Make `rsmpredict` also use an output...

Hmm, yes I can see how that can be quite annoying. I like your suggestion! 👍

See also [this issue](https://github.com/EducationalTestingService/skll/issues/647) for SKLL.