RTX icon indicating copy to clipboard operation
RTX copied to clipboard

Major Ranker refactor did not move the needle on testing??

Open edeutsch opened this issue 7 months ago • 7 comments

I have not had a chance to look into this more, but I've remembered and forgotten this twice this week, so here's a vague report:

Last week @chunyuma committed what appeared to be a major advance in our ranking algorithm. However, the testing results appeared not to move the needle at all!

Before (July 6): https://arax.ci.transltr.io/?systest=78 (44 passing)

After (July 13): https://arax.ci.transltr.io/?systest=79 (44 passing)

I do believe we made a big advance. But why is it not reflected in the test results? Has any noticed/investigated this?

edeutsch avatar Jul 19 '24 18:07 edeutsch