Edda icon indicating copy to clipboard operation
Edda copied to clipboard

Improvement of the difficulty predictor

Open Brollyy opened this issue 6 months ago • 0 comments

#120

  • Updated Nytilde's model to the newest version and added the fallback model.
  • Slight refactor to prepare for implementing different difficulty predictor algorithms.

Summary

The new model doesn't seem to improve too much from the earlier one - the predictions for typical maps around lower and mid levels seem ok (leaning towards underestimation while I looked at some random maps), but for the high difficulty maps it goes off the rails, even with the fallback model:

Ira Sancti (verified manually that the main model is called for all diffs) image

Through the Fire and Flames (verified manually that the fallback model is called for all diffs) image

Parallel Universe Shifter (verified manually that the fallback model is called) image

TODO

  • [ ] The new fallback model still has the same issue as the full model - for maps outside of the training range for features, the difficulty prediction is decreasing with the new notes being added.
  • [ ] Re-implement PKBeam's ML model and implement option to select the model
  • [ ] Check Melchior's standalone algorithm

Brollyy avatar Aug 01 '24 13:08 Brollyy