Hyperactive icon indicating copy to clipboard operation
Hyperactive copied to clipboard

[ENH] Allow `TorchExperiment` metric to set "higher is better"

Open SimonBlanke opened this issue 1 month ago • 1 comments

The TorchExperiment assumes all metrics should be minimized (lower is better) by default. This can be seen here in this line. However, many metrics should be maximized (accuracy, F1, AUC), requiring users to manually negate them or wrap them in custom logic. The integration doesn't auto-detect metric direction from common naming patterns.

Sklearn's OptCV uses _coerce_to_scorer_and_sign (from _skl_metrics.py) to automatically detect metric direction. Maybe we can write something similar for the TorchExperiment.

SimonBlanke avatar Nov 26 '25 08:11 SimonBlanke

Okay I will check this.

amitsubhashchejara avatar Nov 26 '25 10:11 amitsubhashchejara