mljar-supervised icon indicating copy to clipboard operation
mljar-supervised copied to clipboard

leaderboard is showing negative values for f1 metric

Open yairVanti opened this issue 2 years ago • 7 comments

when i run fit on tabular binary classification dataset i get the following leader board image

when i run model.report() it looks better , where the metrics are positive:

image

yairVanti avatar Oct 27 '22 12:10 yairVanti

Looks like a bug. Thank you for reporting!

pplonski avatar Oct 27 '22 12:10 pplonski

Hi, I want to work on this issue

aksy2512 avatar Oct 27 '22 15:10 aksy2512

Hi @aksy2512, thanks, it is all yours!

The first step would be to reproduce the issue. Are you able to reproduce it locally with some fake data?

pplonski avatar Oct 27 '22 15:10 pplonski

Thank you @pplonski for assigning me the issue. I am not able to reproduce the data locally. It would be great if you could suggest me some resources about it

aksy2512 avatar Oct 29 '22 08:10 aksy2512

Thanks @aksy2512 for looking into it.

@yairVanti could you please provide example data and code to reproduce the issue locally?

pplonski avatar Oct 29 '22 13:10 pplonski

dataset is attached, target is the last column. electrical_grid.csv

just train AutoML with these params : ("total_time_limit": 120, "ml_task": "binary_classification", "mode": "Perform", "eval_metric": "f1", "n_jobs": -1, "random_state": 0) and get_leaderboard() on the fitted AutoML instance.

yairVanti avatar Oct 30 '22 09:10 yairVanti

Thank you @yairVanti!

pplonski avatar Nov 02 '22 07:11 pplonski