triage icon indicating copy to clipboard operation
triage copied to clipboard

Incorrect as-of-date year in Postmodeling plots?

Open nanounanue opened this issue 5 years ago • 0 comments

In dirtyduck the last prediction as-of-date is 2017-12-01. The following table is a fragment of the final models from the inspections part of dirtyduck:

|--------------+-----------------------------------------+-----------------------------------------------------------------------------------------+----------------------------------------+-------------+------------------------------------+------------------------------|
|            1 | sklearn.dummy.DummyClassifier           | {"strategy": "prior"}                                                                   | {inspections}                          | {1,4,7}     | {2015-12-01,2016-12-01,2017-12-01} | {" 0.295"," 0.242"," 0.251"} |
|            2 | sklearn.dummy.DummyClassifier           | {"strategy": "uniform"}                                                                 | {inspections}                          | {2,5,8}     | {2015-12-01,2016-12-01,2017-12-01} | {" 0.295"," 0.242"," 0.251"} |
|            3 | sklearn.dummy.DummyClassifier           | {"strategy": "most_frequent"}                                                            | {inspections}                          | {3,6,9}     | {2015-12-01,2016-12-01,2017-12-01} | {" 0.295"," 0.242"," 0.251"} |


Creating the plot for performance over time:

audited_models_class.plot_prec_across_time(param_type='rank_pct',
                                           param=10,
                                           baseline=True,
                                           baseline_query=params.baseline_query,
                                           metric='precision@',
                                           figsize=params.figsize)

Gives you the following plot:

4fd47e296418feefce5cad1683930772e3edf253

Note the years.

Audition makes a similar plot:

metric_over_time_precision@10_pct

nanounanue avatar Mar 26 '19 17:03 nanounanue