Auto-PyTorch icon indicating copy to clipboard operation
Auto-PyTorch copied to clipboard

[Time series Forecasting] Continuous Ranked Probablity Score (CRPS) loss for probablity network ouput type

Open dengdifan opened this issue 3 years ago • 2 comments

We could consider implementing CPRS an alternative training loss for the probabilistic network output type. INFO: https://www.lokad.com/continuous-ranked-probability-score

dengdifan avatar Sep 20 '22 14:09 dengdifan

Hey @dengdifan ! Within a university project, my team and I would like to contribute to this issue. If you have any more detailed specifications or hints, we would be glad to get them from you. Thanks for your work !

omeurer avatar Dec 16 '23 17:12 omeurer

Hi @omeurer, sorry for the late reply, I am currently working on some other projects these days.

Basically, you could check if you can add a new loss type under this py module: https://github.com/automl/Auto-PyTorch/blob/master/autoPyTorch/pipeline/components/training/losses.py

Then you should attach the new loss to this dict: https://github.com/automl/Auto-PyTorch/blob/master/autoPyTorch/pipeline/components/training/losses.py#L128

Finally, some constraints might be required for this function: https://github.com/automl/Auto-PyTorch/blob/master/autoPyTorch/pipeline/time_series_forecasting.py#L207

if you have any further questions, please let me know.

dengdifan avatar Jan 05 '24 12:01 dengdifan