neuralforecast icon indicating copy to clipboard operation
neuralforecast copied to clipboard

Conformal Prediction in NeuralForecast

Open valeman opened this issue 9 months ago • 1 comments

Description

It would be great to have Conformal Prediction in NeuralForecast, similar to statsforecast and mlforecast.

Use case

No response

valeman avatar May 09 '24 08:05 valeman

@AzulGarza I am interested to contribute for the implementation of Conformal Prediciton in NeuralForecast

I checked the implementations in Statforecast/MLForecast, consider following your implementation for _add_conformal_distribution_interval and _add_conformal_error_intervals

However, I also noticed that NeuralForecast has quantiled outputs when we specify loss such as MQLoss (as suggested by quantiles_to_outputs). If users specify conformal prediction interval and use MQLoss, think we shall need to handle this properly such that how should we present the quantiled outputs to the users.

My current thought is when users specify Conformal Prediction parameter, we can compute the prediction intervals using the -median result returned by MQLoss during the cross-validation, while raising a warning to remind the users that the outputs are computed following the Conformal Prediction scheme.

I am rather new to Conformal Prediction and would love to hear from Nixtla's team feedback on this. cc: @elephaint noticed your recent work on Implicit Quantile Networks, which might be relevant.

JQGoh avatar May 16 '24 16:05 JQGoh