river icon indicating copy to clipboard operation
river copied to clipboard

[ENH] Online Quantile Regression with Pinball-Loss Optimizers

Open sisird864 opened this issue 7 months ago • 1 comments

Motivation: River lacks native quantile regression for streaming tasks; this enables prediction intervals and robust regression. (Related: “Quantile Regression Approaches”.)

Proposal:

  • New estimator(s) linear.QuantileSGDRegressor supporting multiple τ in one pass.
  • Optimizer: per-sample pinball loss with optional forgetting factor.
  • API parity with linear_model regressors (fit_one/learn_one/predict_one).
  • Benchmarks: synthetic piecewise-stationary streams; compare vs. batch baselines.
  • Docs: example + tutorial notebook.

Questions: preference for single-τ estimator vs multi-τ; default regularization; placement under linear?

sisird864 avatar Aug 02 '25 16:08 sisird864

Hey there @sisird864. I agree that River could provide more utilities to provide prediction internals. That's the aim of the conf module, which implements conformal prediction algorithms.

Questions: preference for single-τ estimator vs multi-τ; default regularization; placement under linear?

I think single-τ estimator is more than fine. Not sure about the implications of your two other questions really. But I would start simple and build from there.

MaxHalford avatar Sep 07 '25 19:09 MaxHalford