trendbreaker icon indicating copy to clipboard operation
trendbreaker copied to clipboard

Improve cross validation to handle time structure

Open dirkschumacher opened this issue 4 years ago • 3 comments

See here: https://stats.stackexchange.com/a/14109

dirkschumacher avatar May 29 '20 20:05 dirkschumacher

Also see mase https://yardstick.tidymodels.org/reference/mase.html

dirkschumacher avatar May 29 '20 20:05 dirkschumacher

I think the n-fold CV is a good default without good source

dirkschumacher avatar Jun 01 '20 20:06 dirkschumacher

I think it is necessary if, as is the case here, the predictive power of the model is to be evaluated. (A retrospective fit, looking in the whole data set which points are outliers compared to all others, would work fine with usual cross-validation.) One further reference: https://scikit-learn.org/stable/modules/cross_validation.html#time-series-split

stephaneghozzi avatar Aug 06 '20 13:08 stephaneghozzi