ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Chronos: TSDataset should detect low-quality data and provide preprocessing suggestion

Open TheaperDeng opened this issue 1 year ago • 0 comments

Background

We have met with a large amount of different time series, and we should detect the low-quality data and provide suggestion (e.g. call .impute or .resample) during the tsdataset initialization

Some low-quality points includes (will add more later):

  • [ ] Have irregular interval among the data

  • [ ] datetime col is not transformed to timestamp type

  • [ ] Missing value > 20%

  • [ ] One/multiple target does not have any pattern (very-low seasonality or too much noice)

TheaperDeng avatar Sep 19 '22 14:09 TheaperDeng