ipex-llm
ipex-llm copied to clipboard
Chronos: TSDataset should detect low-quality data and provide preprocessing suggestion
Background
We have met with a large amount of different time series, and we should detect the low-quality data and provide suggestion (e.g. call .impute
or .resample
) during the tsdataset initialization
Some low-quality points includes (will add more later):
-
[ ] Have irregular interval among the data
-
[ ] datetime col is not transformed to timestamp type
-
[ ] Missing value > 20%
-
[ ] One/multiple target does not have any pattern (very-low seasonality or too much noice)