Pretrain on forecasting/imputation and finetune on classification

[Glaadiss]

I'm working with a timeseries dataset full of sensor data, but only a small portion is labeled. My plan is to pretrain the model on the entire dataset and then fine-tune it using the labeled subset. This dataset is rich in features and spans numerous devices.

My goal is to assign the correct label (8 possible classes) for every minute, so this is either timeseries clustering/segmentation task or a classification task for every minute.

For every minute I have 60 records (one for each second), and every record includes a few values such as mean, std, min, max calculated based on 100Hz data for a given second.

I'm considering using TimesNet for forecasting and/or imputation during pretraining phase, and classification during fine-tuning phase. Has anyone here experimented with TimesNet for similar applications? I'd love to hear any insights or advice you might have. If it hasn't been done, I'm eager to explore and contribute to this area. Any tips or recommendations would be greatly appreciated!