iTransformer icon indicating copy to clipboard operation
iTransformer copied to clipboard

Multiclass prediction

Open TomKoester opened this issue 1 year ago • 6 comments

Hey, is it possible to do multi class prediction with this?

my data has the following format: Timestamp Feature 1 ... Feature X Target 1 .. Target X

Can you give me a short example how the iTransformer knows what columns the Targetfeatures are?

Thanks

TomKoester avatar Jul 15 '24 11:07 TomKoester

@TomKoester does it even work for single class predictions? happy to build it if you can show me your results

lucidrains avatar Jul 15 '24 13:07 lucidrains

image Here is my output. I ve used a SNGP layer with a threshold to model the certainty for my different classes. I just tried it with generated dummy data and gave it into the model:

image

TomKoester avatar Jul 15 '24 13:07 TomKoester

i forked my repo from the original thuml repo. Is it even possible to use the training classes for the multilabel classification? Or do you think im better with implementing this by myself?

TomKoester avatar Jul 15 '24 13:07 TomKoester

I've read the paper again. Did i understand it right that the iTransformer doesnt care about the input/target features as it predicts ALL features?

TomKoester avatar Jul 15 '24 14:07 TomKoester

Hey @lucidrains , its me again :) i think i can modify the training process when i adjust the f_dim parameter in the exp_long_term_forecasting.py: image

whats your thought on that? it would ignore all predicted input features in training and just evaluate on the f_dim numbers of targets.

TomKoester avatar Jul 16 '24 20:07 TomKoester

@TomKoester, there are no features and targets. Inputs are separate time series and outputs are predictions for each one of them.

satyrmipt avatar Sep 06 '24 18:09 satyrmipt