iTransformer icon indicating copy to clipboard operation
iTransformer copied to clipboard

Published 20 hours ago • verified publisher icon thuml

CLS Token

Open IoSonoMarco opened this issue 9 months ago • 1 comments

Hi all, thanks for the great work. I've been looking at the example codes and modules and I noticed you have an arg for choosing the class strategy as projection or cls_token or average. I guess it doesn't apply to iTransformer since it only works with projection. But I was wondering whether you had feedback about using a learnable class token as a final representation for tasks like timeseries classification. Have you tried it already?

IoSonoMarco avatar May 12 '24 11:05 IoSonoMarco