pykan icon indicating copy to clipboard operation
pykan copied to clipboard

KAN for Vision Transformer

Open chenziwenhaoshuai opened this issue 9 months ago • 4 comments

We are trying to use KAN on ViT to replace MLP for training on ImageNet, and we welcome co-builds! Vision-KAN

chenziwenhaoshuai avatar May 15 '24 03:05 chenziwenhaoshuai

Interesting idea! I've come up with a title for you. Kansformer: What KAN I say?

hk-zh avatar May 15 '24 19:05 hk-zh

效果咋样

hbwzj avatar May 16 '24 16:05 hbwzj

Probably TransformerKan

jloveric avatar May 17 '24 01:05 jloveric

We are training on ImageNet1k, you can follow my github Vision KAN repo to see the progress, and I'd appreciate it if you could give me a star!

chenziwenhaoshuai avatar May 17 '24 02:05 chenziwenhaoshuai