pykan icon indicating copy to clipboard operation
pykan copied to clipboard

Corresponding explanation

Open ghost opened this issue 9 months ago • 6 comments

Hello, what is the proof that kan and mlp are dual?

ghost avatar May 07 '24 09:05 ghost

You can read the full paper at: https://arxiv.org/abs/2404.19756 The section where they define the KANs should be sufficient

brayevalerien avatar May 07 '24 11:05 brayevalerien

Do you use the article "Duality between two generalized.." by Wang Y. et al?

ghost avatar May 07 '24 13:05 ghost

I've not read the paper you are mentioning yet, but there is a discussion about this topic on Reddit. The OP has shared a notebook where they show how one can build an MLP equivalent to a given KAN.

edit: typo

brayevalerien avatar May 07 '24 14:05 brayevalerien

Thanks!

ghost avatar May 07 '24 14:05 ghost

You're welcome. This is a pretty interesting topic and even thought the collab notebook only shows how they are equivalent on a piecewise linear fonction, I'm confident it can be generalized to any continous function with large enough MLPs.

brayevalerien avatar May 07 '24 14:05 brayevalerien

Spoiler: it can. Unfortunately, this comment is too narrow to write down the proof. (semi-quote)

AlessandroFlati avatar May 07 '24 15:05 AlessandroFlati