neuralforecast icon indicating copy to clipboard operation
neuralforecast copied to clipboard

when to surport KANS?

Open luoolu opened this issue 9 months ago • 1 comments

Description

KANs have faster scaling than MLPs. KANs have better accuracy than MLPs with fewer parameters.

Use case

No response

luoolu avatar May 06 '24 07:05 luoolu

Thanks for the suggestion. I think KANs are a nice scientific path and applying it to forecasting could be an interesting scientific venue to pursue.

I don't think the existing evidence about KANs support your statements, though. Your statements are very generic - as if they would apply to any and all problem settings - but the recent KAN paper to which I believe you are referring to doesn't offer the evidence to suggest the generality of your statements.

For now, we'll keep an eye on how KANs perform in real-world problems, and we maybe experiment with them ourselves too. If we find that the performance of KANs for forecasting tasks is a worthwile contribution to NeuralForecast, it may make sense to include them.

Please provide (preferably peer-reviewed) evidence to the contrary if I'm mistaking in any of my statements above.

elephaint avatar May 06 '24 10:05 elephaint