trans-inr icon indicating copy to clipboard operation
trans-inr copied to clipboard

Published 20 hours ago • verified publisher icon yinboc

test with SIREN

Open 1999kevin opened this issue 1 year ago • 0 comments

Nice job! I notice that you still use ReLU MLP with PE. A MLP architecture named SIREN, which replaces the ReLU activation to sine activation, has a better reprenentation ability. Have you even tested SIREN as your hyponet?

1999kevin avatar Apr 30 '23 15:04 1999kevin