trans-inr icon indicating copy to clipboard operation
trans-inr copied to clipboard

Published 20 hours ago • verified publisher icon yinboc

Transformer Encoder Output

Open UmarSpa opened this issue 2 years ago • 0 comments

Hey, thanks for sharing the code.

I am a bit confused regarding the following:

https://github.com/yinboc/trans-inr/blob/f4bdc013286e2be00f9117e4e53913d6692fa49d/models/trans_inr.py#L65

So in essence, you are using Transformer Encoder output (after being passed through a FC layer) to modulate randomly initialized weights of INR, right?

UmarSpa avatar Jan 23 '23 16:01 UmarSpa