Adam Tonderski

icon location Industrial PhD student - researching offline perception for :robot: :car:

Results 2 issues of Adam Tonderski

Need to interpolate positional embedding to work at higher resolutions

Hi again, sorry for the slow response in issue #26. I have some more clarifications and visualizations here. I agree that the sine-cosine embeddings are not learnable. However it seems...

enhancement

Missing square of gradients?

3 comment

Hi, Thanks for the very interesting work! I am confused about one thing. In the paper (e.g. equation 11) the hessian is approximated by the square of the gradients, right?...