Maybe a bug in your code main.py#L330?

[AIWanderer-X]

I compared your code against lucidrains'.

Yours: https://github.com/kyegomez/NaViT/blob/2ae84371103917608603182f08a802cb453d1008/navit/main.py#L330

Lucidrains': https://github.com/lucidrains/vit-pytorch/blob/9992a615d1f3e0117a62ced39a88d48b6be68858/vit_pytorch/na_vit.py#L318

I doubt there might be a bug at this line in your code.

Upvote & Fund

• We're using Polar.sh so you can upvote and help fund this issue.
• We receive the funding once the issue is completed & confirmed by you.
• Thank you in advance for helping prioritize & fund our backlog.