MegaVIT icon indicating copy to clipboard operation
MegaVIT copied to clipboard

Published 20 hours ago • verified publisher icon kyegomez

[BUG] QK norm seems not correct

Open wzm2256 opened this issue 5 months ago • 0 comments

It seems you normalized k and v instead of q and v in https://github.com/kyegomez/MegaVIT/blob/main/mega_vit/main.py line 92. I think this is an error.

Upvote & Fund

  • We're using Polar.sh so you can upvote and help fund this issue.
  • We receive the funding once the issue is completed & confirmed by you.
  • Thank you in advance for helping prioritize & fund our backlog.
Fund with Polar

wzm2256 avatar Sep 15 '24 20:09 wzm2256