MegaVIT
MegaVIT copied to clipboard
kyegomez
The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"
Could you please share the process? ## Upvote & Fund - We're using [Polar.sh](https://polar.sh/kyegomez) so you can upvote and help fund this issue. - We receive the funding once the...
Bumps [pypa/gh-action-pypi-publish](https://github.com/pypa/gh-action-pypi-publish) from 1.4.2 to 1.9.0. Release notes Sourced from pypa/gh-action-pypi-publish's releases. v1.9.0 💅 Cosmetic Output Improvements @woodruffw💰 updated the tense on password nudge in #234 @shenxianpeng💰 helped us disable...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [pypa/gh-action-pypi-publish](https://github.com/pypa/gh-action-pypi-publish) from 1.4.2 to 1.10.3. Release notes Sourced from pypa/gh-action-pypi-publish's releases. v1.10.3 💅 Cosmetic Output Improvements In #270, @facutuesca💰 made a follow-up to their previous PR #250, making the...
In the file https://github.com/kyegomez/MegaVIT/blob/main/mega_vit/main.py 1. In line 150, you mentione "MegaVit model from https://arxiv.org/abs/2106.14759", but that paper is "The Eisenbud-Green-Harris Conjecture". I do not think this is the correct paper....
It seems you normalized k and v instead of q and v in https://github.com/kyegomez/MegaVIT/blob/main/mega_vit/main.py line 92. I think this is an error. ## Upvote & Fund - We're using [Polar.sh](https://polar.sh/kyegomez)...