How many GPU memories are needed？

[dzrdzrdzr]

[chenyzh28]

For me, the inference of grok cost 8*A800 and each GPU costs 65G memory. https://github.com/xai-org/grok-1/issues/257#issue-2199992910

[LuShouPeng]

For me, the inference of grok cost 8*A800 and each GPU costs 65G memory. #257 (comment)

Then this has nothing to do with amateurs.

[youhanasheriff]

For me, the inference of grok cost 8*A800 and each GPU costs 65G memory. #257 (comment)

Then this has nothing to do with amateurs.

Still We stick around.