llama2.c icon indicating copy to clipboard operation
llama2.c copied to clipboard

Published 20 hours ago • verified publisher icon karpathy

mfu calculation

Open pure-water opened this issue 1 year ago • 0 comments

Hi as far as I know

MFU = 6N + 12LHPQ

It is a kind of heustric value not strictlly accurate. I was just wondering is it more precise on the big language model case than the small toy number?

pure-water avatar Dec 10 '23 05:12 pure-water