llama3 icon indicating copy to clipboard operation
llama3 copied to clipboard

Memory footprints (GB) of Llama-3.1-8B, Llama-3.1-70B, Llama-3.1-405B, Llama-3-8B, Llama-3-70B models and hardware specifications required to run the models

Open Rumeysakeskin opened this issue 1 year ago • 1 comments

What are the memory footprints (GB) of

  • Llama-3.1-8B
  • Llama-3.1-70B
  • Llama-3.1-405B
  • Llama-3-8B
  • Llama-3-70B

models and hardware specifications required to run the models?

Rumeysakeskin avatar Jul 24 '24 09:07 Rumeysakeskin

What are the memory footprints (GB) of

* Llama-3.1-8B

* Llama-3.1-70B

* Llama-3.1-405B

* Llama-3-8B

* Llama-3-70B

models and hardware specifications required to run the models?

personal PC use 8B.,memory needs 16gb-32gb. enterprise computer use 70B, 405B

CodeMagic6 avatar Jul 25 '24 03:07 CodeMagic6