BitNet icon indicating copy to clipboard operation
BitNet copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Larger models (70B, 405B)

Open do-me opened this issue 4 months ago • 5 comments

Thanks a lot for open sourcing this amazing library! I was wondering whether you tried/are planning to prepare some larger models too, like Llama-3.1-70B/405B. As it seems, there is an actual chance to be able to run Llama-3.1-405B on a single Mac. Also, would you mind opening up the discussions section?

do-me avatar Oct 18 '24 09:10 do-me