How to download deepseek-r1-8-bit?

Open kuangshengkai opened this issue 10 months ago • 1 comments

There seems only deepseek-r1-4-bit in model cards. Please support deepseek-r1 8-bit for due Mac Studio w/ M3 Ultra. :)

Mar 07 '25 03:03 kuangshengkai

you can download deepseek-r1 8-bit form https://huggingface.co/meituan/DeepSeek-R1-Block-INT8

Mar 30 '25 11:03 youmego