exo icon indicating copy to clipboard operation
exo copied to clipboard
Published 6 hours ago • verified publisher icon exo-explore

[feature] deepseek-r1 Dynamic Quantized versions add

Open hotwa opened this issue 10 months ago • 1 comments

four Dynamic Quantized versions with deepseek-r1, link add in exo?

hotwa avatar Feb 08 '25 12:02 hotwa

The dynamic quantizd version of DeepSeek-R1 is in GGUF format, but the support for llama.cpp is still in working, see: #167 . You could use MLX and tinygard model in exo currently.

flyfishxu avatar Feb 10 '25 06:02 flyfishxu