ktransformers icon indicating copy to clipboard operation
ktransformers copied to clipboard
Published 3 weeks ago • verified publisher icon kvcache-ai

DeepSeek 3.2 Models

Open trilog-inc opened this issue 3 weeks ago • 3 comments

Reminder

  • [x] I have read the above rules and searched the existing issues.

Description

Would it be possible to upload the CPU/GPU weights of the new DeepSeek 3.2 model to hugging face? The same way the Kimi-K2-Thinking ones were uploaded.

Thanks for all the great work!

Pull Request

No response

trilog-inc avatar Dec 01 '25 21:12 trilog-inc

It would be nice having AMX INT8 CPU weights available. Thanks!

shrould8888 avatar Dec 01 '25 21:12 shrould8888

https://github.com/kvcache-ai/ktransformers/blob/main/doc/en/kt-kernel/deepseek-v3.2-sglang-tutorial.md

ovowei avatar Dec 02 '25 12:12 ovowei

Thanks @ovowei. I hope to have time this weekend to quantize the weights and will upload them if no one gets to it first.

trilog-inc avatar Dec 02 '25 16:12 trilog-inc