inference FEAT: support deepseek v2 chat and coder

FEAT: support deepseek v2 chat and coder

Open GXKIM opened this issue 9 months ago • 3 comments

如题

May 07 '24 08:05 GXKIM

deepseek coder 支持了吧

May 07 '24 08:05 qinxuye

deepseek coder 支持了吧

v2 coder

May 07 '24 08:05 GXKIM

https://www.modelscope.cn/models/deepseek-ai/DeepSeek-V2-Chat/summary

May 08 '24 01:05 adogcode

Mac M系列这个问题能搞定么？我都是本地下载好的模型自定义注册 Model Family：deepseek-chat（other也一样） xinference：0.12.0

Jun 11 '24 07:06 100ZZ

希望能增加deepseek v2 和 deepseek coder v2 的支持

vllm 0.5.1版本已支持deepseek v2, 详见vllm 0.5.1 release

Jul 14 '24 07:07 halexan

236B的那个模型没有支持

Jul 22 '24 02:07 ye7love7

什么时候可以支持呢？一直等着这个模型

Jul 24 '24 06:07 dongfangzan

Looking forward！

Jul 26 '24 06:07 halexan

This issue is stale because it has been open for 7 days with no activity.

Aug 06 '24 19:08 github-actions[bot]

This issue was closed because it has been inactive for 5 days since being marked as stale.

Aug 12 '24 03:08 github-actions[bot]

We will support it ASAP.

Sep 04 '24 04:09 qinxuye

This issue is stale because it has been open for 7 days with no activity.

Sep 11 '24 19:09 github-actions[bot]

This issue was closed because it has been inactive for 5 days since being marked as stale.

Sep 16 '24 19:09 github-actions[bot]