lmdeploy icon indicating copy to clipboard operation
lmdeploy copied to clipboard
Published 1 month ago • verified publisher icon InternLM

[Feature] support ByteDance-Seed/Seed-OSS-36B-Instruct

Open mj520 opened this issue 4 months ago • 2 comments

Motivation

https://huggingface.co/ByteDance-Seed/Seed-OSS-36B-Instruct

Related resources

https://huggingface.co/ByteDance-Seed/Seed-OSS-36B-Instruct

Additional context

No response

mj520 avatar Aug 28 '25 02:08 mj520

+1，现在运行会报错：RuntimeError: Can not found rewrite for architectures: ['SeedOssForCausalLM']

Torala avatar Sep 03 '25 15:09 Torala

We are rushing the v0.10.0 version. After it is published, we will come back to support this model

lvhan028 avatar Sep 03 '25 15:09 lvhan028