支持对qwen2-audio-instruct的加速吗

[zhanghanweii]

Checklist

• [X] 1. I have searched related issues but cannot get the expected help.
• [ ] 2. The bug has not been fixed in the latest version.
• [ ] 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.

Describe the bug

没有看到对音频多模态模型的加速

Reproduction

使用swift中的lmdeploy加速

Environment

qwen2-audio的环境

Error traceback

No response

[seetimee]

same question

[lvhan028]

We haven't supported it yet.

[seetimee]

请问有plan的计划吗

[lvhan028]

组内目前人力不足，等0.6.0发布之后，我们会整体看下模型支持情况