ms-swift

ms-swift copied to clipboard

Published 3 weeks ago •

Reame
Issues

何时能支持原生pytorch batch推理

Open PolarisHsu opened this issue 1 year ago • 2 comments

swift infer一条条推理，真是受不了啊，得推到猴年马月…… vllm很多模型都不支持。

Jul 26 '24 03:07 PolarisHsu

等周一接入lmdeploy & vlm

Jul 26 '24 08:07 Jintao-Huang

supported

Feb 09 '25 16:02 Jintao-Huang