aibrix
aibrix copied to clipboard
能支持 Z2 Mini G1a Workstation 么
🚀 Feature Description and Motivation
希望通过你们平台在 G1a实现大模型服务调用。
Use Case
比如运行语音转录或则LLM大模型服务,参考Qwen32b
Proposed Solution
No response
@LuxePlay We plan to extend support to multi-modality models, could you give more details on the use case "语音转录"?
BTW, for "Z2 Mini G1a Workstation", does it come with GPU? We plan to ship a slim container compose version aibrix to serve single node use case.