bigdl-llm-tutorial icon indicating copy to clipboard operation
bigdl-llm-tutorial copied to clipboard

Published 20 hours ago • verified publisher icon intel-analytics

Python performance is too poor, can it provide an inference library in C++ and provide an OpenAI-compatible API

Open geffzhang opened this issue 4 months ago • 3 comments

Using bigdl-llm in a production environment, Python performance is too poor, can you provide an inference library in C++ and provide an OpenAI-compatible API

geffzhang avatar Feb 12 '24 03:02 geffzhang