mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

[Feature Request] Provide a C++ API

Open tranlm opened this issue 10 months ago • 2 comments

🚀 Feature

I'm wondering if you plan on providing a C++ (or C#) API.

Motivation

Many programs that operate on device use C++ or C#. This would enable us developers to adopt it for use.

Alternatives

I've been using llama.cpp, openvino, or onnx runtime genai.

Additional context

NA

tranlm avatar Dec 16 '24 02:12 tranlm