mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

Published 20 hours ago • verified publisher icon mlc-ai

[Bench] Add support for multiple backend

Open cyx-6 opened this issue 11 months ago • 0 comments

This PR adds the support for vllm and llama.cpp backend, especially for json generation.

cyx-6 avatar Nov 20 '24 06:11 cyx-6