support MLC-AI/mlc & RWKV ai00_server

[chymian]

in regards of running local LLMs, may I suggest to support non cuda setups as first class citizen.

there a 2 outstanding projects out there, which ignore the every GPU is a Nivida credo and therefor are usable on every other hardware - which is most likely the majority (but is totally ignored)

pls. have a look at: https://github.com/mlc-ai/mlc-llm and https://github.com/BlinkDL/RWKV-LM with the outstanding fast & compact server, which runs 13b-vicuna quant. on an old rx580 with 8GB (via vulkan) https://github.com/cgisky1980/ai00_rwkv_server (full openAI-API support is pending).