alexpong0630
alexpong0630
Not all OpenAI-Compatible APIs serivce providers's API Key started with "sk", so removed pattern checking
Changes - uncomment validApiKey - code cleanup
@hdnh2006 this PR not allow users add custom models. It's easy to get available models from models endpoint, but I can't find a best way to determine the model supporting...
My original intention was to find a chrome extension that can translate while retaining the original text. The chrome web store does have such extensions, but they are not open...
set --enable-expert-parallel would cause an other problem on old GPU (
不確定是什麼原因, 轉成turbomind後測試過的模型推理能力(特別在tools calling)都肉眼可見的變差。 這是 lm studio gguf qwen3-coder q4 這是lmdeploy 也測試過用vllm 測試同一個AWQ model, 結果都是vllm 成功的prompt, 來到lmdeploy就失敗