deepseek topic

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any...

xorbitsai

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

DefTruth

ms-swift: Use PEFT or Full-parameter to finetune 250+ LLMs or 25+ MLLMs

modelscope

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

inferflow

🚀 DeepSeek-V2大模型逆向API白嫖测试【特长：GPT4平替】，支持高速流式输出、多轮对话，零配置部署，多路token支持。

LLM-Red-Team