aibrix
aibrix copied to clipboard
Add Deepseek R1 multi-node example
🚀 Feature Description and Motivation
AIbrix provides the distributed inference feature and it work out of box with vLLM. We should add some guidances on full weights Deepseek-R1 deployment to attract people who like to use it.
Use Case
multi-node deployment
Proposed Solution
No response