aibrix icon indicating copy to clipboard operation
aibrix copied to clipboard

Add Deepseek R1 multi-node example

Open Jeffwan opened this issue 10 months ago • 0 comments

🚀 Feature Description and Motivation

AIbrix provides the distributed inference feature and it work out of box with vLLM. We should add some guidances on full weights Deepseek-R1 deployment to attract people who like to use it.

Use Case

multi-node deployment

Proposed Solution

No response

Jeffwan avatar Feb 26 '25 23:02 Jeffwan