aibrix icon indicating copy to clipboard operation
aibrix copied to clipboard
verified publisher icon vllm-project

Speedup downloading models by parallel downloading of multiple files

Open brosoul opened this issue 1 year ago • 1 comments

🚀 Feature Description and Motivation

AI Runtime should support download models by parallel downloading of multiple files

Use Case

No response

Proposed Solution

No response

brosoul avatar Oct 14 '24 11:10 brosoul

Let's put the performance optimization into later versions, like v0.3.0

brosoul avatar Dec 24 '24 06:12 brosoul