llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

common: download from URL, improve parallel download progress status

Open phymbert opened this issue 1 year ago • 6 comments

Context

When downloading a sharded model, files are downloaded in parallel, it was added in:

  • #6192

The progressions of each download conflict: image

Need to properly implement CURLOPT_NOPROGRESS for parallel download.

Example in #6515:

main --hf-repo ggml-org/models \
  --hf-file grok-1/grok-1-q4_0-00001-of-00009.gguf \
  --model   models/grok-1-q4_0-00001-of-00009.gguf \
  -ngl 64
   --prompt "I believe the meaning of life is"

phymbert avatar Apr 08 '24 07:04 phymbert

Hi! Can I take on this issue as a first contribution?

TevinWang avatar Apr 10 '24 17:04 TevinWang

Sure, good luck, please ping here for any question

phymbert avatar Apr 10 '24 17:04 phymbert

Hi @TevinWang, are you still working on this issue ?

phymbert avatar Apr 16 '24 10:04 phymbert

Yes, sorry, still working on it!

TevinWang avatar Apr 20 '24 07:04 TevinWang

Thanks, no worries, take your time.

phymbert avatar Apr 20 '24 07:04 phymbert

@phymbert Just created a PR, #6831, let me know if there are any changes needed!

TevinWang avatar Apr 22 '24 17:04 TevinWang