candle icon indicating copy to clipboard operation
candle copied to clipboard

Parquet downloading will fail after an system proxy

Open npuichigo opened this issue 1 year ago • 3 comments

My run of "cargo run --example mnist-training" has error like:

Error: Api error: request error: https://huggingface.co/datasets/mnist/resolve/refs%2Fconvert%2Fparquet/mnist/test/0000.parquet: Network Error: timed out reading response
  1. I have a network proxy to access huggingface
  2. I could just wget the parquet file after using network proxy.
  3. It seems the code just ignore my network proxy.

npuichigo avatar Jan 19 '24 06:01 npuichigo

@LaurentMazare

npuichigo avatar Apr 22 '24 14:04 npuichigo

This part is handled by the hf-hub crate. I'm not super up to date with how it works but my understanding is that this hf-hub/34 made the changes for your env proxy to be picked up but this hasn't been released yet. If that's actually what is missing, you may want to ask on the repo if they plan on making a release anytime soon?

LaurentMazare avatar Apr 22 '24 14:04 LaurentMazare

thanks. I'll ask for a release of hf-hub

npuichigo avatar Apr 23 '24 03:04 npuichigo