unsloth icon indicating copy to clipboard operation
unsloth copied to clipboard
Published 3 months ago • verified publisher icon unslothai

Some models bypass HF_ENDPOINT and download from huggingface.co

Open schrodingercatss opened this issue 1 year ago • 5 comments

I set the environment variable HF_ENDPOINT="https://hf-mirror.com" to use a mirror for downloading models. While some models, like unsloth/Llama-3.2-3B-Instruct-bnb-4bit, correctly use the mirror, others, such as unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit, still attempt to download from huggingface.co.

Due to network restrictions, I cannot access huggingface.co. Even after manually downloading the model using huggingface-cli, the code still tries to connect to huggingface.co during model loading.

Is there a way to ensure all models respect the HF_ENDPOINT setting?

schrodingercatss avatar Nov 29 '24 09:11 schrodingercatss

Interesting I'll take a look!

danielhanchen avatar Dec 04 '24 20:12 danielhanchen

unsloth/Llama-3.2-3B-Instruct-bnb-4bit does not work as well

happyrgb23 avatar Feb 27 '25 08:02 happyrgb23

Hi, any updates on this issue? I’m facing the same problem.

cpuoverload avatar Mar 13 '25 06:03 cpuoverload

Hi, any updates on this issue? I’m facing the same problem.

tianlinzx avatar Apr 15 '25 08:04 tianlinzx

Hi, any updates on this issue? I’m facing the same problem.

LaurenceLong avatar Apr 30 '25 14:04 LaurenceLong

+1

Radar-Lei avatar Oct 13 '25 13:10 Radar-Lei