HuggingFaceModelDownloader
HuggingFaceModelDownloader copied to clipboard
bodaay
Simple go utility to download HuggingFace Models and Datasets
The following lines disables proxy settings which are set with HTTP_PROXY and HTTPS_PROXY environments. Is this behaviour expected? https://github.com/bodaay/HuggingFaceModelDownloader/blob/32cf21ea70db29fdc8f03773bed2de10a0c461fb/hfdownloader/hfdownloader.go#L433C10-L433C10
I have been downloading several models but occasionally notice that there are model folders much smaller than they should be. My internet connection is a crappy long distance microwave connection...
Dataset https://huggingface.co/datasets/EleutherAI/the_pile_deduplicated/tree/main/data Problem The above dataset has 1659 files but the downloader only downloads 1000 files. This is not specifically a problem of the downloader but a way of HTTP...
**[huggingface model repo](https://huggingface.co/Mozilla/Meta-Llama-2-8B-Instruct-llamafile/tree/main)** I may have misunderstood something, but I expected the following command to download just a single file, namely: ``` ./hfdownloader -m "Mozilla/Meta-Llama-3-8B-Instruct-llamafile:Q8_0" -t hf_xxx ``` Instead of...
https://huggingface.co maybe blocked for some reasons, the official [huggingface-cli](https://hf-mirror.com/docs/huggingface_hub/guides/download#download-from-the-cli) support changing endpoint by `HF_ENDPOINT` (for example `export HF_ENDPOINT=https://hf-mirror.com`)
I am trying to download `hfdownloader -j bartowski/DeepSeek-V2.5-GGUF:Q4_0` but it's downloading all the files inside each folders files.
# Improve download performance and progress reporting ## Problem The previous implementation used temporary files for each chunk of a download, which were later merged into the final file. This...
hello im trying to download this repo the problem is when I reach this file named [*.pt](https://huggingface.co/wsj1995/TextualInversion/blob/main/107447/115544/*.pt) I get an error, is there any way to exclude this folder? thanks!
