sentence transformer download is fails while container is up

[praveshkumar1988]

we need to fix the sentence transformer download, it fails all the time with 429 errors when trying to start the container either we need to bake it into the container or we need to download it from an URL that we control like a GCS bucket https://milvus.io/ai-quick-reference/if-the-sentence-transformer-model-downloads-from-hugging-face-are-very-slow-or-failing-what-can-i-do-to-successfully-load-the-model milvus.iomilvus.io If the Sentence Transformer model downloads (from Hugging Face) are very slow or failing, what can I do to successfully load the model? If you're experiencing slow or failed downloads when loading a Sentence Transformer model from Hugging Face, there are s (127 kB)

Error Logs----------- Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1533, in _get_metadata_or_catch_error metadata = get_hf_file_metadata( File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn return fn(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1450, in get_hf_file_metadata r = _request_wrapper( File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 286, in _request_wrapper response = _request_wrapper( File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 309, in _request_wrapper response = http_backoff(method=method, url=url, **params, retry_on_exceptions=(), retry_on_status_codes=(429,)) File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_http.py", line 317, in http_backoff response.raise_for_status() # Will raise uncaught exception File "/usr/local/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 429 Client Error: Too Many Requests for url: https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/config.json