Suggestion for Pre-Downloading Large Model Files like pytorch_model-00001-of-00002.bin

[bizarreuser]

Issue: Difficulty in Downloading Large Files During openchat Installation

Problem Description

Hello,

I've encountered some difficulties while installing openchat, mainly due to the size of the file pytorch_model-00001-of-00002.bin. Given its large size, the download process can be quite slow during installation, particularly in cases of poor network connections.

Suggestion

I would like to suggest the possibility of providing an option to pre-download this file. This way, users can complete the download of the file before the installation process, potentially speeding up the entire setup. If possible, a script or tool could be provided to facilitate this process.

Request for Feedback

I'm curious to hear your thoughts on this suggestion and welcome any form of feedback.

Appreciation

Thank you very much for your time and consideration!

[Uzzimauzer]

Hello,

You may download model and all needed files from Hugging Face, and in the --model flag, specify the path to the folder with model, like: python3 -m ochat.serving.openai_api_server --model /usr/src/app/openchat_3.5 --host 0.0.0.0