BrainChulo icon indicating copy to clipboard operation
BrainChulo copied to clipboard

bootstrap_models.py is broken

Open chrishart0 opened this issue 1 year ago • 4 comments

Just cloned your repo down. Tried following through the readme and ran into an issue with bootstrap_models.py

 $ python bootstrap_models.py

NOTE: You can change the default downloaded model by passing an additional argument:bootstrap_models.py [hugging-face-llm-model-name] [hugging-face-embeddings-model-name]
Your choices:
MODEL: openlm-research/open_llama_3b
EMBEDDINGS MODEL: sentence-transformers/all-MiniLM-L6-v2

Downloading model sentence-transformers/all-MiniLM-L6-v2 to ./models/sentence-transformers/all-MiniLM-L6-v2
Please note that if model is large this may take a while.
Traceback (most recent call last):
  File "/media/chris/LLM Drive/BrainChulo/bootstrap_models.py", line 58, in <module>
    main(model, embeddings)
  File "/media/chris/LLM Drive/BrainChulo/bootstrap_models.py", line 32, in main
    _download_if_not_exists(embeddings_model)
  File "/media/chris/LLM Drive/BrainChulo/bootstrap_models.py", line 19, in _download_if_not_exists
    process.check_returncode()
  File "/usr/lib/python3.11/subprocess.py", line 502, in check_returncode
    raise CalledProcessError(self.returncode, self.args, self.stdout,
subprocess.CalledProcessError: Command '['python3', 'download-model.py', 'sentence-transformers/all-MiniLM-L6-v2', '--output', './models']' returned non-zero exit status 1.

System Info

OS: Ubuntu 22.04 Python Version: 3.11.4

chrishart0 avatar Oct 17 '23 00:10 chrishart0

Hello there! Thanks for signaling this issue, we're looking into it!

hugothomel avatar Oct 17 '23 16:10 hugothomel

Hi, thanks for reporting it. It looks like the script needs to log more info on failure, we cannot tell from the current logs what the issue is.

@chrishart0 Would you be willing to try again if we added more logs here?

paolorechia avatar Oct 18 '23 05:10 paolorechia

Yes

chrishart0 avatar Oct 18 '23 05:10 chrishart0

So I created a new branch called fix-bootstrap that I suggest you pull. I noticed we had a dependencies issue when installing the requirements, which allowed for a reproduction of your error if not acted upon. Can you try running bash setup.sh again and tell us if it works?

hugothomel avatar Oct 18 '23 06:10 hugothomel