cortex.cpp icon indicating copy to clipboard operation
cortex.cpp copied to clipboard

bug: `cortex run`: Error: Please delete model before downloading again

Open gabrielle-ong opened this issue 4 months ago • 0 comments

Cortex version

v1.0.0-141

Describe the Bug

Issue faced when running an already downloaded huggingface model author/model_id

> cortex-nightly run bartowski/Meta-Llama-3.1-8B-Instruct-GGUF
...
Selected: Meta-Llama-3.1-8B-Instruct-Q2_K.gguf
Model already downloaded: bartowski:Meta-Llama-3.1-8B-Instruct-GGUF:Meta-Llama-3.1-8B-Instruct-Q2_K.gguf
Error: Please delete the model before downloading again
Error: Model not found

Expected behaviour:

  1. I expect it to run the downloaded model
  2. I expected the model alias to be the huggingface path bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Screenshots / Logs

Mac: image image

What is your OS?

  • [x] MacOS
  • [ ] Windows
  • [ ] Linux

What engine are you running?

  • [X] cortex.llamacpp (default)
  • [ ] cortex.tensorrt-llm (Nvidia GPUs)
  • [ ] cortex.onnx (NPUs, DirectML)

gabrielle-ong avatar Oct 03 '24 10:10 gabrielle-ong