cortex.cpp
cortex.cpp copied to clipboard
bug: `cortex run`: Error: Please delete model before downloading again
Cortex version
v1.0.0-141
Describe the Bug
Issue faced when running an already downloaded huggingface model author/model_id
> cortex-nightly run bartowski/Meta-Llama-3.1-8B-Instruct-GGUF
...
Selected: Meta-Llama-3.1-8B-Instruct-Q2_K.gguf
Model already downloaded: bartowski:Meta-Llama-3.1-8B-Instruct-GGUF:Meta-Llama-3.1-8B-Instruct-Q2_K.gguf
Error: Please delete the model before downloading again
Error: Model not found
Expected behaviour:
- I expect it to run the downloaded model
- I expected the model alias to be the huggingface path
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF
Screenshots / Logs
Mac:
What is your OS?
- [x] MacOS
- [ ] Windows
- [ ] Linux
What engine are you running?
- [X] cortex.llamacpp (default)
- [ ] cortex.tensorrt-llm (Nvidia GPUs)
- [ ] cortex.onnx (NPUs, DirectML)