text-generation-inference
text-generation-inference copied to clipboard
How do you download a subfile?
System Info
Specifically: bartowski/NemoMix-Unleashed-12B-GGUF/NemoMix-Unleashed-12B-Q4_K_M.gguf I tried:
command: --model-id bartowski/NemoMix-Unleashed-12B-GGUF/NemoMix-Unleashed-12B-Q4_K_M.gguf
but it failed.
Information
- [X] Docker
- [ ] The CLI directly
Tasks
- [ ] An officially supported command
- [ ] My own modifications
Reproduction
See above
Expected behavior
Downloading a file.