ksic180586

Model only outputs G repeatedly in interactive mode with ggml-model-i2_s.gguf

9

When I run `run_inference.py` in interactive mode using the provided `ggml-model-i2_s.gguf` from Hugging Face, the model only outputs the character `G` in a loop, no matter what prompt I use....