gptcommit icon indicating copy to clipboard operation
gptcommit copied to clipboard

`Error: No tokenizer found for model` with Ollama

Open luochen1990 opened this issue 1 year ago • 6 comments

Describe the bug

Trying to use ollama but failed with Error: No tokenizer found for model, tried to change the model but still same error.

To Reproduce

[openai]
api_base = "http://127.0.0.1:11434/v1"
api_key = ""
model = "llama3.1:latest"
retries = 2
proxy = ""
  1. Run ollama server locally
  2. Exec ollama run llama3.1:latest
  3. Try some talk to Confirm that ollama is running without issue
  4. Edit ~/.config/gptcommit/config.toml and add above config
  5. git add something and Execute git commit
  6. See error

Expected behavior

Works correctly and without error

Screenshots If applicable, add screenshots to help explain your problem. Run your command with the RUST_LOG=trace environment variable for the best support

image

image

System Info (please complete the following information):

  • OS: linux (NixOS unstable)
  • Version: gptcommit v0.5.16

luochen1990 avatar Sep 27 '24 03:09 luochen1990