ollama-js icon indicating copy to clipboard operation
ollama-js copied to clipboard

Published 20 hours ago • verified publisher icon ollama

prompt_eval_count is only defined on the first request

Open madflow opened this issue 3 months ago • 0 comments

  • prompt_eval_count is only defined on the first "chat" or "generate" request.
  • It is undefined on the second request with the same content.
  • When implementors rely on this field to be a not nullable number, this might be surprising.
  • https://github.com/ollama/ollama/issues/2068

madflow avatar Mar 18 '24 08:03 madflow