hollama icon indicating copy to clipboard operation
hollama copied to clipboard

Published 20 hours ago • verified publisher icon fmaclen

Show response tokens per second rate

Open fmaclen opened this issue 10 months ago • 0 comments

To calculate how fast the response is generated in tokens per second (token/s), divide eval_count / eval_duration.

https://github.com/ollama/ollama/blob/main/docs/api.md#response

fmaclen avatar Mar 27 '24 16:03 fmaclen