bug: Missing Token speed when stream option is off

[TC117]

Per Nicole's request. create a bug ticket to investigate

Expected behavior I really don't know what to expect but at least give me something similar to token speed for me to have an idea of the performance of my prompt

Screenshots missing token speed.webm

Environment details

• Operating System: Win10
• Jan Version: Jan v0.4.3-139

[louis-jan]

Token Speed = Tokens / second (time window), there is no streaming gap so the Token Speed does not mean much in this case. The response will be returned at once the result will be always equal total tokens / s and time windows = 1.

[louis-jan]

Since this is a misleading feature request, not really a bug. We can close it for now.