chatAir icon indicating copy to clipboard operation
chatAir copied to clipboard

[important] Api call count and token used

Open jtt007 opened this issue 10 months ago • 1 comments

Hi,

Since many api have rate limit, In api server settings, once the particular api is configured, we can show 1.total api calll made since configured 2.per day api call ( this will reset to zero daily based on system time)

This is important must need feature. Additionally we can have token usage status also been displayed, since we already have inside chat, but this is clear when we clear context or chat. Instead under api sever setting page, we can show token used since configured This will be easy to track the token usage and estimate the price

jtt007 avatar Feb 16 '25 04:02 jtt007

Token calculation is usually used to calculate the token provided by the service provider and the returned token for statistics. It is not accurate statistics and has a large error, so there is no in-depth development.

flyun avatar Mar 20 '25 09:03 flyun