[important] Api call count and token used
Hi,
Since many api have rate limit, In api server settings, once the particular api is configured, we can show 1.total api calll made since configured 2.per day api call ( this will reset to zero daily based on system time)
This is important must need feature. Additionally we can have token usage status also been displayed, since we already have inside chat, but this is clear when we clear context or chat. Instead under api sever setting page, we can show token used since configured This will be easy to track the token usage and estimate the price
Token calculation is usually used to calculate the token provided by the service provider and the returned token for statistics. It is not accurate statistics and has a large error, so there is no in-depth development.