macai
macai copied to clipboard
[Feature Request] Token&cost counters
Reference Issues
No response
Summary
Is an everyday LLMs user, I would like to be aware of token usage/cost stats for each chat and globally for all accounts (e.g. for last week or just today). There might be a section in settings to add token/cost counter for chats/API services/globally, also we may convert tokens to cost directly, so currency settings can also be great
Basic Example
I use some costly models sometimes and wanna be in control of my spendings. Some APIs, e.g. OpenRouter API, allow to load cost details automatically, that can be useful.
Drawbacks
No response
Unresolved questions
No response
In #50 we may start caching token cost details in advance