ThunderAI
ThunderAI copied to clipboard
Add an option to display system usage data (token count, etc.) in chat
It would be useful to add a feature that allows publishing system usage data (e.g., token count and other relevant metrics) for the different APIs directly in the chat.
Add a setting to enable/disable this functionality.
Evaluate for which APIs it makes sense to show these metrics and for which it doesn’t.
Display the toggle option only for the APIs where it is relevant.
This would give users more transparency and control over their usage while keeping the UI clean for APIs where such data is not meaningful.