[FEAT]: Track Token Costs During Chat and Record Statistics

[chalitbkb]

What would you like to see?

Is it possible to calculate the token cost used in each conversation at the bottom of the chat box and keep a record of all statistics, including total expenses, on the dashboard?

Example

[CaffiendDevKit]

I would also like to see this.

I would be happy to manually enter the costs when selecting the specific model, either default or per workspace.

I can see some complications in that some providers offer a flat rate for in and out, some offer a different price for in and out.

But would be a great feature to see implemented

[timothycarambat]

We have now had metrics recording for a while now and they can be see when hovering over any LLM response as well as clicking them will show them instantly as reported