continue icon indicating copy to clipboard operation
continue copied to clipboard

include index and retrieval token usage in My Usage

Open mattf opened this issue 1 year ago • 1 comments

Validations

  • [X] I believe this is a way to improve. I'll try to join the Continue Discord for questions
  • [X] I'm not able to find an open issue that requests the same enhancement

Problem

as a user with a token budget, i appreciate being able to see my token usage by day and per model for generation & prompt. the indexing (embed(chunk*)) and retrieval (embed(query) & rank(query, chunk*)) pipeline also consume my token budget. i want to be able to see the index and retrieval token usage.

i prefer to see the usage for indexing separate from retrieval, i.e. see embed(chunk*) separate from embed(query).

Solution

No response

mattf avatar Sep 10 '24 10:09 mattf