shortest icon indicating copy to clipboard operation
shortest copied to clipboard

Track token usage

Open gladyshcodes opened this issue 2 months ago • 1 comments

What

We may need better telemetry on how many input/output/total tokens went into shortest. Fortunately, Anthropic API returns token usage for each request.

Why

  • Help people better measure cost
  • Control costs
  • Facilitate cost-benefit analysis

gladyshcodes avatar Dec 27 '24 11:12 gladyshcodes