llm-graph-builder icon indicating copy to clipboard operation
llm-graph-builder copied to clipboard

Published 20 hours ago • verified publisher icon neo4j-labs

Track LLM token usage

Open kaustubh-darekar opened this issue 6 months ago • 2 comments

  • [ ] Store the token usage in extract and chat in database
  • [ ] Use environment variable to turn on token usage tracking (mandatory database details if turned ON)

kaustubh-darekar avatar May 27 '25 08:05 kaustubh-darekar

Hi @jexp
should we store token usage as combined for all llms used by user or
each llm usage separate per user?

kaustubh-darekar avatar May 27 '25 08:05 kaustubh-darekar

Across all LLMs, just total token usage.

jexp avatar May 27 '25 13:05 jexp