llama-stack icon indicating copy to clipboard operation
llama-stack copied to clipboard

add token usage metadata to agents turn execution results

Open jhpiedrahitao opened this issue 6 months ago • 2 comments

🚀 Describe the new functionality needed

add token usage metadata from inference steps to agents when getting turn execution results

💡 Why is this needed? What if we don't build it?

for majority of applications it is required to track token usage to estimate costs associated with the agent utilization

Other thoughts

No response

jhpiedrahitao avatar Apr 11 '25 17:04 jhpiedrahitao