aws-genai-llm-chatbot icon indicating copy to clipboard operation
aws-genai-llm-chatbot copied to clipboard

Published 20 hours ago • verified publisher icon aws-samples

Token Consumption per Call

Open GiuseppeSergi3 opened this issue 8 months ago • 1 comments

Hello everyone, I was wondering if the number of tokens (both input and output) used for each question asked to the chatbot is currently being tracked. It would be useful information for cost control purposes. Is it tracked somewhere?

Thanks, Giuseppe

GiuseppeSergi3 avatar May 30 '24 12:05 GiuseppeSergi3