azure-search-openai-demo icon indicating copy to clipboard operation
azure-search-openai-demo copied to clipboard

Published 20 hours ago • verified publisher icon Azure-Samples

Tracking spent tokens

Open developer992 opened this issue 1 year ago • 1 comments

How do we track spent tokens?

I've tracked down that this ChatCompletion.usage class holds this information but i am having hard time hunting all the calls down ... Is there an easier and more precise way?

developer992 avatar Feb 01 '24 14:02 developer992

Good question! I believe many customers specifically track token usage in either Azure API Management or Application Insights (Azure Monitor). Have you read through https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/monitoring to see what it recommends?

pamelafox avatar Feb 02 '24 00:02 pamelafox