Agent Builder vs Playground : Token count behavior diff

[NetGH]

Hi There,

An Azure OpenAI model has been registered as Custom.

It works in both Agent Builder and Playground.

In Agent Builder it says Token used: nnn, where nnn is the actual token count from the usage SSE event. E.g

“usage”: {  “completion_token”: 123 }

In Playground, however, it says: “This model doesn’t return token count.”

[microsoft-github-policy-service[bot]]

Thank you for contacting us! Any issue or feedback from you is quite important to us. We will do our best to fully respond to your issue as soon as possible. Sometimes additional investigations may be needed, we will usually get back to you within 2 days by adding comments to this issue. Please stay tuned.

[xiaolang124]

Currently, we don’t support token counting for custom models, but we may consider adding this feature for certain models in the future.