Pamela Fox

That error could also come from Azure OpenAI, it's the same class for both clients, I believe. Did you find the actual error in the logs / App Insights?

@stephenasuncionDEV I'm curious, have you seen a change in the logic needed for the calculation I pu above? Just want to make sure I didn't miss an announcement.

For now, since I have a need to use this functionality across multiple projects, I've put it in a small package: https://github.com/pamelafox/openai-messages-token-helper For example- ``` from openai_messages_token_helper import count_tokens_for_image image...

Thanks for approval! FYI that I don't have merge permission, so someone on your team will need to merge when you're ready.

I am using a GitHub action workflow, not ADO pipeline, which you can see in my attempted PR: https://github.com/Azure-Samples/azure-search-openai-demo/pull/444/files

Thanks @JohnathonMohr for the suggestion. I've now run into this issue for a different repo where I need to specify a parameters file in a different location than the template,...

No, this looks like an accidental PR with personal changes.

Thanks so much for the report, something must have changed with the downloaded Python packages. I've put in a quickfix that seems to superficially fix it, still need to dig...

Cool! I made a few changes to the PR to make it a little easier to test out, by actually making the additional backend deployment, mind if I push them...

Here are what my usage graphs look like during a load test btw: