spring-ai icon indicating copy to clipboard operation
spring-ai copied to clipboard

Published 20 hours ago • verified publisher icon spring-projects

The withStreamUsage() of the OpenAiChatOptions is not supported in AzureOpenAiChatOptions.

Open hy4470 opened this issue 1 year ago • 3 comments
trafficstars

When using Azure OpenAI, the 'usage' metadata is always returned as empty in the stream().

I understand that 'usage' is supported in the latest OpenAIServiceVersion, V2024_08_01_PREVIEW. Therefore, the AzureOpenAiChatOptions should also support the withStreamUsage() method to align with this.

hy4470 avatar Nov 12 '24 02:11 hy4470