spring-ai icon indicating copy to clipboard operation
spring-ai copied to clipboard

Published 20 hours ago • verified publisher icon spring-projects

Please make EmbeddingModel asynchronous

Open Dieken opened this issue 7 months ago • 0 comments
trafficstars

https://github.com/spring-projects/spring-ai/blob/v1.0.0-M7/spring-ai-model/src/main/java/org/springframework/ai/embedding/EmbeddingModel.java

It's synchronous API, this forces class OpenAiApi holds both RestClient and WebClient:

https://github.com/spring-projects/spring-ai/blob/v1.0.0-M7/models/spring-ai-openai/src/main/java/org/springframework/ai/openai/api/OpenAiApi.java#L100

This also forces a Spring WebFlux application to use thread pool for blocking call to embed().

Dieken avatar Apr 21 '25 09:04 Dieken