openai4j icon indicating copy to clipboard operation
openai4j copied to clipboard

[FEATURE] Support customize dispatcher of okHttpClient in DefaultOpenAiClient

Open jsonwan opened this issue 5 months ago • 0 comments

Is your feature request related to a problem? Please describe. I want to use this openai client in a production environment, so the ThreadPoolExecutor which okHttpClient use should be customized for monitoring and tracing reason. The way to modify ThreadPoolExecutor of okHttpClient is to customize its dispatcher.

Describe the solution you'd like Add a dispatcher field in OpenAiClient.Builder to allow user to customize it.

jsonwan avatar Sep 10 '24 09:09 jsonwan