spring-ai icon indicating copy to clipboard operation
spring-ai copied to clipboard

Review what is in ChatOptions

Open markpollack opened this issue 1 year ago • 2 comments
trafficstars

There is the issue #1271 to review but also that the new o1 model has temperature, top_p,and n fixed at 1 while presence_penalty and frequency_panalty are fixed at 0. Also, logprobs is no supported.

This link has a nice write-up on limitations in the model that distinguish it from other models, notably that system messages, tools, function calling are not supported.

Also top_k is in common options but not supported in openai - i think i made the wrong analysis way back by putting it in common options.

markpollack avatar Sep 19 '24 14:09 markpollack