spring-ai
spring-ai copied to clipboard
Review what is in ChatOptions
trafficstars
There is the issue #1271 to review but also that the new o1 model has temperature, top_p,and n fixed at 1 while presence_penalty and frequency_panalty are fixed at 0. Also, logprobs is no supported.
This link has a nice write-up on limitations in the model that distinguish it from other models, notably that system messages, tools, function calling are not supported.
Also top_k is in common options but not supported in openai - i think i made the wrong analysis way back by putting it in common options.