OpenLLM
OpenLLM copied to clipboard
bug: OpenAI marshalling types
Describe the bug
Union type for struct stop in CompletionRequest | ChatCompletionRequest in OpenAI compatible endpoint needs to be registered to cattr converter. Currently, stop is a bit broken.
To reproduce
No response
Logs
No response
Environment
main
System information (Optional)
No response