Jeffrey Tang

For example, constraining the model to output a boolean, rather than a boolean embedded inside a JSON object. Should be possible with a small modification to the existing Outlines integration.

For readability purposes, it's useful to allow an optional separator string for enum values. For example: `TypeName_EnumValue` instead of `TypeNameEnumValue`. This PR adds the `EnumPrefixSeparator` configuration parameter to control such...

feat: Function calling with output schema enforcement

6

Introduces function-calling capabilities with JSON schema enforcement on output. Example using `Mistral-7B-Instruct-v0.3`: ``` curl 127.0.0.1:8080/generate -X POST -d '{ "inputs": "WHat is the current temperature of New York, San Francisco...