endolith

I tried to go through these directions and it didn't work. I kept pasting error messages into AI and trying things until I got Open Interpreter working in Termux 0.118.3...

Add structured outputs support to Runpod API

4

Add support for structured outputs (JSON schema, regex, choice, grammar, and structural_tag constraints) using vLLM 0.11.0+'s StructuredOutputsParams API. Changes: - Import StructuredOutputsParams from vllm.sampling_params - Extract structured_outputs from extra_body in...

and run markdown linter

Guided decoding backends not working - both old and new APIs fail

3

Neither the old guided decoding API (`guided_json`) nor the new structured outputs API (`structured_outputs`) work in this worker. JSON schema constraints are ignored with the old API, and the new...

Does LMFE_STRICT_JSON_FIELD_ORDER not work?

1

I tried to enable LMFE_STRICT_JSON_FIELD_ORDER = `true` in the env vars in Runpod but it still allows the LLM to output json in whatever order it wants (such as outputting...