jorado

Thanks for adding the `json_schema` response type! While this PR does implement it, I'm wondering if it might miss an opportunity to better align with OpenAI's specification, which was a...

I now get a different error, both in the latest image and in 2.2.0. ``` 2024-08-08T14:13:11.002710Z INFO text_generation_launcher: Args { model_id: "google/gemma-2-9b-it", revision: None, validation_workers: 2, sharded: None, num_shard: None,...