Generative models/LLMs in the benchmarks

[ogencoglu]

Would be interesting to have "prompt + LLM" accuracy in the benchmark as well. A simple prompt to GPT4 and restricting the output with LMQL should be quite straightforward.