richardanaya2_2048b.Q6_K.gguf

icon indicating a website link https://www.richardanaya.com/

icon location Portland, OR icon location Data Engineer, Code Philosopher, & Robot Psychologist.

Results 43 comments of richardanaya2_2048b.Q6_K.gguf

Grammar Guided response from model.

i am able to easily break Ollama's JSON support like this even with embedding JSON schema in prompts. ![image](https://github.com/ollama/ollama/assets/294042/615c5c5e-65cd-458b-8c22-4f0f3087a979)

Grammar Guided response from model.

I created an extensive PR for supporting grammar and go-side server validation here https://github.com/ollama/ollama/pull/4525

Improved json grammar

I'd offer with the ability to override the grammar on API calls as in this https://github.com/ollama/ollama/pull/4525 PR, we wouldn't have to debate which grammar to use for JSON.