CognitiveTech

ok, working. done

@iorisa https://github.com/ollama/ollama/blob/main/docs/openai.md > #### Supported features > > - [x] Chat completions > - [x] Streaming > - [x] JSON mode > - [x] Reproducible outputs

this change is a month old, perhaps @victor-u has previous version ollama

ok, one last thing: Do I need to `gradio cc install` before `gradio cc dev`? In all the versions when I type `gradio cc dev` my output is like this:...

ok, well.. I just realized I am trying to code with `gradio_pdf` which was released in january, so before `cc` became a module. maybe I will try again from scratch...

thanks freddy! i did find the gradio --help does work, later on.. so I deleted the first place mentioned on this issue, but failed to move from the other. I...

in fact, according to the mistral paper its [trained on 8k context](https://arxiv.org/pdf/2310.06825.pdf) | Parameter | Value | | -- | -- | | dim | 4096 | | n_layers |...

may as well thow my two cents in the mix.. I have tested a lot of things, but this works really well for mistral models: ``` TEMPLATE """ {{ if...

### Working Models #### Mistral Prompt - [**Mistral-7B-Instruct-v0.2-GGUF**](https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GGUF) - snorkel-mistral-pairrm-dpo.Q8_0.gguf #### Default Prompt - [**SynthIA-7B-v2.0-GGUF**](SynthIA-7B-v2.0-GGUF) ( I like Synthia too, not sure about V3 though ) ##### User: Assistant: *Their...

@imartinez for sure. I never added to the docs for a couple reasons, mainly because most of the models I tried didn't perform very well, compared to Mistral 7b Instruct...