MicroDev comments

Repositories
Issues
Comments

Results 3 comments of


                                            MicroDev

[Feature] Add Ollama support

```py from guidance import models ollama = models.Ollama('phi3.5') ollama = models.Ollama('phi3.5:3.8b') ollama = models.Ollama('phi3.5:latest') ... ```

ollama support?

Hi! I’ve implemented a thin wrapper for Ollama support in my [fork](https://github.com/microdev1/guidance/tree/ollama). Can you give it a shot before I submit a PR? Thanks!

ollama support?

> I am not sure if there are any other ways to automatically retrieve the role tags based on the model information provided by Ollama. If I have misunderstood anything,...