Marco Tulio Correia Ribeiro comments

Results 47 comments of


                                            Marco Tulio Correia Ribeiro

Raw text streaming with hugging face transformers?

I think https://github.com/microsoft/guidance/discussions/129 answers this now, feel free to reopen otherwise.

Docs building instructions

You can access the docs [here](https://guidance.readthedocs.io/en/latest/) (this should have been on the readme, I'll add it).

Transformers separate model server?

In the works.

Javascript Support

We have no plans to implement a js version, but as soon as we get server support going it should be easy to call guidance from `js`

In the new [release](https://github.com/guidance-ai/guidance/discussions/429), we support [llama-cpp models](https://github.com/guidance-ai/guidance#llamacpp). Sorry it took us so long to get to this! They are great, and very fast.

error while using guidance with azure openai

I think this is fixed now. If not, please reopen and give us a snippet to reproduce.

Exception: Error generating stop tokens for geneach loop.

> The error goes away after seting stop=False as suggested in the error message but I think this should be added to the readme. I can do the pull request...

Guaranteeing valid syntax JSON fails for arrays of numbers

The cleanest way would be to set `pattern='[0-9]+`, but as you noted that doesn't work for OpenAI models. Another easy fix is to get the model to stop generation at...

add proverb_playground.png to explain the actual process

Sorry, how does this explain the process better than the gif we have in the readme right now?

add .save() and .load() functions to Program class to (de)serialize partially executed programs

Hey, sorry it took us so long (please see [this](https://github.com/guidance-ai/guidance/discussions/429) announcement). The new version works a little differently, we have [immutable objects](https://github.com/guidance-ai/guidance#basic-generation), and it's easy to take partial completions and...