Urro

It's September of 2024 and I'm still running into this issue through the official release, attempting to load a GGUF with a GrammarlessTokenizer from Transformer's AutoTokenizer. I'll try using the...

Support for MistralForCausalLM would also be great!

It's important to note the limited vocabulary on some Seq2Seq T5 models. However, I definitely think it's still possible if Guidance can maintain its specialized token healing processes. I am...

Thank you for the informative response, Currently, I need a complex regex that is only possible with at least one of the following features, in order of most efficient to...

Is there a way for me to use Lark or EBNF with Guidance directly?

Thank you so much! While this doesn't have much to do with the original issue, it still provides feature support for named capture groups that cannot be performed with a...

I keep getting this error: ```bash --------------------------------------------------------------------------- PanicException Traceback (most recent call last) Cell In[2], line 61 58 print(lm) 60 if __name__ == "__main__": ---> 61 main() Cell In[2], line...

Thanks for the quick reply! Sorry for my late one. I'm using the latest stable of `llguidance`, version 0.7.0. I've also tried a variety of models, but the main one...

Thank you so much for the detailed reply. On a related note, is there a recommended citation for Guidance? I would like to include the mention in my next research...