Tal Globus

Running into this same issue

Checking on this, definitely high-priority

Any updates on this? Seems to solve a pretty significant occasional bug

Happy to help implement this

@paulbkoch Running into the same issue. ```python import llama_cpp print(llama_cpp.__version__) ``` Output: ```python 0.2.57 ``` But... ```python from guidance import models, gen, system, assistant mistral = models.MistralInstruct() ``` Output: ```python...

@kvey Any updates?