Kevin
Kevin
@marella thanks for putting a branch together. I quickly tried to put together a prototype with it with your HF model above `marella/gpt-2-ggml` and `guidance==0.0.61` but it's hanging around `_stream_then_save`....