Zach Blank

@jyrigo @AhmerKhan1 we are getting reports from iOS drivers that the spoken instructions are too low and they can't hear them regardless of the volume of their device. This is...

> Hi Team, I have identified the issue there was problem with batch size.. now its working fine.. thanks for support !! @arpitkk can you explain what you changed to...

+1

If I understand the OP, this is something I am looking for as well. I want to host an ONNX model with Triton and have that interface with Guidance. @marcotcr,...

@lukaswangbk did you find a solution?

I am running into this same issue. The provided script to convert storywriter HF to FT leads to this error: `RuntimeError: clip_qkv is enabled for this MPT model. This may...

Curious if there's been any progress with this. I've hooked up Microsoft/Guidance and vLLM but the most powerful features aren't yet available because of missing features in vLLM. Thank you!

Hi, I have the same issue with this. Have you found a workaround @alvaromb ?