Rob Porter
Rob Porter
Here's the workaround that I found. Use at your own risk: ``` javascript // Listen to tab events. If we tab we need to look to see if we "natively"...
+1 for this use case. This could be hugely impactful. Is this ticket the best way to track the status of this feature request?
Beam search is a deal breaker for our use case. We use it extensively in prod. We have found that it increases the accuracy of our LLM's responses by roughly...
> For users who need beam search, I'd like to know how sensitive you are w.r.t. the latency and throughput of the inference. We are very sensitive to throughput, but...