outlines icon indicating copy to clipboard operation
outlines copied to clipboard

feat request: Batch inference with outlines applying the same regex

Open alonsosilvaallende opened this issue 1 year ago • 1 comments

I'm trying to make batch inference with outlines when I'm applying the same regex to a whole dataset. I noticed the following comment in the logits processor: https://github.com/dottxt-ai/outlines/blob/dc31b9b4027e71bd69f213bd3ab7d98b2f0a1529/outlines/processors/base_logits_processor.py#L47-L48 Why is it the case? Is it some hard constraint or can it be relaxed when applying the same regex?

alonsosilvaallende avatar Oct 29 '24 15:10 alonsosilvaallende

Does it work now?

rlouf avatar Jun 25 '25 20:06 rlouf