outlines icon indicating copy to clipboard operation
outlines copied to clipboard

Support LMStudio backend

Open rlouf opened this issue 6 months ago • 2 comments

LMStudio supports structured outputs with outlines-core. We can use their Python SDK to add it as a backend in Outlines.

rlouf avatar Jun 25 '25 13:06 rlouf

Hey @rlouf , I have used and liked both projects and would be interested in implementing this feature in my free time. Are there any timelines, and would it be suitable for a first contribution to outlines?

Davo00 avatar Jul 02 '25 10:07 Davo00

I think the path to implementation is pretty straightforward, as this is going to be very similar to the Ollama integration (we may be able to use regex patterns as well, but I would need to check with the LMStudio team; let's assume we can't for now). I think it is suitable as a first contribution.

rlouf avatar Jul 02 '25 14:07 rlouf