outlines
outlines copied to clipboard
Support LMStudio backend
LMStudio supports structured outputs with outlines-core. We can use their Python SDK to add it as a backend in Outlines.
Hey @rlouf , I have used and liked both projects and would be interested in implementing this feature in my free time. Are there any timelines, and would it be suitable for a first contribution to outlines?
I think the path to implementation is pretty straightforward, as this is going to be very similar to the Ollama integration (we may be able to use regex patterns as well, but I would need to check with the LMStudio team; let's assume we can't for now). I think it is suitable as a first contribution.