Support Constraint Generation

[jgcb00]

Hi, It would be great to support constraint generation, following the work of https://github.com/outlines-dev/outlines

This should not be to much work, to integrate, but this should probably not be in this repository, let me know yours thoughts on that !