Add Tensor-RT integration

Open rlouf opened this issue 1 year ago • 4 comments

Following #728 we could add a Tensor-RT integration that would allow to use outlines's constrained generation via logits processors.

Mar 09 '24 18:03 rlouf

@rlouf if anyone is not working on this ,would love to solve this .

Apr 11 '25 12:04 kernel-loophole

I don't think anyone is working on this. If you are interested, you'd have to do this in the v1.0 branch to avoid having to overhaul it when we release 1.0. We're currently writing the docs at the moment, which might help with implementation.

Apr 11 '25 18:04 cpfiffer

No one is. I would integrate outlines-core directly instead of going through outlines.

Apr 11 '25 19:04 rlouf

this is great will start working on this soon ,any starting point or arc review for this

Apr 11 '25 19:04 kernel-loophole