Alexandre Gourdel
Alexandre Gourdel
did you find any solution ?
In order to fix this issue, just remove lines 229;230;231 from src/index.rs inside the "next_state" function and it should do the trick. When we are in one final state, the...
Well, I saw what you proposed in #236 and I'm afraid it would be a mistake. You need to keep the eos_token in the allowed tokens mask because otherwise the...
Previous benchmarks times were false ( Because Debug mode) Here is the real times for compilation and mask access : Compilation times from rust :  Mask access times :...

@joerunde (and @rlouf ) Did you check that the tests have been made with release mod activated ? I got fooled myself. Every benchmark times that I got here #194...
Yes of course. Let me clean some french comments write by me for myself. But caution, it's not ready for production. It needs proper documentation, comments, a real constructor for...
@cpfiffer https://github.com/dottxt-ai/outlines-core/pull/187