Dan Saattrup Smart
Dan Saattrup Smart
I second this. Further, aside from taking longer, it also accumulates way more RAM during (what seems to be) the compilation stage. Uses >50GB RAM and crashes when using vLLM...
Just for the record, this is still an issue for me, meaning that the newest version of Outlines I can use is v0.0.46, as all newer versions cause me to...
> [#1386](https://github.com/dottxt-ai/outlines/pull/1386) integrates the last `outlines-core` update, and we haven't seen any performance of memory issue with it. I can take a look at the example you're struggling with [@saattrupdan](https://github.com/saattrupdan)....
Missing evaluations for the following languages: - [ ] Bosnian (bs) - [ ] Bulgarian (bg) - [ ] Croatian (hr) - [ ] Danish (da) - [ ] Estonian...
Hi Claus, Can you post the full traceback please? Also, can you post your OS as well as the output of `pip list`?
Thanks for that. Could you try installing `kenlm` separately, with `pip install https://github.com/kpu/kenlm/archive/master.zip`, and see if that produces the same error? If so, can you try installing it with `pip...
@cis2131 Great to hear! I cannot seem to find any mysql errors in your traceback above?
Try following these instructions and see if that helps: https://stackoverflow.com/a/25920020
@cis2131 Can you try switching to the `refactor/change-poetry-to-uv` branch and installing there?
@cis2131 The branch has now been merged into main, so if you pull the newest changes on the `main` branch then you can try again there.