Nick Ouellet
Nick Ouellet
A similar problem with control flow is faced by actually a very similar (albeit more "primitive" involving no LLMs) scenario as lmql - parser combinators. I think [parsy](https://parsy.readthedocs.io/en/latest/) is fairly...
@lbeurerkellner I did bump it to `transformers==4.28.1` and set `clean_up_tokenization_spaces` to True which seemed to fix it [this](https://github.com/huggingface/transformers/blob/42288269c38a324d457a02f069433fb8aee23e8a/src/transformers/tokenization_utils_fast.py#L551) is where the error originates. It's looking for the argument or from...