Andrew Lapp

@isamu-isozaki can you please take a look at this changeset and the provided example `json_schema_outlines.py`? https://github.com/lapp0/exllamav2/pull/1 I believe it should provide a sufficient basis for implementing `outlines.models.exllamav2`. Let me know...

@isamu-isozaki sorry for the delayed response. `pyairports` is an annoying library which has caused a lot of issues for me as well. And the only thing we use the library...

>Should I modify the pyproject.toml to install exllamav2 or do you recommend skipping the tests(like diffusers)? We should allow it in the test dependencies for any platform which supports `exllamav2`...

> I think I was a bit confused on how to add models but I'm guessing blockblockblock/TinyLlama-1.1B-Chat-v1.0-bpw4-exl2 is already in the test environment? Yes it's already in the test environment....

>@lapp0 Got it and thanks! I think I'm only missing coverage which I'll try making tests for once I get time Great, please let me know when you're ready for...

Great job @isamu-isozaki ! I've opened the EXL2 PR for logits processors https://github.com/turboderp/exllamav2/pull/634

@isamu-isozaki I'm not sure whether the ExLlamaV2 PR will be merged soon, it's been a week without comment. To get this out the door could you please Outlines ExLlamaV2 documentation...

Does this bug exist when you use the following? ``` logits_processor = outlines.processors.JSONLogitsProcessor( schema, outlines.models.transformers(...).tokenizer ) ```

I'm unable to reproduce using logits processors imported from `outlines.processors`. Could you please help me understand what I'm missing here? ```python3 from transformers import AutoTokenizer from transformers.file_utils import SPIECE_UNDERLINE import...

>Bringing Outlines into compliance with the JSON schema spec here would unfortunately be a breaking change, as it's likely that at least some users have been expecting the patterns they...