Andrew Lapp
Andrew Lapp
Replaces https://github.com/outlines-dev/outlines/pull/507 Fixes https://github.com/outlines-dev/outlines/issues/795 Awaiting https://github.com/outlines-dev/outlines/pull/904 before I continue working on this In `regex.py` Outlines compiles an index of legal tokens for each state of the FSM (`state_scan_tokens`) On the...
### Describe the issue as clearly as possible: Pattern repetition cannot be used when one repetition is dependent on another repetition in and array or object For example, when handling...
Initialization benchmarks are introduced in https://github.com/outlines-dev/outlines/pull/542 We should extend these benchmarks to measure the performance of inference. # Goal Outlines shouldn't be a bottleneck for most inference. A reasonable goal...
### What behavior of the library made you think about the improvement? The verbiage is a bit confusing. `RegexGuide.is_final_state` currently returns both EOS-required AND EOS-accepting states. This has resulted in...
### Describe the issue as clearly as possible: The pattern is `DATE = r"(\d{4})-(0[1-9]|1[0-2])-([0-2][0-9]|3[0-1])"` This allows the generation of "2024-02-30" ### Steps/code to reproduce the bug: ```python Difficult to reproduce...
### What behavior of the library made you think about the improvement? Generation cannot be interleaved with function calls and return values. ### How would you like it to behave?...
### What behavior of the library made you think about the improvement? Only vLLM can be served. ### How would you like it to behave? Our serve endpoint should be...
### Describe the issue as clearly as possible: ExLlamaV2 cannot be used with beam sampler. ### Steps/code to reproduce the bug: ```python import outlines import threading # git lfs install...
### What behavior of the library made you think about the improvement? Currently `CFGFSM` is LR(0). Before @benlipkin's changes in https://github.com/outlines-dev/outlines/pull/544, terminals would **always** terminate if they legally could. Now...
### What behavior of the library made you think about the improvement? It's not obvious which features are compatible with each model. A user was recently struggling with running a...