parserllm

parserllm copied to clipboard

Tried `examples/example.py` with a tokenizer derived from a `dict[str, int]`: ```python from tokenizers import Tokenizer from tokenizers.models import WordLevel tokenizer = WordLevel(Tokenizer(str_to_int_dict)) tokenizer.eos_token_id = '\n' ``` Stack trace: ```shell Traceback...

markjr-cisco

Minimum example: ```python grammar = '''start: expression expression: expression " " expression | terminal terminal: "token1" | "token2" '''.strip() parser = Lark(grammar, parser='lalr') p = ParserState(parser) ``` Now, this works...

marcotcr

Hey I was trying to run quantized models using AutoGPTQ or EXLLAMA but it did not work at all. So I am asking if you are thinking about creating a...

ghost

Should this library be folded into ReLLM?

1

I didn't want to saddle [ReLLM](https://github.com/r2d4/rellm ) with the Lark dependency and didn't want to deal with monorepo issues. Any suggestions?

r2d4