lark

lark copied to clipboard

Is it possible to parse a list of terminals?

2

I already have my tokens as a list of terminals, like this in a toy grammar: start: A B C A: "a" B: "b" C: "c" tokens = ["a", "b",...

Daniel63656

A fix for black formatter breaking standalone parser generation.

6

Here lies a fix for Lark's standalone parser generation breaking when Lark is run through the black formatter. The fix simply entails stripping lines as they are iterated through in...

marsninja

**Describe the bug** The functionality of Lark standalone parser generator breaks if lark codebase is run through the black formatter tool. This error is produced: ``` jaclang/vendor/lark/tools/standalone.py:217: in main gen_standalone(lark_inst,...

marsninja

Standalone parser is not deterministic

2

**Describe the bug** I want to keep a standalone parser in my repo, to make it easy to use without any dependencies. But even rebuilding exactly the same grammar produces...

Kyuuhachi

example: reconstruct_python.py failing in half cases

1

## Short description When running the example `examples/advanced/reconstruct_python.py`, the code fails on `AssertionError` in approx 50% of cases. ``` Traceback (most recent call last): File "/home/zarnovic/git/lark/examples/advanced/reconstruct_python.py", line 86, in test()...

zarnovican

Breaking changes / docs out of date

7

**Describe the bug** After updated from Lark 1.1.5 to 1.1.7, the parser fails with (at least) two problems. These seem to be due to a rename of `ParseTree` to `Tree`...

akissinger

This PR updates the Python grammar to be a bit more up-to-date and correct, and it suggests a set of tests that could be run, although I am not sure...

MegaIng

Found a gotcha with the interactive parser

3

``` parser = Lark(r""" %ignore /[\t \f]+/ // WS start: d|c d: B c: A B A: "abc" B: /[^\W\d]\w*/ """, parser="lalr") input_str = 'abc' interactive = parser.parse_interactive(input_str) print(interactive.exhaust_lexer()) interactive.accepts()...

RevanthRameshkumar

Implement cache for earley parser

10

**Suggestion** Lark currently supports caching to disk for the LALR parser, but it would be great to support it for the Earley parser too. We have a project that has...

jtwaleson

Contextual Lexer Leaking "Spam" Terminals

11

**Describe the bug** In a contextual lexing setup, where numerous BasicLexer instances get spawned for the various contexts, many of these instances are being created with toxic "spam" terminals. In...

davidmcnabnz