instaparse icon indicating copy to clipboard operation
instaparse copied to clipboard

Time to remove "Experimental" label?

Open cloojure opened this issue 9 years ago • 1 comments

Hi - Just started using Instaparse and I am loving it.

Looking at

:auto-whitespace :standard

and friends, it seems that this would be a core part of nearly all syntaxes that aren't insane (yes, I'm looking at you Python & YAML), and should no longer be labelled "experimental." Should this be considered a core part of Instaparse at this point?

Alan

cloojure avatar Aug 19 '16 20:08 cloojure

The feature certainly works as advertised, but there are still some deeper issues I'd like to address. Some users have expressed that using auto-whitespace makes it easier to fall into certain ambiguity traps (particularly if you don't have a good underling mental model of what auto-whitespace is actually doing behind the scenes), and others have opined that there is no good way to express exceptions to the auto-whitespace rule -- it's currently an all-or-nothing thing.

So I still ponder whether there's a way to make auto-whitespace more generally useful.

Certainly one popular request is to allow instaparse to work on sequences of tokens, rather than just strings. If I implement this, it may make auto-whitespace unnecessary (since whitespace would disappear in the tokenization pass).

Realistically though, if I find something that subsumes auto-whitespace, I'd most likely just leave auto-whitespace in for backwards compatibility. So it's pretty safe to use, if it works for your needs (if that's what you're asking).

Engelberg avatar Aug 22 '16 08:08 Engelberg