PyShEx icon indicating copy to clipboard operation
PyShEx copied to clipboard

Unicode outside BMP

Open ericprud opened this issue 1 year ago • 0 comments

iirc, PyShEx failed tests where the schema (or data?) had codepoints > U+FFFD . I stumbled across a repo that I created for dealing with this in Java and Javascript, both of which use UTF16 internally and thus require the grammar to be written not in terms of codepoints U+10000- but instead surrogate pairs. I don't remember the state of this repot, but it could be handy to clone it and play with the python rather than experimenting in the larger ShEx g4.

ericprud avatar Mar 19 '23 09:03 ericprud