lmql icon indicating copy to clipboard operation
lmql copied to clipboard

UTF8 non-breaking space leads to incorrect parsing

Open arnaud-secondlayer opened this issue 1 year ago • 1 comments

I found a problem with a UTF-8 non-breaking space at the end of a line. Although I ask LMQL to retrieve a value in a set, it outputs something else. I have the code to reproduce the problem, note the non-breaking space (0xc2 0xa0) after the '-'.

I'm attaching the script as a file, to make sure the non-breaking space is not removed by Github's editor.

test_lmql.py.zip

arnaud-secondlayer avatar Nov 07 '23 22:11 arnaud-secondlayer

Thanks for the reproduction package. We will have a look.

lbeurerkellner avatar Nov 10 '23 21:11 lbeurerkellner