tl icon indicating copy to clipboard operation
tl copied to clipboard

Unicode BOM symbol support.

Open nagolove opened this issue 3 years ago • 1 comments

Hi. I do not know is it real issue, but then my editor save BOM symbols in file(on Windows) Teal parser get error like this:

3 syntax errors:
sub\code2.tl:1:1: invalid token '∩'
sub\code2.tl:1:2: invalid token '╗'
sub\code2.tl:1:3: invalid token '┐'

nagolove avatar Mar 31 '21 19:03 nagolove

Yes, skipping the initial UTF-8 BOM ("\xEF\xBB\xBF") from files when running the lexer would be good! Looks like Lua does this as well.

hishamhm avatar Apr 05 '21 19:04 hishamhm