tree-sitter-css
tree-sitter-css copied to clipboard
bug: Identifier considers non-ASCII an error
Did you check existing issues?
- [ ] I have read all the tree-sitter docs if it relates to using the parser
- [X] I have searched the existing issues of tree-sitter-css
Tree-Sitter CLI Version, if relevant (output of tree-sitter --version)
No response
Describe the bug
In an editor, I noticed that a class selector gets marked as an error if I use non-ASCII letters. Looking at the source code here, it seems that identifiers are constrained to ASCII. This is not correct; CSS allows basically any non-ASCII character in identifiers.
Steps To Reproduce/Bad Parse Tree
Use a non-ASCII character in an identifier. One example is the letter á.
Expected Behavior/Parse Tree
Non-ASCII letters should not appear as errors.
Repro
/* Example code that fails to parse */
.skráning {
background-color: white;
}