Fix tmLanguage implementation to work with (most) of the vscode extensions
So, the code that handle the tmLanguages grammars (that for now, only seems lo work for sql-mode) seems fairy complete, and it does work for SQL well.
The thing is, when trying to load any new tmLanguage grammar, it doesn work as expected in most of the ones that I tried (lua, html, clojure).
Each ones gives a different reason, but seems like a combination on the limitations of cl-ppcre compare to the regex engine that vscode is using.
One of the examples is the error that the lua grammar triggers https://github.com/lem-project/lem/issues/1155 .
What can be a nice solution for this problem? :thinking:
These are the extension that I'm refering to https://github.com/microsoft/vscode/tree/main/extensions (inside there is a folder called syntaxes that contains the tmLanguage grammar)
Hmmm, have we entered a phase where we should create our own regex library...
I guess if VSCode can parse the expression correctly, I don't see why we can't (maybe there is a C library that we can build a wrapper).
Maybe we have to build it, but I think it maybe an overkill. Maybe a fork of cl-ppcre? Not sure... :thinking:
Is there a need or can treesitter be leaned on here?