Chris Cleveland
Chris Cleveland
Sure. This is for a search engine. The first step is to tokenize the text before indexing it. A simple way to do it is with a whitespace tokenizer, but...
The external developers will have the option to write transformers in other languages like Python or Javascript. They can do Rust if they need speed, other langs if they don't....
The transformer does more than just process text. It attaches metadata to tokens as well. Yes, there is an ffi interface that sends tokens back and forth as structs. For...
Any thoughts on this?
Yes, we need more control over the output directory. See also #306. I want to put my .g4 files in the main java source tree and put the generated files...
@MagnetiteMC Ok, I see it now. I simply changed == to !=, rather than do it as he did in the pr, to give the dev more flexibility to specify...
Just wanted to bump this issue up. I saw this post on Hacker News today: https://tratt.net/laurie/blog/2023/why_split_lexing_and_parsing_into_two_separate_phases.html See also the discussion: https://news.ycombinator.com/item?id=35798829
@eeeebbbbrrrr I just stumbled across this: https://pgt.dev/ Wonder if it could be a universal solution to the deployment problem?