mathics-scanner icon indicating copy to clipboard operation
mathics-scanner copied to clipboard

Revise escape sequence scanning

Open rocky opened this issue 8 months ago • 1 comments

Refactor the scanner. Remove prescanner. Handling escape sequences is not a separate phase, but instead is integrated into the scanning phase.

rocky avatar Apr 14 '25 15:04 rocky

@mmatera There is still a lot to do regarding writing tests and ensuring we handle errors and everything correctly.

But since this is getting large, this is a heads-up as to what's on the horizon.

rocky avatar Apr 14 '25 15:04 rocky

@mmatera merging needs to be coordinated with https://github.com/Mathics3/mathics-core/pull/1403 since exception handling has been revised. (In a previous PR, you commented on the use of TranslateErrorNew.)

After this PR, we'll still need to handle boxing expressions inside strings. Boxing expression outside strings, I think, works. But I haven't been able to get to galatea to understand what is expected versus not.

rocky avatar May 31 '25 15:05 rocky