faster-utf8-validator
faster-utf8-validator copied to clipboard
zwegner
A very fast library for validating UTF-8 using AVX2/SSE4 instructions
Thanks for the greater work 👍, I now use the library in Notepad2 (https://github.com/zufuliu/notepad2 by commit https://github.com/zufuliu/notepad2/commit/481377287679fd85e9c2d16f8f9220e0e30a6ac6). I found manually expanded/unrolled version of the two functions are about 2x faster...
BeeOnRope brought up some good points in this subthread of my HN post: https://news.ycombinator.com/item?id=21550453 I can see two main approaches to adaptation: whether to use an early exit for ASCII-only...
This isn't so much an issue as much as it is a tip. But you mention not having access to an AVX512 machine: > This algorithm should map fairly nicely...
Hey @zwegner this looks really interesting. Would you mind clarifying the license of the validator? I didn't see any mention of this. Or better yet add a LICENSE file to...
If it is truly the state of the art, browsers should probably begin to use it.
