ctl icon indicating copy to clipboard operation
ctl copied to clipboard

Published 20 hours ago • verified publisher icon rurban

Unicode NFD is destructive

Open TinoDidriksen opened this issue 3 years ago • 1 comments

u8string will get proper utf-8/unicode support, exceeding C++ STL. compare will check u8strings normalized to NFD.

Please consider that very carefully. Normalization is destructive. E.g. both Å (U+00C5) and Å (U+212B) will normalize to Å (U+0041 U+030A). There are lots of such destructive normalizations, but do you really want to consider them equal? I sure don't.

TinoDidriksen avatar Feb 04 '22 19:02 TinoDidriksen

Compare is done with a copy of course. See also libu8ident, which does the ident checks already

rurban avatar Apr 09 '23 20:04 rurban