Make sure domains are normalized

Open Minoru opened this issue 2 years ago • 1 comments

curl's author blogs about IDN: https://daniel.haxx.se/blog/2022/12/14/idn-is-crazy/ I only skimmed it, but my first take-away is that we probably should normalize domains to some (arbitrarily chosen) format, so "identical" domains end up being actually identical and don't e.g. appear multiple times in our list.

Dec 26 '22 17:12 Minoru

Lo and behold, we indeed have identical domains on the list: ⵣ.todz.ynh.fr is xn--lnj.todz.ynh.fr.

Jun 17 '23 09:06 Minoru