twitter-text icon indicating copy to clipboard operation
twitter-text copied to clipboard

Allow emoji domain names

Open mhlz opened this issue 1 year ago • 1 comments

Problem

Currently the ruby version of this library does not recognize links to domains that include emojis, even though browsers support those domains. Texts that include "https://🌈🌈🌈.st" will not be accepted as a valid URL. The problem comes from idn-ruby and libidn2, which does not recognize emoji characters as valid for domain names, even though they are registerable and work fine in browsers (after being translated into punycode).

Solution

I replaced idn-ruby with another rubygem that implements the punycode conversion in ruby directly without native dependencies and then added some validation that libidn2 did to pass the conformity test suite again.

Result

Texts that include "https://🌈🌈🌈.st" will now correctly identified as including a link. Note that currently there are more checks in this library that prevent "🌈🌈🌈.st" from being parsed as a link. While I would like to make that work as well, I felt like that would be too big of a change.

mhlz avatar Jul 08 '23 20:07 mhlz

CLA assistant check
All committers have signed the CLA.

CLAassistant avatar Jul 08 '23 20:07 CLAassistant