hyphe
hyphe copied to clipboard
Websites crawler with built-in exploration and control web interface
which could propose to merge: - variations of tlds of a same domain - variations of twitter sources (mobile.twitter.com/user + twitter.com/user + twitter.com/UsEr - ...
This could include child/parent ones, but also citing/cited ones, and allow easily to merge one into the current with a single button as with latest HyBro changes This should provide...
Cannot set http://fr.wikipedia.org/wiki/Front_de_gauche_%28France%29 as homepage for WE with prefix http://fr.wikipedia.org/wiki/Front_de_gauche_(France)
Est-il possible d'exporter la liste de toutes les URLs complètes crawlées par Hyphe ? Je précise "complètes" parce que la fonction EXPORT de l'interface Web de Hyphe ne semble pas...
https://github.com/medialab/ural/blob/master/ural/is_shortened_url.py#L17