url-extractor topic

List url-extractor repositories

galer

207
Stars
33
Forks
Watchers

A fast tool to fetch URLs from HTML attributes by crawl-in.

url-knife

327
Stars
14
Forks
Watchers

Extract and decompose (fuzzy) URLs (including emails, which are conceptually a part of URLs) in texts with robust patterns.

Damn-Small-URL-Crawler

29
Stars
12
Forks
Watchers

A Minimal Yet Powerful Crawler for Extracting all The Internal/External/Fuzz-able Links from a website