fetchurls
fetchurls copied to clipboard
adamdehaven
A bash script to spider a site, follow links, and fetch urls (with built-in filtering) into a generated text file.
Hey Adam, thank you for your nice little script! :-) I ran into the problem that the website I'd like to fetch all URLs from blocked the default `wget` User-Agent...
Hi, hope you're doing well fetchurl is not working on kali but same process is done on cPanel its working fine. 
Metadata
Owner
Metadata
A bash script to spider a site, follow links, and fetch urls (with built-in filtering) into a generated text file.