domain_analyzer
domain_analyzer copied to clipboard
duplicate url scheme in crawler.py summary output
Hi, Just used your tool to crawl a website and found this in the output:
Summary of https://https://ftp.example.com
Looks like the url scheme is already in the host_name variable.
Cheers
PS: it's a really interesting tool, thanks for making it
Can you give us some example of how you run it? Command line you use? We can not reproduce it
Here's an example: ./domain_analyzer.py -d dns.be -o -e -q
In the summary of the crawler.