Domainiator
Domainiator copied to clipboard
Published
20 hours ago •
benjojo
benjojo
A quick mass domain crawler that I use to crawl zone files.
Results
6
Domainiator issues
Sort by
recently updated
recently updated
newest added
useful to see if we can proceed, that way we don't make everyone angry like last time
How long it took to get the first byte, and if how long it took to get the last one.
Need to write own net/http
as far as I am aware go does provide a "callback" to do this
Need to write own net/http
I want to crawl every domain at least once a fortnight. For this I will need to split up the domain files in the beginning to 14 bits and load...