domained icon indicating copy to clipboard operation
domained copied to clipboard

Invalid domains/subdomains should be removed

Open ccsplit opened this issue 6 years ago • 0 comments

Currently the application will send all of the results into the various tools such as EyeWitness which can cause issues such as the one below. Therefore, it would be a good idea to remove invalid domains after the results are returned. This could be done a couple of ways such as trying to resolve the domains and if it errors/cannot obtain an IP address ignoring and/or placing it into an invalid domain list.

I will work on implementing this if I get a chance.

Attempting to screenshot https://.example.com
Process Process-5:
Traceback (most recent call last):
File "/usr/lib/python3.7/encodings/idna.py", line 165, in encode
raise UnicodeError("label empty or too long")
UnicodeError: label empty or too long

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/usr/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
self.run()
File "/usr/lib/python3.7/multiprocessing/process.py", line 99, in run
self._target(*self._args, **self._kwargs)
File "/home/ec2-user/domained/bin/EyeWitness/EyeWitness.py", line 303, in worker_thread
http_object.resolved = resolve_host(http_object.remote_system)
File "/home/ec2-user/domained/bin/EyeWitness/modules/helpers.py", line 293, in resolve_host
resolved = socket.gethostbyname(system)
UnicodeError: encoding with 'idna' codec failed (UnicodeError: label empty or too long)
Finished in 8636.717457056046 seconds

Originally posted by @tanujjane in https://github.com/TypeError/domained/issues/61#issuecomment-558174781

ccsplit avatar Nov 25 '19 15:11 ccsplit