httpscreenshot icon indicating copy to clipboard operation
httpscreenshot copied to clipboard

OSError: [Errno 9] Bad file descriptor

Open ghost opened this issue 6 years ago • 2 comments

I am using httpscreenshot to see if sites are up and understanding what they are hosting. This list has 675 domains and I am using the --headless flag. The list of domains consist of sites that may or may not be hosting anything. Testing against 50 sites known to be hosting content the script works pretty well. When testing against a list of sites that might not be hosting anything it fails out with the following:

[-] Something bad happened with URL: <Domain> Process Process-2: Traceback (most recent call last): File "/usr/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap self.run() File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run self._target(*self._args, **self._kwargs) File "../httpscreenshot.py", line 370, in worker browser.quit() File "/home//.local/lib/python2.7/site-packages/selenium/webdriver/phantomjs/webdriver.py", line 80, in quit self.service.stop() File "/home//.local/lib/python2.7/site-packages/selenium/webdriver/common/service.py", line 151, in stop self.send_remote_shutdown_command() File "/home//.local/lib/python2.7/site-packages/selenium/webdriver/phantomjs/service.py", line 67, in send_remote_shutdown_command os.close(self._cookie_temp_file_handle) OSError: [Errno 9] Bad file descriptor

I've sought help on this error but can't get to a conclusion as to why this does not work. I'm trying to understand sites available to conduct further analysis on those hosting. Any help would be much appreciated.

Thanks.

ghost avatar Jun 22 '18 15:06 ghost

Can you send me an example of a URL where it fails in this way?

On Fri, Jun 22, 2018 at 11:32 AM RichardLWright [email protected] wrote:

I am using httpscreenshot to see if sites are up and understanding what they are hosting. This list has 675 domains and I am using the --headless flag. The list of domains consist of sites that may or may not be hosting anything. Testing against 50 sites known to be hosting content the script works pretty well. When testing against a list of sites that might not be hosting anything it fails out with the following:

[-] Something bad happened with URL: Process Process-2: Traceback (most recent call last): File "/usr/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap self.run() File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run self._target(*self._args, **self._kwargs) File "../httpscreenshot.py", line 370, in worker browser.quit() File "/home//.local/lib/python2.7/site-packages/selenium/webdriver/phantomjs/webdriver.py", line 80, in quit self.service.stop() File "/home//.local/lib/python2.7/site-packages/selenium/webdriver/common/service.py", line 151, in stop self.send_remote_shutdown_command() File "/home//.local/lib/python2.7/site-packages/selenium/webdriver/phantomjs/service.py", line 67, in send_remote_shutdown_command os.close(self._cookie_temp_file_handle) OSError: [Errno 9] Bad file descriptor

I've sought help on this error but can't get to a conclusion as to why this does not work. I'm trying to understand sites available to conduct further analysis on those hosting. Any help would be much appreciated.

Thanks.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/breenmachine/httpscreenshot/issues/31, or mute the thread https://github.com/notifications/unsubscribe-auth/AGazc07trB5_yTV_Gv8f5G1htcUfeSe1ks5t_Q4IgaJpZM4U0AQ1 .

breenmachine avatar Jun 22 '18 15:06 breenmachine

Here's a sample list that will fail out. I'm running this from a directory that I have created that contains the list so that all results will go inside that folder:

Command: sudo python ../httpscreenshot.py --list list --headless

http://googlezr.com http://googlezs.com http://googlezt.com http://googlezu.com http://googlezv.com http://googlezw.com http://googlezx.com http://googlezy.com http://googlezz.com

Once the program says "Something has gone wrong with this URL" 5 times, the program errors out.

ghost avatar Jun 25 '18 15:06 ghost