unknown error: DevToolsActivePort file doesn't exist

[El-Idiota]

Is there an existing issue for this?

• [X] I have searched the existing issues

I'm submitting a ...

• [X] bug report
• [ ] feature request
• [ ] support request --> Contact me over mail for support https://github.com/MShawon

Description

Hello sir,

First thank you for the high quality of your project 👍

the script work normally, and as you can see in the config, i plan to open 100 chrome (max_threads =100) but stuck around ~70

=> Check error message :

https://ibb.co/ZXMkCw6

03-Aug-2022 15:00:54] | 51.3% | Worker xxx | Line : 643 | WebDriverException | unknown error: Chrome failed to start: exited abnormally. (unknown error: DevToolsActivePort file doesn't exist) (The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)

=> Test made on dedicated server : `* AMD EPYC 7401P

• 2x SSD U.2 NVMe 960 GB Datacenter
• 4x RAM 32768 MB DDR4 ECC reg.
• NIC 1 Gbit Intel I350`

=> Resource usage (YouTube script is running) :

https://ibb.co/SNHSgYV

=>df output (YouTube script is running):

• Filesystem 1K-blocks Used Available Use% Mounted on
• udev 65904436 0 65904436 0% /dev
• tmpfs 13188780 1432 13187348 1% /run
• /dev/md2 916527368 16130804 853764424 2% /
• tmpfs 65943896 0 65943896 0% /dev/shm
• tmpfs 5120 0 5120 0% /run/lock
• tmpfs 65943896 0 65943896 0% /sys/fs/cgroup
• /dev/md1 1012428 183684 776420 20% /boot
• tmpfs 13188776 0 13188776 0% /run/user/1000
• tmpfs 13188776 0 13188776 0% /run/user/0

=> tmp content (YouTube script is running): https://ibb.co/B26yrtf

Thanks.

Environment

- OS : Ubuntu 20.04 
- Python : 3.8.10
- Script version : Last (1.7.4)

config.json

{
    "http_api": {
        "enabled": true,
        "host": "0.0.0.0",
        "port": 12000
    },
    "database": true,
    "views": 1000,
    "minimum": 90.0,
    "maximum": 100.0,
    "proxy": {
        "category": "p",
        "proxy_type": "http",
        "filename": "1.txt",
        "authentication": false,
        "proxy_api": false,
        "refresh": 0.0
    },
    "background": false,
    "bandwidth": true,
    "playback_speed": 1,
    "max_threads": 100,
    "min_threads": 90
}

[golimer]

same here

[MShawon]

how do you know it's opening 70 chrome? I mean you're literally seeing 70 chrome playing ur video through GUI?

[El-Idiota]

how do you know it's opening 70 chrome? I mean you're literally seeing 70 chrome playing ur video through GUI?

Yeah, through GUI tested with video length => 1 hour thanks

[El-Idiota]

Now testing with different videos length and same result https://ibb.co/xjThPty

[MShawon]

you don't see this error all the time, right?

WebDriverException | unknown error: Chrome failed to start: exited abnormally. (unknown error: DevToolsActivePort file doesn't exist) (The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)

can you post some screenshot of the terminal where it says Video Found : {VIDEO_TITLE} | Watch Duration : {TIME}

[El-Idiota]

Here you go https://ibb.co/ZBn1gwq

The error start after opening 20 to 30 chrome driver and not stop

[MShawon]

that's really odd.. it can open 100 chrome without any problem.. can you try it on windows or another machine?

[El-Idiota]

can't, only have 7 days linux server for test. maybe server side limitation ? and need tweaking thanks