browse_website using Selenium Chromium opens the url `data:,` then gets stuck

[PeterSR]

Duplicates

• [X] I have searched the existing issues

Steps to reproduce 🕹

My environment:

• OS: Ubuntu
• Python: 3.8
• Browsers installed: Firefox, Chromium
• Memory type: PineconeMemory
• Not using GPT-4

Run with prompt / ai settings (see below).

• AI first performs google search which runs fine. Then it tries to browse a website:
• Next action: NEXT ACTION: COMMAND = browse_website ARGUMENTS = {'url': 'https://www.amazon.com/Keychron-Wireless-Mechanical-Hot-Swappable-Programmable/dp/B0BHZ524M8', 'question': 'reviews'}
• Chromium window opens (via Selenium) and the url is data:,
• Then nothing happens.

Tested on both stable (60b2b61b52c263dba25a6c33623561273e890229, v0.2.0) and master (6a93537c426759708f0e91a125587512c05f354c)

Current behavior 😯

• Chromium window opens (via Selenium) and the url is data:,
• Then nothing happens.

Expected behavior 🤔

• Chromium window opens with the intended url
• Some kind of browsing or extraction of the page content
• Further actions

Your prompt 📝

ai_goals:
- Search the web and find good options for a QMK / VIA mechanical keyboard PCB that
  has a wireless bluetooth module. The form factor should be 60%, 75% or 80%
ai_name: A helpful assistant
ai_role: an AI designed to help me solve various tasks

[PeterSR]

Running in debug mode gives the following extra information:

  System: Command browse_website returned: Error: Message: unknown error: DevToolsActivePort file doesn't exist
Stacktrace:
#0 0x55bca6875fe3 <unknown>
#1 0x55bca65b4d36 <unknown>
#2 0x55bca65e1459 <unknown>

I know that I have recently been using the dev tools in that browser, but I am not sure how that could affect anything.

Edit: It could be that this message only shows up after I closed the Chromium window after concluding that nothing would happen.

[PeterSR]

It seems to be a Selenium or ChromeDriver issue. Perhaps an issue with Chromium version or something. But the question is: Can we allow users to change the driver to Firefox / Gecko? Or use a fallback approach?

[sixtay]

Can confirm I am getting the same issue.

NEXT ACTION: COMMAND = browse_website ARGUMENTS = {'url': 'https://www.cityscapeqatar.com/en-gb/news-and-media/industry-news/property-management-trends-to-look-out-for-in-2019.html', 'question': 'What are some of the trends that are shaping the property management sector, both globally and locally?'} SYSTEM: Command browse_website returned: Error: Message: unknown error: DevToolsActivePort file doesn't exist Stacktrace: #0 0x55bbc579bfe3 <unknown> #1 0x55bbc54dad36 <unknown> #2 0x55bbc5507459 <unknown> #3 0x55bbc5503051 <unknown> #4 0x55bbc54ffa9b <unknown> #5 0x55bbc5541af7 <unknown> #6 0x55bbc554111f <unknown> #7 0x55bbc5538693 <unknown> #8 0x55bbc550b03a <unknown> #9 0x55bbc550c17e <unknown> #10 0x55bbc575ddbd <unknown> #11 0x55bbc5761c6c <unknown> #12 0x55bbc576b4b0 <unknown> #13 0x55bbc5762d63 <unknown> #14 0x55bbc5735c35 <unknown> #15 0x55bbc5786138 <unknown> #16 0x55bbc57862c7 <unknown> #17 0x55bbc5794093 <unknown> #18 0x7f6d65c6a609 start_thread

Edit: I got it working by adding the following options to selenium here https://github.com/Torantulino/Auto-GPT/blob/4bb7a598a502b9f9642bda63eb1c44c4663e5bff/autogpt/web.py#L37

options.add_argument("--no-sandbox")
options.add_argument("--disable-dev-shm-usage")
options.add_argument("--remote-debugging-port=9222")

[mustfit09]

I also have the same problem and the environment is the same as him:

• OS: Ubuntu
• Python: 3.8
• Browsers installed: Chromium

[Pwuts]

Closing as resolved in #1473