testcafe icon indicating copy to clipboard operation
testcafe copied to clipboard

Support the nativeAutomation mode for the BrowserStack browser provider

Open patrickathompson opened this issue 1 year ago • 13 comments

What is your Scenario?

When running latest version of TestCafe with nativeAutomation enabled and using browserstack remote browser provider, the following error occurs:

Error: The "browserstack" do not support the Native Automation mode. Remove the "native automation" option to continue.

What are you suggesting?

Add a configuration option to support this new mode, or release a new module that supports it.

What alternatives have you considered?

AWS DeviceFarm, Docker localhost headless

Additional context

I have created another issue here:

https://github.com/DevExpress/testcafe-browser-provider-browserstack/issues/199

I felt it was necessary to mention, however, since the code to throw the error and block native automation in browsertstack was added to testcafe and not the browser provider itself.

patrickathompson avatar May 22 '23 17:05 patrickathompson

Hello,

At present, TestCafe supports the Native Automation mode only for local Chromium-based browsers. Please refer to the following help topic to learn more about Native Automation mode limitations: https://testcafe.io/documentation/404237/guides/intermediate-guides/native-automation-mode#limitations.

AlexKamaev avatar May 23 '23 07:05 AlexKamaev

This is a new feature request. Are you saying that you are not going to support native automation in remote browsers moving forward? If you plan on supporting this feature then you should probably leave the issue open.

patrickathompson avatar May 23 '23 15:05 patrickathompson

Currently, we do not have plans to support remote browsers. We are fully focused on Chrome-based native automation mode. Our plans can change in the future. However, at present, there is no need to keep this issue opened.

AlexKamaev avatar May 24 '23 07:05 AlexKamaev

We discussed the issue with the team once again and decided to keep it open in order to track user interest.

AlexKamaev avatar May 24 '23 07:05 AlexKamaev

The lack of remote browser support further complicates the visual regression testing story in TestCafe. To test reliably, you need a 100% reproducible environment, both hardware and software (i.e. the Docker image). Right now, the options are managing your own browser pool or using a third-party browser pool, like Browserstack. Lack of the remote browser support makes the second option impossible. TestCafe users have to choose between improved test stability brought by the NA mode, supporting more infrastructure or forgoing the visual regression testing,

In addition to that, I had to switch from the "testcafe/testcafe" image to the "browserless/chrome" when migrating to 1.19 because of various issues in the default image DevExpress provides. These might have been fixed or not, but either way I'd have to re-arrange the test pipeline again.

Klaster1 avatar May 29 '23 07:05 Klaster1

any updates about planning to support remote browsers? we are using selenium grid for testcafe tests run , we have several issue related to proxy and using native automation would be really important to us

wombatka avatar Jun 30 '23 10:06 wombatka

We also need native automation for remote browsers, specifically Browserstack.

Dvoreth avatar Jun 30 '23 16:06 Dvoreth

@wombatka At present, we cannot give any precise estimates on when TestCafe will support any other browsers except Chromium-based.

AlexKamaev avatar Jul 03 '23 07:07 AlexKamaev

We also need native automation for remote browsers, specifically Browserstack.

vasilyevi avatar Nov 22 '23 15:11 vasilyevi

This issue has been automatically marked as stale because it has not had any activity for a long period. It will be closed and archived if no further activity occurs. However, we may return to this issue in the future. If it still affects you or you have any additional information regarding it, please leave a comment and we will keep it open.

github-actions[bot] avatar May 22 '24 01:05 github-actions[bot]

Any updates? Any actions will be taken? or there are still no plans at all to support native automation in remote browsers?

wombatka avatar May 28 '24 05:05 wombatka

We have not researched the issue yet, since we were focused on other tasks.

Bayheck avatar May 29 '24 11:05 Bayheck

Wanna second the request for remote browsers (we use Saucelabs instead of BrowserStack, but still).

apolonskiy avatar Jul 05 '24 12:07 apolonskiy