grunt-saucelabs icon indicating copy to clipboard operation
grunt-saucelabs copied to clipboard

Test timeout

Open jondeandres opened this issue 10 years ago • 8 comments

Hi,

I'm experiencing some problems with different versions of this library. With version 4.1.2 seems to work properly, although I think there are some random problems getting test status.

With 5.x.x, 6.x.x, 7.x.x and 8.x.x it seems the test hangs after run it. I have multiple urls, but it hangs after finish the first one. If I change to only url it also hangs and the end resulting in a timeout. The test is really success as I can see in the sauce labs video.

Any idea of this?

jondeandres avatar Jun 10 '15 12:06 jondeandres

Ah. I think you need to add the test-reporting code to your test page. https://github.com/axemclion/grunt-saucelabs#exposing-test-results-to-the-sauce-labs-api

Jonahss avatar Jun 10 '15 18:06 Jonahss

I also have this problem. The tests complete successfully and are viewable on the saucelabs url, but the result is never received.

This causes travis-ci to timeout and error on builds (Example: https://travis-ci.org/tejacques/crosstab/builds/74841929)

tejacques avatar Aug 11 '15 01:08 tejacques

Actually it looks like this is encountering an error but failing silently -- one of the test OS/Browser combinations looks to be no longer supported by saucelabs. So the real problem is it's just not displaying that to me.

tejacques avatar Aug 11 '15 01:08 tejacques

That's an even better error! Think you'd be able to detect that error and have grunt-saucelabs fail the test?

On Mon, Aug 10, 2015 at 6:23 PM, Tom Jacques [email protected] wrote:

Actually it looks like this is encountering an error but failing silently -- one of the test OS/Browser combinations looks to be no longer supported by saucelabs. So the real problem is it's just not displaying that to me.

— Reply to this email directly or view it on GitHub https://github.com/axemclion/grunt-saucelabs/issues/192#issuecomment-129663268 .

Jonahss avatar Aug 11 '15 18:08 Jonahss

I'll open a separate issue for what I encountered since it'll be easier to track and fix that way.

tejacques avatar Aug 11 '15 18:08 tejacques

I'm using grunt-saucelabs 8.6.2. Here's an example of a reported timeout that actually passed on saucelabs:

Tested http://127.0.0.1:3000/test/runner.html
Platform: ,safari,5
Passed: true
Url https://saucelabs.com/jobs/9a817dd09f6c45e894ba90f8dca8185d
=> Stopping Tunnel to Sauce Labs
>> Error: After trying 90 times with a delay of 2000s, this job never reached 'complete' status.
>>     at /Users/jpillora/Code/JavaScript/xdomain/test/node_modules/grunt-saucelabs/src/Job.js:157:21

(Grunt test timeout 90 times with a delay of 2000[m]s -> 180s)

https://saucelabs.com/tests/9a817dd09f6c45e894ba90f8dca8185d (Duration: 20s)

Note, I have the test-reporting code in my tests.

jpillora avatar Jan 24 '16 01:01 jpillora

versions in the range ^9.0.0 are also experiencing this issue.

JakeChampion avatar Aug 08 '16 16:08 JakeChampion

@jpillora how did you end up resolving this? Was it just a transient issue?

alexweissman avatar Oct 23 '17 20:10 alexweissman