luigi icon indicating copy to clipboard operation
luigi copied to clipboard

Flacky backwards compatibility test

Open JohannesDoberer opened this issue 9 months ago • 1 comments

Logout and login again is failing sometimes if a pr get's merged. https://github.com/SAP/luigi/actions/runs/9062391595/job/24896282753

Log:

 Login Flow
    ✓ User name in profile dropdown (1499ms)
    ✓ Link in profile dropdown (2455ms)
    ✓ Change title and logo (1154ms)
    1) Logout and login again

  TopNavDropDown
    Desktop
      ✓ Clicking around drop down in TopNav (636ms)
    Mobile
      ✓ Should be able to select product (464ms)
      ✓ Should be able to close (475ms)


  6 passing (12s)
  1 failing

  1) Login Flow
       Logout and login again:
     AssertionError: Timed out retrying after 4000ms: expected '<body>' to contain 'Login to Luigi sample app'
      at Context.eval (webpack:///../e2e/tests/1-angular/login-flow-nav-dropdown.cy.js:81:19)




  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        7                                                                                │
  │ Passing:      6                                                                                │
  │ Failing:      1                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  1                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     12 seconds                                                                       │
  │ Spec Ran:     login-flow-nav-dropdown.cy.js                                                    │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Screenshots)

  -  /home/runner/work/luigi/luigi-compatibility-testing/test/e2e-test-application/cy     (1280x633)
     press/screenshots/login-flow-nav-dropdown.cy.js/Login Flow -- Logout and login a               
     gain (failed).png        
     

JohannesDoberer avatar May 14 '24 06:05 JohannesDoberer

Maybe a cache issue, because after deleting the cache it is green.

JohannesDoberer avatar May 14 '24 07:05 JohannesDoberer

Hey @JohannesDoberer, Should I wait continuing to commit till this project is resolved, since I thought about tackling a few more code intensive tasks and that could become complicated if one of the tests always fails on me? Obviously only if that is wanted

Best Regards

Johannes

Jotrorox avatar May 16 '24 08:05 Jotrorox

Hey @Jotrorox, You can still contribute to the Luigi project. It is not your fault. We will start investigating this issue soon. Also, if it fails again, I will just re-run the failed job (if it is this logout and login again test). So... no worries and feel free to contribute.

Cheers, Johannes

JohannesDoberer avatar May 16 '24 08:05 JohannesDoberer

It seems to not only be a thing with my commits as seen here: 53e757d, but that one plus my commits are the only times this seems to have occured.

Jotrorox avatar May 17 '24 14:05 Jotrorox