oppia icon indicating copy to clipboard operation
oppia copied to clipboard

E2E Flake (Docker): E2E user test failing in Docker Setup

Open jayam04 opened this issue 9 months ago • 2 comments

CI Test Type

E2E

Stacktrace

[0-0] Test name: Site language should show version details in the about page footer has video path /home/runner/work/oppia/webdriverio-video/jebrlo.mp4
[0-0] ffmpeg exited with code 255
[0-0] Error in "Site language should show version details in the about page footer"
Error: Expected false to be true.
    at <Jasmine>
    at UserContext.<anonymous> (/home/runner/work/oppia/oppia/core/tests/webdriverio_desktop/userJourneys.js:300:64)
    at Generator.next (<anonymous>)
    at fulfilled (/home/runner/work/oppia/oppia/core/tests/webdriverio_desktop/userJourneys.js:17:58)
    ✖ should show version details in the about page footer » [ unknown spec file ]
[0-0] FAILED in chrome - /core/tests/webdriverio_desktop/userJourneys.js

 "spec" Reporter:
------------------------------------------------------------------
Running: chrome (v102.0.5005.61) on LINUX
Session ID: eac62129383fcd03f6ce4257dff39cbb

» /core/tests/webdriverio_desktop/userJourneys.js
Basic user journeys
    Account creation
       ✓ should create users
       ✓ should create moderators
       ✓ should create admins

» unknown spec file
Site language
   ✓ should change after selecting a different language
   ✓ should use language selected in the Preferences page.
   ✓ should set preferred audio language selected in the Preferences page.
   ✓ should save the language selected in the footer into the preferences.
   ✓ should not change in an exploration
   ✓ should not change in exploration and collection player for guest users
   ✖ should show version details in the about page footer

9 passing (4m 56.8s)
1 failing

1) Site language should show version details in the about page footer
Expected false to be true.      
      actual expected
      
      falsetrue
      
Error: Expected false to be true.
    at <Jasmine>
    at UserContext.<anonymous> (/home/runner/work/oppia/oppia/core/tests/webdriverio_desktop/userJourneys.js:300:64)
    at Generator.next (<anonymous>)
    at fulfilled (/home/runner/work/oppia/oppia/core/tests/webdriverio_desktop/userJourneys.js:17:58)

Additional Information

This flake occurs in CI with Docker setup. Check #19962, where CI tests are run in Docker setup.

Occurrences

https://github.com/oppia/oppia/actions/runs/8865824065/job/24342523282?pr=19962

Debugging document link

No response

jayam04 avatar May 03 '24 15:05 jayam04

I believe this has to do with the docker CI not actually being in prod env as the footer version only actually shows up on prod environments and not dev. Might be the cause of other Docker flakes as well as I believe E2E tests were built with the prod env in mind.

jnvtnguyen avatar May 06 '24 01:05 jnvtnguyen

Yup, I have checked it yesterday. Currently there are issues with dev-server starting in prod environment, once do will commit changes. Thanks @jnvtnguyen for looking.

jayam04 avatar May 06 '24 01:05 jayam04