web icon indicating copy to clipboard operation
web copied to clipboard

[QA] run e2e tests with external idp (keycloak) in CI

Open saw-jan opened this issue 1 year ago • 4 comments

Description

e2e tests can run with keycloak as an idp (Done in https://github.com/owncloud/web/issues/9904). So now, we want to have e2e tests running with keycloak setup in CI.

Motivation

Previously, we found bugs related to ocis with external idp like this one https://github.com/owncloud/ocis/pull/8074. Issues related to ocis with external idp are not possible to find out as early as possible. And only can be found when playing around manually.

Since we have e2e tests that can run with keycloak idp, bugs like that can be found early if we have automated tests running in CI.

NOTE: currently, there are no docs on running tests with keycloak. But here are the available envs: https://github.com/owncloud/web/blob/71cbae47a518c0d0b2bf446fce7fb6bc3ee4813c/tests/e2e/config.js#L9-L14

Open Tasks

  • [x] Filter out e2e test suites to run with keycloak (We may want to run only the few selected scenarios)
    • Ref: https://github.com/owncloud/web/pull/9518
  • [x] Bring e2e-with-keycloak to Drone CI
    • run nightly and with full-ci only

CC @ScharfViktor

Todo

  • [ ] keycloak user storage for e2e test @nabim777 https://github.com/owncloud/web/pull/10895
  • [ ] document how to run tests
  • [ ] e2e tests related to admin setting(role assign fails intermittently locally and hard failure in CI) @amrita-shrestha

saw-jan avatar Feb 09 '24 06:02 saw-jan

@PrajwolAmatya and @saw-jan i need some basic info how do we run test and keycloak before

amrita-shrestha avatar Feb 14 '24 08:02 amrita-shrestha

I used to run as follow:

### on oCIS repo
goto: deployments/examples/ocis_keycloak
run: docker compose up

### first login to
https://keycloak.owncloud.test

### then login to
https://ocis.owncloud.test
run e2e test:
BASE_URL_OCIS=ocis.owncloud.test KEYCLOAK=ture pnpm run test:e2e:cucumber tests/e2e/cucumber/features/smoke/copyMove.feature:6

PrajwolAmatya avatar Feb 14 '24 08:02 PrajwolAmatya

@PrajwolAmatya and @saw-jan i need some basic info how do we run test and keycloak before

currently, we do not have any docs related to that. but here are the available envs:

https://github.com/owncloud/web/blob/71cbae47a518c0d0b2bf446fce7fb6bc3ee4813c/tests/e2e/config.js#L9-L14

saw-jan avatar Feb 14 '24 08:02 saw-jan

@PrajwolAmatya and @saw-jan i need some basic info how do we run test and keycloak before

currently, we do not have any docs related to that. but here are the available envs:

https://github.com/owncloud/web/blob/71cbae47a518c0d0b2bf446fce7fb6bc3ee4813c/tests/e2e/config.js#L9-L14

i have already seen that I just want to know if we already had docs of setup for testing it against the local setup but nevermind i will look over it

amrita-shrestha avatar Feb 14 '24 09:02 amrita-shrestha

All tasks are completed, so closing this issue.

nabim777 avatar Jun 20 '24 08:06 nabim777