web
web copied to clipboard
[QA] run e2e tests with external idp (keycloak) in CI
Description
e2e tests can run with keycloak as an idp (Done in https://github.com/owncloud/web/issues/9904). So now, we want to have e2e tests running with keycloak setup in CI.
Motivation
Previously, we found bugs related to ocis with external idp like this one https://github.com/owncloud/ocis/pull/8074. Issues related to ocis with external idp are not possible to find out as early as possible. And only can be found when playing around manually.
Since we have e2e tests that can run with keycloak idp, bugs like that can be found early if we have automated tests running in CI.
NOTE: currently, there are no docs on running tests with keycloak. But here are the available envs: https://github.com/owncloud/web/blob/71cbae47a518c0d0b2bf446fce7fb6bc3ee4813c/tests/e2e/config.js#L9-L14
Open Tasks
- [x] Filter out e2e test suites to run with keycloak (We may want to run only the few selected scenarios)
- Ref: https://github.com/owncloud/web/pull/9518
- [x] Bring e2e-with-keycloak to Drone CI
- run
nightly
and withfull-ci
only
- run
CC @ScharfViktor
Todo
- [ ] keycloak user storage for e2e test @nabim777 https://github.com/owncloud/web/pull/10895
- [ ] document how to run tests
- [ ] e2e tests related to admin setting(role assign fails intermittently locally and hard failure in CI) @amrita-shrestha
@PrajwolAmatya and @saw-jan i need some basic info how do we run test and keycloak before
I used to run as follow:
### on oCIS repo
goto: deployments/examples/ocis_keycloak
run: docker compose up
### first login to
https://keycloak.owncloud.test
### then login to
https://ocis.owncloud.test
run e2e test:
BASE_URL_OCIS=ocis.owncloud.test KEYCLOAK=ture pnpm run test:e2e:cucumber tests/e2e/cucumber/features/smoke/copyMove.feature:6
@PrajwolAmatya and @saw-jan i need some basic info how do we run test and keycloak before
currently, we do not have any docs related to that. but here are the available envs:
https://github.com/owncloud/web/blob/71cbae47a518c0d0b2bf446fce7fb6bc3ee4813c/tests/e2e/config.js#L9-L14
@PrajwolAmatya and @saw-jan i need some basic info how do we run test and keycloak before
currently, we do not have any docs related to that. but here are the available envs:
https://github.com/owncloud/web/blob/71cbae47a518c0d0b2bf446fce7fb6bc3ee4813c/tests/e2e/config.js#L9-L14
i have already seen that I just want to know if we already had docs of setup for testing it against the local setup but nevermind i will look over it
All tasks are completed, so closing this issue.