visualization-tool icon indicating copy to clipboard operation
visualization-tool copied to clipboard
verified publisher icon visualize-admin

add CI regression test for all the GraphQL queries

Open Rdataflow opened this issue 2 years ago • 3 comments

Is your enhancement related to a problem? Please describe. Currently broken query functions are not detected due to missing CI regression tests on them.

Describe the solution you'd like CI regression tests detecting any broken query functionality.

Describe alternatives you've considered more manual tests :upside_down_face:

Usecases and impact see broken query function like #1274

Rdataflow avatar Nov 21 '23 07:11 Rdataflow

@bprusinowski I guess this is covered to a certain degree with the k6 tests, right?

Rdataflow avatar May 03 '24 14:05 Rdataflow

Thanks for adding the issue Thomas, we could definitely do that. One thing I see that could be a challenge would be the fact that some cubes are changing from time to time, and we already see that with current end to end tests where we have to periodically update the tests since cubes have evolved.

  • Do you think it would be a good idea / feasible to have some tests cube where the data does not change ?

While writing this, I figured that we could use the cube versioning to only query a particular version so that we are confident that values will not change.

ptbrowne avatar May 03 '24 15:05 ptbrowne

yes, it would be the best solution I can imagine to pin a version of a cube :+1:

Rdataflow avatar May 03 '24 16:05 Rdataflow