http-add-on icon indicating copy to clipboard operation
http-add-on copied to clipboard

End to end and stress tests

Open arschles opened this issue 2 years ago • 12 comments

We currently have mostly unit tests inside this repository, along with a few integration tests (like one for the interceptor coming in #206). I propose that we add more testing strategies to this project, including:

  • end to end: a test that installs the addon to a Kubernetes cluster along with KEDA and any other dependencies, installs an app and an HTTPScaledObject, and runs a quick suite of requests to trigger scale-from-zero, scale up, and scale back down to zero. this test should check that the app and the interceptor both scale properly, and that the external scaler, operator, and interceptor's admin endpoints all report the expected things (NOTE: KEDA does this, and there is a prototype of something similar in #206)
  • stress: a test that runs a large number of requests concurrently against an interceptor fleet, optionally for a large period of time. also possibly inspect internal admin endpoints along the way to ensure that metrics report as expected. the main purpose of this test is to ensure that, from the outside, requests get serviced as expected

arschles avatar Aug 23 '21 20:08 arschles

@ajanth97 are you interested in implementing either one of these at some point?

arschles avatar Aug 23 '21 20:08 arschles

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 7 days if no further activity occurs. Thank you for your contributions.

stale[bot] avatar Dec 07 '21 23:12 stale[bot]

@arschles sorry I just saw this. yeah will do when I get some time

ajanth97 avatar Dec 08 '21 05:12 ajanth97

sounds good @ajanth97 - thanks!

arschles avatar Dec 08 '21 20:12 arschles

I am currently working on this.

v-shenoy avatar Jun 27 '22 05:06 v-shenoy

e2e test are executed on every PR/Push https://github.com/kedacore/http-add-on/pull/564

JorTurFer avatar Jan 13 '23 15:01 JorTurFer

should we close this one if done?

HongboFei avatar Jan 14 '23 04:01 HongboFei

Stress tests are still pending, we could cose this and open another issue for stress test if we want to have it more accuracy tracked

JorTurFer avatar Jan 14 '23 09:01 JorTurFer

OK, thanks Jorge. That;s OK. We can keep it what it is.

HongboFei avatar Jan 22 '23 10:01 HongboFei

@MrsDaehin , may you be interested in help with this too? (after core load tests are ready, ofc) This is easier to test indeed because this is closer to an API (and here the load should be higher)

JorTurFer avatar Jul 12 '23 19:07 JorTurFer

we can discuss this. It will be easy once we got k6 running.

MrsDaehin avatar Jul 12 '23 20:07 MrsDaehin