e2e-benchmarking icon indicating copy to clipboard operation
e2e-benchmarking copied to clipboard

add ingress-perf config template to be overwirte

Open qiliRedHat opened this issue 1 year ago • 6 comments

Type of change

  • [ ] Refactor
  • [ ] New feature
  • [ ] Bug fix
  • [x] Optimization
  • [ ] Documentation Update

Description

Customize the ingress-perf config file, for example for tuningPatch, use different ingress replica numbers, thread numbers.

Related Tickets & Documents

  • Related Issue # https://issues.redhat.com/browse/OCPQE-17275

  • [x] I have performed a self-review of my code.

  • [ ] If it is a core feature, I have added thorough tests.

Testing

  • Please describe the System Under Test.
  • Please provide detailed steps to perform tests related to this code change. example ENV_VARS: CONFIG_TEMPLATE=config/standard-template.yml TUNING_PATCH="'{"spec":{"nodePlacement": {"nodeSelector": {"matchLabels": {"node-role.kubernetes.io/infra": ""}}}, "replicas": 3}}'" CONNECTIONS=100 SAMPLES=1 DURATION=1m CONCURRENCY=10 SERVER_REPLICAS=40 REQUEST_TIMEOUT=20s DELAY=20s
  • How were the fix/results from this change verified? Please provide relevant screenshots or results.

qiliRedHat avatar Oct 11 '23 14:10 qiliRedHat

I want to do two changes for ‘tuningPatch’ for a same test config, e.g. oc -n openshift-ingress-operator patch ingresscontroller/default --type=merge -p '{"spec":{"tuningOptions": {"threadCount": 8}}}' oc -n openshift-ingress-operator patch ingresscontroller/default --type=merge -p '{"spec":{"nodePlacement": {"nodeSelector": {"matchLabels": {"node-role.kubernetes.io/infra": ""}}}, "replicas": 3}}' I failed to put them together in one ‘tuningPatch’ https://github.com/cloud-bulldozer/ingress-perf/blob/main/pkg/runner/tuning.go#L35

qiliRedHat avatar Oct 11 '23 14:10 qiliRedHat

@rsevilla87 PTAL, in some of the tests such as more ingress replicas, I hope to be able to customize the parameters in the configuration files and avoid adding new configuration files for each non-standard tests configurations.

qiliRedHat avatar Jan 15 '24 08:01 qiliRedHat

The change looks good technically, but I wonder, that if what you need new configurations, why don't you add more config files rather than templating the existing... We're trying to avoid this kind of templates as much as possible as they are difficult to track. Same applies to other tools

rsevilla87 avatar Feb 06 '24 11:02 rsevilla87

As an alternative, what do you think about adding new script custom-run.sh, rather than modifying run.sh. That way changes on run.sh won't be able to affect CPT in any way

rsevilla87 avatar Feb 06 '24 16:02 rsevilla87

The change looks good technically, but I wonder, that if what you need new configurations, why don't you add more config files rather than templating the existing... We're trying to avoid this kind of templates as much as possible as they are difficult to track. Same applies to other tools

@rsevilla87 Thanks for the comment, I'll consider to use new configurations. I can overwrite config as env var so no need to use custom-run.sh.

Please let me know if you have some suggestion for https://github.com/cloud-bulldozer/e2e-benchmarking/pull/634#issuecomment-1757794801

qiliRedHat avatar Feb 07 '24 10:02 qiliRedHat

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: qiliRedHat Once this PR has been reviewed and has the lgtm label, please assign rsevilla87 for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

openshift-ci[bot] avatar Jun 24 '24 02:06 openshift-ci[bot]