benchmark-runner

benchmark-runner copied to clipboard

This PR fix scale issue for vdbench and bootstorm workloads. 1. Add parallelism for: - create vm/pod - start vm/pod - delete vm/pod 2. Wrap every run by threads limit,...

ebattat

upgrade functional environment cluster to install OCP 4.12.0-rc.4

ebattat

remove coredns patch

3

Remove coredns patch because removing bufsize from /etc/coredns/Corefile

ebattat

Benchmark-runner: Add ability to run Prometheus queries and extract output into json format

1

**Is your feature request related to a problem? Please describe.** Yes, we want to have ability to run Prometheus queries directly through benchmark-runner **Describe the solution you'd like** We will...

ebattat

Add new workload outside of the benchmark-runner tree

4

**Is your feature request related to a problem? Please describe.** I would like to run a workload with the benchmark-runner framework without making any changes to the benchmark-runner tree or...

RobertKrawitz

It is presently not possible to run two instances of benchmark-runner concurrently. While it would not be appropriate to do that when running benchmarks, for development or testing purposes it...

RobertKrawitz

wait_for_pod_completed does not detect pod going into error state

1

If a pod goes into error state, wait_for_pod_completed does not detect that and hangs until timeout: ``` Method name: wait_for_initialized {'label': 'app=system-metrics-collector', 'workload': 'uperf-vm'} , Start time: 2021-12-09 09:19:22 Method...

RobertKrawitz

OpenShift support should be via `import openshift` or other existing Python package

1

There's an existing `openshift` package available on PyPi that provides OpenShift support. Reference https://github.com/RobertKrawitz/OpenShift4-tools/blob/7f38a73f61fde0d7dcf43de2814c0cf14a5199cd/experimental/prom-extract

RobertKrawitz

test_delete_sync_pod_timeout_error fails if delete succeeds very quickly

1

test_delete_sync_pod_timeout_error is consistently failing for me as follows: ```tests/integration/benchmark_runner/common/oc/test_oc.py::test_delete_sync_pod_timeout_error FAILED [100%] ============================================================================================================================= FAILURES ============================================================================================================================== ________________________________________________________________________________________________________________ test_delete_sync_pod_timeout_error _________________________________________________________________________________________________________________ def test_delete_sync_pod_timeout_error(): """ This method delete pod with timeout error :return: """ oc...

RobertKrawitz

benchmark-runner should support local persistent storage

2

benchmark-runner should support local persistent storage in addition to OCS and ephemeral storage.

RobertKrawitz