conduit icon indicating copy to clipboard operation
conduit copied to clipboard

Performance benchmarks: Better configuration

Open hariso opened this issue 2 years ago • 1 comments

Feature description

Currently, we're using bash scripts to configure a Docker container (in which Conduit will be running) and also to create test pipelines. There are two implications of this:

  1. The configuration for a single test is split into two files (run-workload.sh which runs a Docker container, and workload scripts which create pipelines)
  2. Workload scripts are pretty verbose (cURL calls)

Once we're done with pipeline config files, we can easily configure a whole performance test with a single YML file (one part of it would configure the test instance, another would the pipeline YML config).

Depends on:

  • https://github.com/ConduitIO/conduit/issues/32

hariso avatar Aug 01 '22 10:08 hariso

This issue might be a requirement before we do automated benchmarks. At this point, it is not important.

uchennakevinm1 avatar Aug 01 '22 16:08 uchennakevinm1