conduit
conduit copied to clipboard
Performance benchmarks: Better configuration
Feature description
Currently, we're using bash scripts to configure a Docker container (in which Conduit will be running) and also to create test pipelines. There are two implications of this:
- The configuration for a single test is split into two files (run-workload.sh which runs a Docker container, and workload scripts which create pipelines)
- Workload scripts are pretty verbose (cURL calls)
Once we're done with pipeline config files, we can easily configure a whole performance test with a single YML file (one part of it would configure the test instance, another would the pipeline YML config).
Depends on:
- https://github.com/ConduitIO/conduit/issues/32
This issue might be a requirement before we do automated benchmarks. At this point, it is not important.