aws-otel-test-framework
aws-otel-test-framework copied to clipboard
Issue with performance tests for metrics
If you try to run otlp_grpc_exporter_metric performance test:
terraform apply -var="data_rate=5000" -var="debug=true" -var="testcase=../testcases/otlp_grpc_exporter_metric_mock" -var="install_package_source=local" -var-file="../testcases/otlp_grpc_exporter_metric_mock/parameters.tfvar
It will give you:
{"testcase":"otlp_grpc_exporter_metric_mock","instanceType":"m5.2xlarge","receivers":["otlp"],"processors":["batch"],"exporters":["otlp"],"dataType":"otlp","dataMode":"metric","dataRate":5000,"avgCpu":0.03666620071652944,"avgMem":62.920635733333334,"maxCpu":0.19999619791228065,"maxMem":63.229952,"commitId":"dummy_commit","collectionPeriod":10,"testingAmi":"soaking_linux"}
Which is virtually no usage (numbers don't look correct)
I tried running load-generator and Opentelemetry Collector locally and load-generator doesn't seem to produce any data nor log anny errors:
./app/bin/load-generator metric -r=5000 -d=otlp -u=127.0.0.1:4317
Additionally, I made a sample Go app using otel sdk, which succesfully managed to send the grpc metrics to 127.0.0.1:4317, so the issues seems to be with the load generator.