dd-trace-rb icon indicating copy to clipboard operation
dd-trace-rb copied to clipboard

Add parametric system-tests workflow

Open vpellan opened this issue 8 months ago • 1 comments

What does this PR do?

This PR adds a GitHub workflow for parametrics system-tests

Motivation:

The SCA Env Var system-tests is run as a parametric test, and I wanted to test it on the CI.

Additional Notes:

The FORCE_TESTS env var does not work as the -F option on system-tests only work for the DEFAULT scenario right now. There are currently 4 tests that needs to be fixed:

  • [ ] tests/parametric/test_dynamic_configuration.py::TestDynamicConfigSamplingRules::test_trace_sampling_rules_with_tags
  • [ ] tests/parametric/test_otel_span_methods.py::Test_Otel_Span_Methods::test_otel_span_started_with_link_from_datadog_headers
  • [ ] tests/parametric/test_otel_span_methods.py::Test_Otel_Span_Methods::test_otel_span_started_with_link_from_w3c_headers
  • [ ] tests/parametric/test_otel_span_methods.py::Test_Otel_Span_Methods::test_otel_span_started_with_link_from_other_spans

vpellan avatar Jun 10 '24 13:06 vpellan