dd-trace-py icon indicating copy to clipboard operation
dd-trace-py copied to clipboard

chore(ci): parallelize profile tests

Open taegyunkim opened this issue 1 year ago • 3 comments

Checklist

  • [ ] The PR description includes an overview of the change
  • [ ] The PR description articulates the motivation for the change
  • [ ] The change includes tests OR the PR description describes a testing strategy
  • [ ] The PR description notes risks associated with the change, if any
  • [ ] Newly-added code is easy to change
  • [ ] The change follows the library release note guidelines
  • [ ] The change includes or references documentation updates if necessary
  • [ ] Backport labels are set (if applicable)

Reviewer Checklist

  • [ ] Title is accurate
  • [ ] All changes are related to the pull request's stated goal
  • [ ] Avoids breaking API changes
  • [ ] Testing strategy adequately addresses listed risks
  • [ ] Newly-added code is easy to change
  • [ ] Release note makes sense to a user of the library
  • [ ] If necessary, author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
  • [ ] Backport labels are set in a manner that is consistent with the release branch maintenance policy

taegyunkim avatar Jul 04 '24 01:07 taegyunkim

  • #9712 Graphite 👈
  • main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @taegyunkim and the rest of your teammates on Graphite Graphite

taegyunkim avatar Jul 04 '24 01:07 taegyunkim

Datadog Report

Branch report: taegyunkim/pytest-xdist Commit report: 04b87ed Test service: dd-trace-py

:x: 258 Failed (38 Known Flaky), 166160 Passed, 1195 Skipped, 9h 53m 35.6s Total duration (32m 9.53s time saved)

:x: Failed Tests (258)

This report shows up to 5 failed tests.

  • test_template_decorator - test_aiohttp_jinja2.py - Details

    Expand for error
    annot unpack non-iterable async_generator object
    
  • test_template_decorator - test_aiohttp_jinja2.py - Details

    Expand for error
    annot unpack non-iterable async_generator object
    
  • test_template_decorator - test_aiohttp_jinja2.py - Details

    Expand for error
    annot unpack non-iterable async_generator object
    
  • test_template_error - test_aiohttp_jinja2.py - Details

    Expand for error
    annot unpack non-iterable async_generator object
    
  • test_template_error - test_aiohttp_jinja2.py - Details

    Expand for error
    annot unpack non-iterable async_generator object
    

Benchmarks

Benchmark execution time: 2024-09-10 20:41:14

Comparing candidate commit d632feda8f53b006b6ae1b89fc6640408517839b in PR branch taegyunkim/pytest-xdist with baseline commit 0cf67580b170e0fec7b00b1959f3a10df19fcf24 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 353 metrics, 47 unstable metrics.

pr-commenter[bot] avatar Jul 04 '24 02:07 pr-commenter[bot]

CODEOWNERS have been resolved as:

.riot/requirements/100ae3c.txt                                          @DataDog/apm-python
.riot/requirements/1151222.txt                                          @DataDog/apm-python
.riot/requirements/12f3878.txt                                          @DataDog/apm-python
.riot/requirements/14af757.txt                                          @DataDog/apm-python
.riot/requirements/17b19f7.txt                                          @DataDog/apm-python
.riot/requirements/19d6194.txt                                          @DataDog/apm-python
.riot/requirements/1a63c5d.txt                                          @DataDog/apm-python
.riot/requirements/1bd5d47.txt                                          @DataDog/apm-python
.riot/requirements/1e0a659.txt                                          @DataDog/apm-python
.riot/requirements/1e2507e.txt                                          @DataDog/apm-python
.riot/requirements/21e021c.txt                                          @DataDog/apm-python
.riot/requirements/68d56fb.txt                                          @DataDog/apm-python
.riot/requirements/7fb555f.txt                                          @DataDog/apm-python
.riot/requirements/800c4ca.txt                                          @DataDog/apm-python
.riot/requirements/93a288a.txt                                          @DataDog/apm-python
.riot/requirements/a0249ad.txt                                          @DataDog/apm-python
.riot/requirements/f961c1f.txt                                          @DataDog/apm-python
.riot/requirements/1ae24f1.txt                                          @DataDog/apm-python
.riot/requirements/2be0986.txt                                          @DataDog/apm-python
.riot/requirements/c54cef3.txt                                          @DataDog/apm-python
riotfile.py                                                             @DataDog/apm-python
tests/profiling/collector/test_threading.py                             @DataDog/profiling-python
tests/profiling/conftest.py                                             @DataDog/profiling-python
tests/profiling/exporter/test_http.py                                   @DataDog/profiling-python
.riot/requirements/10f0ea3.txt                                          @DataDog/apm-python
.riot/requirements/1292e83.txt                                          @DataDog/apm-python
.riot/requirements/1fff854.txt                                          @DataDog/apm-python

github-actions[bot] avatar Sep 10 '24 19:09 github-actions[bot]