openfe icon indicating copy to clipboard operation
openfe copied to clipboard

Trying to speed up CI a little bit

Open IAlibay opened this issue 9 months ago • 6 comments
trafficstars

My small laptop can't run tests because they take too long :(

Developers certificate of origin

IAlibay avatar Feb 14 '25 19:02 IAlibay

Time to beat is 24 mins.

IAlibay avatar Feb 14 '25 19:02 IAlibay

Codecov Report

:x: Patch coverage is 95.23810% with 2 lines in your changes missing coverage. Please review. :white_check_mark: Project coverage is 92.52%. Comparing base (e369a20) to head (4137d16). :warning: Report is 270 commits behind head on main.

Files with missing lines Patch % Lines
openfe/tests/protocols/conftest.py 92.59% 2 Missing :warning:
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1131      +/-   ##
==========================================
- Coverage   94.66%   92.52%   -2.14%     
==========================================
  Files         143      143              
  Lines       11012    11030      +18     
==========================================
- Hits        10425    10206     -219     
- Misses        587      824     +237     
Flag Coverage Δ
fast-tests 92.52% <95.23%> (?)
slow-tests ?

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:
  • :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

codecov[bot] avatar Feb 14 '25 20:02 codecov[bot]

Time to beat is 24 mins.

Now it's roughly 15 mins, so ~ 40% improvement. Still plenty more that could be done, but for the tests I need to run faster this is a win.

IAlibay avatar Feb 14 '25 20:02 IAlibay

let's discuss this at today's meeting

IAlibay avatar Feb 17 '25 08:02 IAlibay

Decision from today's call: @atravitz and @mikemhenry will work on improving dispatched AWS runners and we'll use this to test the workflow where we manually dispatch long jobs & work through a PR.

IAlibay avatar Feb 19 '25 16:02 IAlibay

No API break detected ✅

github-actions[bot] avatar Oct 13 '25 13:10 github-actions[bot]