tools icon indicating copy to clipboard operation
tools copied to clipboard

Speed up pytest with parallelization

Open mashehu opened this issue 2 years ago • 3 comments

Description of feature

pytest-xdist should do the job (just need to add -n auto). Tested it locally and throws errors because of git errors due to parallel actions (because we use the same git repo for the moduoles cache for test_modules, test_subworkflow, test_components.

One option would be be with --dist=loadgroup and grouping the different git operations together with @pytest.mark.xdist_group(name="group1")

mashehu avatar Jun 18 '23 10:06 mashehu

Do we want to work on that if we're going towards nf-test?

maxulysse avatar Jul 04 '23 16:07 maxulysse

this is for the pytest for the nf-core/tools python code 🙂

mashehu avatar Jul 04 '23 16:07 mashehu

:homer:

maxulysse avatar Jul 04 '23 16:07 maxulysse

is this completed or is there something missing? can we close the issue?

mirpedrol avatar Mar 13 '25 09:03 mirpedrol

related to #2685

mashehu avatar Mar 13 '25 09:03 mashehu