asv icon indicating copy to clipboard operation
asv copied to clipboard

[CI] PyPy tests are slow again

Open HaoZeke opened this issue 7 months ago • 0 comments

On PyPy, test_run.py::test_run_spec is significantly slower than the other tests. Here are the times for the top 5 tests on each run:

ubuntu-latest, pypy-3.11

146.00s call     test/test_run.py::test_run_spec
58.15s call     test/test_continuous.py::test_continuous
45.38s call     test/test_run.py::test_set_commit_hash
44.01s call     test/test_run.py::test_env_matrix_value
32.66s call     test/test_run.py::test_return_code

ubuntu-latest, 3.8

72.77s call     test/test_run.py::test_run_spec
60.80s call     test/test_find.py::test_find
47.45s call     test/test_workflow.py::test_run_publish
30.69s call     test/test_continuous.py::test_continuous
26.77s call     test/test_run.py::test_parallel

ubuntu-latest, 3.12

78.76s call     test/test_run.py::test_run_spec
62.91s call     test/test_find.py::test_find
32.17s call     test/test_continuous.py::test_continuous
28.23s call     test/test_run.py::test_parallel
25.39s call     test/test_run.py::test_env_matrix_value

macos-13, pypy-3.11

265.83s call     test/test_run.py::test_run_spec
132.88s call     test/test_continuous.py::test_continuous
96.61s call     test/test_run.py::test_env_matrix_value
90.89s call     test/test_run.py::test_set_commit_hash
73.53s call     test/test_profile.py::test_profile_python_commit

macos-13, 3.8

138.64s call     test/test_workflow.py::test_run_publish
113.98s call     test/test_run.py::test_run_spec
91.93s call     test/test_find.py::test_find
77.43s call     test/test_run.py::test_parallel
60.98s call     test/test_continuous.py::test_continuous

macos-13, 3.12

137.96s call     test/test_find.py::test_find
136.74s call     test/test_run.py::test_run_spec
82.01s call     test/test_continuous.py::test_continuous
55.19s call     test/test_run.py::test_parallel
49.24s call     test/test_run.py::test_env_matrix_value

Originally posted by @mattip in https://github.com/airspeed-velocity/asv/issues/1512#issuecomment-3178137988

HaoZeke avatar Sep 12 '25 20:09 HaoZeke