bbot
bbot copied to clipboard
Find out why 3.12 tests are slow
For python 3.9, 3.10, and 3.11, the tests take ~25 minutes. But for 3.12, they take 40. The tests still pass, they just take almost twice as long. I've done an in-depth diagnosis of the logs, and there isn't much difference between them except certain lines in 3.12 just take much longer to execute.
For example, in 3.9, the time gap between these lines is 45 seconds:
2024-03-24T03:05:14.4592251Z bbot/test/test_step_1/test__module__tests.py::test__module__tests PASSED [ 0%]
2024-03-24T03:05:59.6787821Z bbot/test/test_step_1/test_agent.py::test_agent
And in 3.12, the same two lines are 104 seconds apart -- more than twice the duration.
2024-03-24T03:05:11.3349011Z bbot/test/test_step_1/test__module__tests.py::test__module__tests PASSED [ 0%]
2024-03-24T03:06:55.8822560Z bbot/test/test_step_1/test_agent.py::test_agent
wtf?
This might have something to do with this: https://github.com/python/cpython/issues/107674.