bbot icon indicating copy to clipboard operation
bbot copied to clipboard

Find out why 3.12 tests are slow

Open TheTechromancer opened this issue 1 year ago • 1 comments

For python 3.9, 3.10, and 3.11, the tests take ~25 minutes. But for 3.12, they take 40. The tests still pass, they just take almost twice as long. I've done an in-depth diagnosis of the logs, and there isn't much difference between them except certain lines in 3.12 just take much longer to execute.

For example, in 3.9, the time gap between these lines is 45 seconds:

2024-03-24T03:05:14.4592251Z bbot/test/test_step_1/test__module__tests.py::test__module__tests PASSED [  0%]
2024-03-24T03:05:59.6787821Z bbot/test/test_step_1/test_agent.py::test_agent 

And in 3.12, the same two lines are 104 seconds apart -- more than twice the duration.

2024-03-24T03:05:11.3349011Z bbot/test/test_step_1/test__module__tests.py::test__module__tests PASSED [  0%]
2024-03-24T03:06:55.8822560Z bbot/test/test_step_1/test_agent.py::test_agent 

wtf?

TheTechromancer avatar Mar 21 '24 08:03 TheTechromancer

This might have something to do with this: https://github.com/python/cpython/issues/107674.

TheTechromancer avatar Mar 25 '24 03:03 TheTechromancer