cibuildwheel icon indicating copy to clipboard operation
cibuildwheel copied to clipboard

chore(ci): speed-up tests

Open mayeut opened this issue 1 year ago • 4 comments

mayeut avatar Feb 03 '24 09:02 mayeut

Maybe we should just get os.cpu_count() or len(os.sched_getaffinity(0)) as a default & override where it needs to be overriden ? (probably only TravisCI)

mayeut avatar Feb 03 '24 09:02 mayeut

Last time when I try this it crashed because some collision in pip install using pip cache. Maybe the current timeout maybe also connected with this.

Czaki avatar Feb 10 '24 11:02 Czaki

Last time when I try this it crashed because some collision in pip install using pip cache. Maybe the current timeout maybe also connected with this.

This was investigated in https://github.com/pypa/cibuildwheel/issues/1254, I think we worked around this in https://github.com/pypa/cibuildwheel/pull/1301 , so shouldn't be an issue any more.

joerick avatar Feb 18 '24 18:02 joerick

Not huge speedups, but it looks reasonable. Any particular reason to hard-code the concurrency on travis/azure rather than letting os.cpu_count() do it?

joerick avatar Feb 18 '24 18:02 joerick

Let's merge this for the speedups, then revisit if we can use a smarter method to get the num threads.

henryiii avatar Feb 29 '24 21:02 henryiii