explosion
support parallel builds with `setup.py build -j10`
When I try to do a parallel build with setup.py build -j10 I still only get one gcc process being run at a time, which means that the build takes a while longer than I would like. It would be great to have support for parallel builds so they take less time.
I would really appreciate a PR to improve this, sure.
One thing that's really awkward at the moment is that we invoke the compiler separately in a bunch of subprocesses. This is super slow. I don't know how to avoid it though, given the way the jsonl build log works. Open to suggestions.
Better yet, allow passing this option via environment variable, so that I could do:
env MAKELAGS="-j" poetry install that installs my project, which installs scapy, which installs blis which then uses as many cores as are available, like make does.
Context: this is a notable issue for any musl-based distro, like alpine, where today there can be no wheels on pypi.org