Danny McClanahan

Results 64 comments of Danny McClanahan

As per #2210, `pip install --report --dry-run --ignore-installed` can be much faster than invoking pip directly due to several optimizations including the ability to avoid downloading any artifacts whatsoever (instead...

I'm also interested in adapting `uv` as an alternate resolver, although with the metadata caching improvements I have been waiting to get merged in pip I would be surprised if...

No, thanks so much! Will be playing around with pex3 for a bit now.........

I am confident that either of the methods you described above are a preferable solution for the use case I described. I will probably still be playing around with parallel...

Hmmmm: the particular parallelization/synchronization operations necessary for this make it seem like a good fit for pants, actually, especially since pants is much more able to control the build inputs...

> Since this would only be used by the Pex CLI (build-time), a rust implementation is actually how I'd approach this. This makes perfect sense, thanks! Totally hadn't considered this.

Created project at https://github.com/cosmicexplorer/medusa-zip, will update here if the prototype demonstrates any value.

The project has two features: crawling for files in parallel, and converting a crawl list into a zip in parallel. Given that pex currently expects to have all the `Chroot`'s...

Ok, so even just limiting the parallelism to reading source files + compressing their contents, we have produced quite a significant speedup. The current pex diff is at https://github.com/pantsbuild/pex/compare/main...cosmicexplorer:pex:medusa-zip?expand=1, and...

> I think maybe you missed copy mode symlink. That's why the chroot setup is fast today. Yes, but I was confused as to why it only checks for `self._copy_mode...