pipx icon indicating copy to clipboard operation
pipx copied to clipboard

parallel execution of pipx

Open sigma67 opened this issue 2 years ago • 2 comments

Not sure if this is a bug or a feature request, I just wanted to note this here since I haven't seen a pertaining issue.

Describe the bug Executing pipx commands in parallel can result in unforeseen issues. I have noticed two main types of issues:

  1. pipx list fails if pipx install is ongoing due to missing metadata
  2. if shared libraries are outdated, any pipx command will trigger a shared libraries upgrade, which will cause concurrent commands to fail

How to reproduce

Scenario 1

import subprocess
from concurrent.futures import ThreadPoolExecutor
from typing import List

cmd = ["pipx", "list"]
cmd_list = [cmd] * 5 + ["pipx", "install", "pycowsay"]
with ThreadPoolExecutor() as executor:
    results: List[subprocess.CompletedProcess] = list(executor.map(subprocess.run, cmd_list))

print(results)

Scenario 2 as above, but remove the pipx install and ensure shared libraries are outdated, for example by running in a docker container with outdated libraries

Expected behavior Don't fail, but wait for the concurrent process to finish (debatable)

At the very least I'd expect pipx list not to fail with exit code 1 when a pipx install is ongoing

sigma67 avatar Sep 13 '23 14:09 sigma67

PR welcome. Today, parallel execution is just not supported.

gaborbernat avatar Dec 02 '23 17:12 gaborbernat