mqtt-io icon indicating copy to clipboard operation
mqtt-io copied to clipboard

Poetry fails to install dill with python >3.9 breaking github actions

Open linucks opened this issue 7 months ago • 0 comments

I submitted a PR where the CI action failed, but this appears to be unrelated to my code as it's present in the main branch.

If I check out a the main branch and set up a virtual environment and run the commands from the CI file as shown:

jmht-MacBook-Air% python3.10 --version
Python 3.10.16
jmht-MacBook-Air% python3.10 -m venv venv
jmht-MacBook-Air% . ./venv/bin/activate
(venv) jmht-MacBook-Air% pip install poetry
Collecting poetry
  Using cached poetry-2.1.1-py3-none-any.whl.metadata (7.1 kB)
Collecting build<2.0.0,>=1.2.1 (from poetry)
  Using cached build-1.2.2.post1-py3-none-any.whl.metadata (6.5 kB)
Collecting cachecontrol<0.15.0,>=0.14.0 (from cachecontrol[filecache]<0.15.0,>=0.14.0->poetry)
  Using cached cachecontrol-0.14.2-py3-none-any.whl.metadata (3.1 kB)
Collecting cleo<3.0.0,>=2.1.0 (from poetry)
  Using cached cleo-2.1.0-py3-none-any.whl.metadata (12 kB)
Collecting dulwich<0.23.0,>=0.22.6 (from poetry)
  Using cached dulwich-0.22.8-cp310-cp310-macosx_11_0_arm64.whl.metadata (4.9 kB)
Collecting fastjsonschema<3.0.0,>=2.18.0 (from poetry)
  Using cached fastjsonschema-2.21.1-py3-none-any.whl.metadata (2.2 kB)
Collecting findpython<0.7.0,>=0.6.2 (from poetry)
  Using cached findpython-0.6.3-py3-none-any.whl.metadata (5.3 kB)
Collecting installer<0.8.0,>=0.7.0 (from poetry)
  Using cached installer-0.7.0-py3-none-any.whl.metadata (936 bytes)
Collecting keyring<26.0.0,>=25.1.0 (from poetry)
  Using cached keyring-25.6.0-py3-none-any.whl.metadata (20 kB)
Collecting packaging>=24.0 (from poetry)
  Using cached packaging-24.2-py3-none-any.whl.metadata (3.2 kB)
Collecting pbs-installer<2026.0.0,>=2025.1.6 (from pbs-installer[download,install]<2026.0.0,>=2025.1.6->poetry)
  Using cached pbs_installer-2025.3.17-py3-none-any.whl.metadata (991 bytes)
Collecting pkginfo<2.0,>=1.12 (from poetry)
  Using cached pkginfo-1.12.1.2-py3-none-any.whl.metadata (13 kB)
Collecting platformdirs<5,>=3.0.0 (from poetry)
  Using cached platformdirs-4.3.7-py3-none-any.whl.metadata (11 kB)
Collecting poetry-core==2.1.1 (from poetry)
  Using cached poetry_core-2.1.1-py3-none-any.whl.metadata (3.5 kB)
Collecting pyproject-hooks<2.0.0,>=1.0.0 (from poetry)
  Using cached pyproject_hooks-1.2.0-py3-none-any.whl.metadata (1.3 kB)
Collecting requests<3.0,>=2.26 (from poetry)
  Using cached requests-2.32.3-py3-none-any.whl.metadata (4.6 kB)
Collecting requests-toolbelt<2.0.0,>=1.0.0 (from poetry)
  Using cached requests_toolbelt-1.0.0-py2.py3-none-any.whl.metadata (14 kB)
Collecting shellingham<2.0,>=1.5 (from poetry)
  Using cached shellingham-1.5.4-py2.py3-none-any.whl.metadata (3.5 kB)
Collecting tomli<3.0.0,>=2.0.1 (from poetry)
  Using cached tomli-2.2.1-py3-none-any.whl.metadata (10 kB)
Collecting tomlkit<1.0.0,>=0.11.4 (from poetry)
  Using cached tomlkit-0.13.2-py3-none-any.whl.metadata (2.7 kB)
Collecting trove-classifiers>=2022.5.19 (from poetry)
  Using cached trove_classifiers-2025.3.19.19-py3-none-any.whl.metadata (2.3 kB)
Collecting virtualenv<21.0.0,>=20.26.6 (from poetry)
  Using cached virtualenv-20.29.3-py3-none-any.whl.metadata (4.5 kB)
Collecting xattr<2.0.0,>=1.0.0 (from poetry)
  Using cached xattr-1.1.4-cp310-cp310-macosx_11_0_arm64.whl.metadata (3.8 kB)
Collecting msgpack<2.0.0,>=0.5.2 (from cachecontrol<0.15.0,>=0.14.0->cachecontrol[filecache]<0.15.0,>=0.14.0->poetry)
  Using cached msgpack-1.1.0-cp310-cp310-macosx_11_0_arm64.whl.metadata (8.4 kB)
Collecting filelock>=3.8.0 (from cachecontrol[filecache]<0.15.0,>=0.14.0->poetry)
  Using cached filelock-3.18.0-py3-none-any.whl.metadata (2.9 kB)
Collecting crashtest<0.5.0,>=0.4.1 (from cleo<3.0.0,>=2.1.0->poetry)
  Using cached crashtest-0.4.1-py3-none-any.whl.metadata (1.1 kB)
Collecting rapidfuzz<4.0.0,>=3.0.0 (from cleo<3.0.0,>=2.1.0->poetry)
  Using cached rapidfuzz-3.12.2-cp310-cp310-macosx_11_0_arm64.whl.metadata (12 kB)
Collecting urllib3>=1.25 (from dulwich<0.23.0,>=0.22.6->poetry)
  Using cached urllib3-2.3.0-py3-none-any.whl.metadata (6.5 kB)
Collecting importlib_metadata>=4.11.4 (from keyring<26.0.0,>=25.1.0->poetry)
  Using cached importlib_metadata-8.6.1-py3-none-any.whl.metadata (4.7 kB)
Collecting jaraco.classes (from keyring<26.0.0,>=25.1.0->poetry)
  Using cached jaraco.classes-3.4.0-py3-none-any.whl.metadata (2.6 kB)
Collecting jaraco.functools (from keyring<26.0.0,>=25.1.0->poetry)
  Using cached jaraco.functools-4.1.0-py3-none-any.whl.metadata (2.9 kB)
Collecting jaraco.context (from keyring<26.0.0,>=25.1.0->poetry)
  Using cached jaraco.context-6.0.1-py3-none-any.whl.metadata (4.1 kB)
Collecting httpx<1,>=0.27.0 (from pbs-installer[download,install]<2026.0.0,>=2025.1.6->poetry)
  Using cached httpx-0.28.1-py3-none-any.whl.metadata (7.1 kB)
Collecting zstandard>=0.21.0 (from pbs-installer[download,install]<2026.0.0,>=2025.1.6->poetry)
  Using cached zstandard-0.23.0-cp310-cp310-macosx_11_0_arm64.whl.metadata (3.0 kB)
Collecting charset-normalizer<4,>=2 (from requests<3.0,>=2.26->poetry)
  Using cached charset_normalizer-3.4.1-cp310-cp310-macosx_10_9_universal2.whl.metadata (35 kB)
Collecting idna<4,>=2.5 (from requests<3.0,>=2.26->poetry)
  Using cached idna-3.10-py3-none-any.whl.metadata (10 kB)
Collecting certifi>=2017.4.17 (from requests<3.0,>=2.26->poetry)
  Using cached certifi-2025.1.31-py3-none-any.whl.metadata (2.5 kB)
Collecting distlib<1,>=0.3.7 (from virtualenv<21.0.0,>=20.26.6->poetry)
  Using cached distlib-0.3.9-py2.py3-none-any.whl.metadata (5.2 kB)
Collecting cffi>=1.16.0 (from xattr<2.0.0,>=1.0.0->poetry)
  Using cached cffi-1.17.1-cp310-cp310-macosx_11_0_arm64.whl.metadata (1.5 kB)
Collecting pycparser (from cffi>=1.16.0->xattr<2.0.0,>=1.0.0->poetry)
  Using cached pycparser-2.22-py3-none-any.whl.metadata (943 bytes)
Collecting anyio (from httpx<1,>=0.27.0->pbs-installer[download,install]<2026.0.0,>=2025.1.6->poetry)
  Using cached anyio-4.9.0-py3-none-any.whl.metadata (4.7 kB)
Collecting httpcore==1.* (from httpx<1,>=0.27.0->pbs-installer[download,install]<2026.0.0,>=2025.1.6->poetry)
  Using cached httpcore-1.0.7-py3-none-any.whl.metadata (21 kB)
Collecting h11<0.15,>=0.13 (from httpcore==1.*->httpx<1,>=0.27.0->pbs-installer[download,install]<2026.0.0,>=2025.1.6->poetry)
  Using cached h11-0.14.0-py3-none-any.whl.metadata (8.2 kB)
Collecting zipp>=3.20 (from importlib_metadata>=4.11.4->keyring<26.0.0,>=25.1.0->poetry)
  Using cached zipp-3.21.0-py3-none-any.whl.metadata (3.7 kB)
Collecting more-itertools (from jaraco.classes->keyring<26.0.0,>=25.1.0->poetry)
  Using cached more_itertools-10.6.0-py3-none-any.whl.metadata (37 kB)
Collecting backports.tarfile (from jaraco.context->keyring<26.0.0,>=25.1.0->poetry)
  Using cached backports.tarfile-1.2.0-py3-none-any.whl.metadata (2.0 kB)
Collecting exceptiongroup>=1.0.2 (from anyio->httpx<1,>=0.27.0->pbs-installer[download,install]<2026.0.0,>=2025.1.6->poetry)
  Using cached exceptiongroup-1.2.2-py3-none-any.whl.metadata (6.6 kB)
Collecting sniffio>=1.1 (from anyio->httpx<1,>=0.27.0->pbs-installer[download,install]<2026.0.0,>=2025.1.6->poetry)
  Using cached sniffio-1.3.1-py3-none-any.whl.metadata (3.9 kB)
Collecting typing_extensions>=4.5 (from anyio->httpx<1,>=0.27.0->pbs-installer[download,install]<2026.0.0,>=2025.1.6->poetry)
  Using cached typing_extensions-4.12.2-py3-none-any.whl.metadata (3.0 kB)
Using cached poetry-2.1.1-py3-none-any.whl (277 kB)
Using cached poetry_core-2.1.1-py3-none-any.whl (331 kB)
Using cached build-1.2.2.post1-py3-none-any.whl (22 kB)
Using cached cachecontrol-0.14.2-py3-none-any.whl (21 kB)
Using cached cleo-2.1.0-py3-none-any.whl (78 kB)
Using cached dulwich-0.22.8-cp310-cp310-macosx_11_0_arm64.whl (925 kB)
Using cached fastjsonschema-2.21.1-py3-none-any.whl (23 kB)
Using cached findpython-0.6.3-py3-none-any.whl (20 kB)
Using cached installer-0.7.0-py3-none-any.whl (453 kB)
Using cached keyring-25.6.0-py3-none-any.whl (39 kB)
Using cached packaging-24.2-py3-none-any.whl (65 kB)
Using cached pbs_installer-2025.3.17-py3-none-any.whl (53 kB)
Using cached pkginfo-1.12.1.2-py3-none-any.whl (32 kB)
Using cached platformdirs-4.3.7-py3-none-any.whl (18 kB)
Using cached pyproject_hooks-1.2.0-py3-none-any.whl (10 kB)
Using cached requests-2.32.3-py3-none-any.whl (64 kB)
Using cached requests_toolbelt-1.0.0-py2.py3-none-any.whl (54 kB)
Using cached shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB)
Using cached tomli-2.2.1-py3-none-any.whl (14 kB)
Using cached tomlkit-0.13.2-py3-none-any.whl (37 kB)
Using cached trove_classifiers-2025.3.19.19-py3-none-any.whl (13 kB)
Using cached virtualenv-20.29.3-py3-none-any.whl (4.3 MB)
Using cached xattr-1.1.4-cp310-cp310-macosx_11_0_arm64.whl (19 kB)
Using cached certifi-2025.1.31-py3-none-any.whl (166 kB)
Using cached cffi-1.17.1-cp310-cp310-macosx_11_0_arm64.whl (178 kB)
Using cached charset_normalizer-3.4.1-cp310-cp310-macosx_10_9_universal2.whl (198 kB)
Using cached crashtest-0.4.1-py3-none-any.whl (7.6 kB)
Using cached distlib-0.3.9-py2.py3-none-any.whl (468 kB)
Using cached filelock-3.18.0-py3-none-any.whl (16 kB)
Using cached httpx-0.28.1-py3-none-any.whl (73 kB)
Using cached httpcore-1.0.7-py3-none-any.whl (78 kB)
Using cached idna-3.10-py3-none-any.whl (70 kB)
Using cached importlib_metadata-8.6.1-py3-none-any.whl (26 kB)
Using cached msgpack-1.1.0-cp310-cp310-macosx_11_0_arm64.whl (81 kB)
Using cached rapidfuzz-3.12.2-cp310-cp310-macosx_11_0_arm64.whl (1.4 MB)
Using cached urllib3-2.3.0-py3-none-any.whl (128 kB)
Using cached zstandard-0.23.0-cp310-cp310-macosx_11_0_arm64.whl (633 kB)
Using cached jaraco.classes-3.4.0-py3-none-any.whl (6.8 kB)
Using cached jaraco.context-6.0.1-py3-none-any.whl (6.8 kB)
Using cached jaraco.functools-4.1.0-py3-none-any.whl (10 kB)
Using cached zipp-3.21.0-py3-none-any.whl (9.6 kB)
Using cached anyio-4.9.0-py3-none-any.whl (100 kB)
Using cached backports.tarfile-1.2.0-py3-none-any.whl (30 kB)
Using cached more_itertools-10.6.0-py3-none-any.whl (63 kB)
Using cached pycparser-2.22-py3-none-any.whl (117 kB)
Using cached exceptiongroup-1.2.2-py3-none-any.whl (16 kB)
Using cached h11-0.14.0-py3-none-any.whl (58 kB)
Using cached sniffio-1.3.1-py3-none-any.whl (10 kB)
Using cached typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Installing collected packages: trove-classifiers, fastjsonschema, distlib, zstandard, zipp, urllib3, typing_extensions, tomlkit, tomli, sniffio, shellingham, rapidfuzz, pyproject-hooks, pycparser, poetry-core, platformdirs, pkginfo, pbs-installer, packaging, msgpack, more-itertools, installer, idna, h11, filelock, exceptiongroup, crashtest, charset-normalizer, certifi, backports.tarfile, virtualenv, requests, jaraco.functools, jaraco.context, jaraco.classes, importlib_metadata, httpcore, findpython, dulwich, cleo, cffi, build, anyio, xattr, requests-toolbelt, keyring, httpx, cachecontrol, poetry
Successfully installed anyio-4.9.0 backports.tarfile-1.2.0 build-1.2.2.post1 cachecontrol-0.14.2 certifi-2025.1.31 cffi-1.17.1 charset-normalizer-3.4.1 cleo-2.1.0 crashtest-0.4.1 distlib-0.3.9 dulwich-0.22.8 exceptiongroup-1.2.2 fastjsonschema-2.21.1 filelock-3.18.0 findpython-0.6.3 h11-0.14.0 httpcore-1.0.7 httpx-0.28.1 idna-3.10 importlib_metadata-8.6.1 installer-0.7.0 jaraco.classes-3.4.0 jaraco.context-6.0.1 jaraco.functools-4.1.0 keyring-25.6.0 more-itertools-10.6.0 msgpack-1.1.0 packaging-24.2 pbs-installer-2025.3.17 pkginfo-1.12.1.2 platformdirs-4.3.7 poetry-2.1.1 poetry-core-2.1.1 pycparser-2.22 pyproject-hooks-1.2.0 rapidfuzz-3.12.2 requests-2.32.3 requests-toolbelt-1.0.0 shellingham-1.5.4 sniffio-1.3.1 tomli-2.2.1 tomlkit-0.13.2 trove-classifiers-2025.3.19.19 typing_extensions-4.12.2 urllib3-2.3.0 virtualenv-20.29.3 xattr-1.1.4 zipp-3.21.0 zstandard-0.23.0

[notice] A new release of pip is available: 24.3.1 -> 25.0.1
[notice] To update, run: pip install --upgrade pip
(venv) jmht-MacBook-Air% poetry install
The "poetry.dev-dependencies" section is deprecated and will be removed in a future version. Use "poetry.group.dev.dependencies" instead.
Updating dependencies
Resolving dependencies... (0.9s)

Package operations: 51 installs, 1 update, 0 removals

  - Installing markupsafe (3.0.2)
  - Installing alabaster (0.7.16)
  - Installing babel (2.17.0)
  - Installing docutils (0.18.1)
  - Installing imagesize (1.4.1)
  - Installing jinja2 (3.1.6)
  - Installing parse (1.20.2)
  - Installing pygments (2.19.1)
  - Updating setuptools (75.6.0 -> 78.0.1)
  - Installing six (1.17.0)
  - Installing smmap (5.0.2)
  - Installing snowballstemmer (2.2.0)
  - Installing sphinxcontrib-applehelp (2.0.0)
  - Installing sphinxcontrib-devhelp (2.0.0)
  - Installing sphinxcontrib-htmlhelp (2.1.0)
  - Installing sphinxcontrib-jsmath (1.0.1)
  - Installing sphinxcontrib-qthelp (2.0.0)
  - Installing sphinxcontrib-serializinghtml (2.0.0)
  - Installing astroid (3.3.9)
  - Installing attrs (25.3.0)
  - Installing cerberus (1.3.7)
  - Installing commonmark (0.9.1)
  - Installing fpyutils (4.0.1)
  - Installing gitdb (4.0.12)
  - Installing iniconfig (2.1.0)
  - Installing isort (6.0.1)
  - Installing lxml (4.9.4)
  - Installing mccabe (0.7.0)
  - Installing mypy-extensions (1.0.0)
  - Installing paho-mqtt (2.1.0)
  - Installing parse-type (0.6.4)
  - Installing py (1.11.0)
  - Installing pluggy (1.5.0)
  - Installing pyyaml (6.0.2)
  - Installing sphinx (3.5.3)
  - Installing toml (0.10.2)
  - Installing unidecode (1.3.8)
  - Installing aiomqtt (2.3.0)
  - Installing ast-to-xml (0.2.4)
  - Installing backoff (2.2.1)
  - Installing behave (1.2.6)
  - Installing confp (0.4.1)
  - Installing coverage (5.5)
  - Installing gitpython (3.1.44)
  - Installing md-toc (8.2.3)
  - Installing mypy (1.15.0)
  - Installing pylint (3.3.6)
  - Installing pytest (6.2.5)
  - Installing recommonmark (0.7.1)
  - Installing semver (2.13.0)
  - Installing sphinx-autoapi (1.9.0)
  - Installing tox (3.28.0)

Writing lock file

Installing the current project: mqtt-io (2.6.0)
(venv) jmht-MacBook-Air% poetry run pylint -d fixme mqtt_io
The "poetry.dev-dependencies" section is deprecated and will be removed in a future version. Use "poetry.group.dev.dependencies" instead.
Traceback (most recent call last):
  File "/opt/mqtt-io-flyte/venv/bin/pylint", line 8, in <module>
    sys.exit(run_pylint())
  File "/opt/mqtt-io-flyte/venv/lib/python3.10/site-packages/pylint/__init__.py", line 31, in run_pylint
    from pylint.lint import Run as PylintRun
  File "/opt/mqtt-io-flyte/venv/lib/python3.10/site-packages/pylint/lint/__init__.py", line 22, in <module>
    from pylint.lint.parallel import check_parallel
  File "/opt/mqtt-io-flyte/venv/lib/python3.10/site-packages/pylint/lint/parallel.py", line 12, in <module>
    import dill
ModuleNotFoundError: No module named 'dill'

pylint fails, as for some reason dill hasn't been installed.

linucks avatar Mar 24 '25 19:03 linucks