vaex icon indicating copy to clipboard operation
vaex copied to clipboard
verified publisher icon vaexio

[BUG-REPORT] install error for vaex on python=3.10 in vaex-core with vaexfast.cpp

Open root-11 opened this issue 3 years ago • 7 comments

Thank you for reaching out and helping us improve Vaex!

Before you submit a new Issue, please read through the documentation. Also, make sure you search through the Open and Closed Issues - your problem may already be discussed or addressed.

Description Please provide a clear and concise description of the problem. This should contain all the steps needed to reproduce the problem. A minimal code example that exposes the problem is very appreciated.

Software information

  • Vaex version (import vaex; vaex.__version__):

not available - install error

  • Vaex was installed via: pip / conda-forge / from source

pip

  • OS:
windows OS Name	Microsoft Windows 10 Enterprise
Version	10.0.19044 Build 19044

Additional information Please state any supplementary information or provide additional context for the problem (e.g. screenshots, data, etc..).

To replicate:

using python 3.10 & cmd.exe

python -m venv c:\Data\venv\github-pages
c:\Data\venv\github-pages\Scripts\activate.bat
(github-pages) C:\Data\venv>pip install jupyter vaex==4.8.0

Traceback:

(github-pages) C:\Data\venv>pip install jupyter vaex==4.8.0 
Collecting jupyter
  Using cached jupyter-1.0.0-py2.py3-none-any.whl (2.7 kB)
Collecting vaex==4.8.0
  Using cached vaex-4.8.0-py3-none-any.whl (4.7 kB)
Collecting vaex-server<0.9,>=0.8.1
  Using cached vaex_server-0.8.1-py3-none-any.whl (23 kB)
Collecting vaex-core<4.9,>=4.8.0
  Using cached vaex-core-4.8.0.tar.gz (2.2 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
    Preparing wheel metadata ... done
Collecting vaex-ml<0.18,>=0.17.0
  Using cached vaex_ml-0.17.0-py3-none-any.whl (56 kB)
Collecting vaex-viz<0.6,>=0.5.1
  Using cached vaex_viz-0.5.1-py3-none-any.whl (19 kB)
Collecting vaex-hdf5<0.13,>=0.12.0
  Using cached vaex_hdf5-0.12.0-py3-none-any.whl (16 kB)
Collecting vaex-astro<0.10,>=0.9.0
  Using cached vaex_astro-0.9.0-py3-none-any.whl (20 kB)
Collecting vaex-jupyter<0.8,>=0.7.0
  Using cached vaex_jupyter-0.7.0-py3-none-any.whl (43 kB)
Collecting notebook
  Using cached notebook-6.4.8-py3-none-any.whl (9.9 MB)
Collecting qtconsole
  Using cached qtconsole-5.2.2-py3-none-any.whl (120 kB)
Collecting ipywidgets
  Using cached ipywidgets-7.6.5-py2.py3-none-any.whl (121 kB)
Collecting jupyter-console
  Using cached jupyter_console-6.4.0-py3-none-any.whl (22 kB)
Collecting ipykernel
  Using cached ipykernel-6.9.1-py3-none-any.whl (128 kB)
Collecting nbconvert
  Using cached nbconvert-6.4.2-py3-none-any.whl (558 kB)
Collecting astropy
  Using cached astropy-5.0.1-cp310-cp310-win_amd64.whl (6.4 MB)
Collecting pyarrow>=3.0
  Using cached pyarrow-7.0.0-cp310-cp310-win_amd64.whl (16.1 MB)
Collecting rich
  Using cached rich-11.2.0-py3-none-any.whl (217 kB)
Collecting progressbar2
  Using cached progressbar2-4.0.0-py2.py3-none-any.whl (26 kB)
Collecting future>=0.15.2
  Using cached future-0.18.2.tar.gz (829 kB)
Collecting frozendict!=2.2.0
  Using cached frozendict-2.3.0-cp310-cp310-win_amd64.whl (34 kB)
Collecting pandas
  Using cached pandas-1.4.1-cp310-cp310-win_amd64.whl (10.6 MB)
Collecting filelock
  Using cached filelock-3.6.0-py3-none-any.whl (10.0 kB)
Collecting requests
  Using cached requests-2.27.1-py2.py3-none-any.whl (63 kB)
Collecting dask
  Using cached dask-2022.2.1-py3-none-any.whl (1.1 MB)
Collecting nest-asyncio>=1.3.3
  Using cached nest_asyncio-1.5.4-py3-none-any.whl (5.1 kB)
Collecting blake3
  Using cached blake3-0.3.1-cp310-none-win_amd64.whl (193 kB)
Collecting tabulate>=0.8.3
  Using cached tabulate-0.8.9-py3-none-any.whl (25 kB)
Collecting aplus
  Using cached aplus-0.11.0.tar.gz (3.7 kB)
Collecting numpy>=1.16
  Using cached numpy-1.22.2-cp310-cp310-win_amd64.whl (14.7 MB)
Collecting pydantic>=1.8.0
  Using cached pydantic-1.9.0-cp310-cp310-win_amd64.whl (2.1 MB)
Collecting six
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting cloudpickle
  Using cached cloudpickle-2.0.0-py3-none-any.whl (25 kB)
Collecting pyyaml
  Using cached PyYAML-6.0-cp310-cp310-win_amd64.whl (151 kB)
Collecting typing-extensions>=3.7.4.3
  Using cached typing_extensions-4.1.1-py3-none-any.whl (26 kB)
Collecting h5py>=2.9
  Using cached h5py-3.6.0-cp310-cp310-win_amd64.whl (2.8 MB)
Collecting xarray
  Using cached xarray-0.21.1-py3-none-any.whl (865 kB)
Collecting bqplot>=0.10.1
  Using cached bqplot-0.12.33-py2.py3-none-any.whl (1.2 MB)
Collecting ipyvolume>=0.4
  Using cached ipyvolume-0.5.2-py2.py3-none-any.whl (2.9 MB)
Collecting ipyleaflet
  Using cached ipyleaflet-0.15.0-py2.py3-none-any.whl (3.3 MB)
Collecting ipympl
  Using cached ipympl-0.8.8-py2.py3-none-any.whl (507 kB)
Collecting ipyvuetify<2,>=1.2.2
  Using cached ipyvuetify-1.8.2-1-py2.py3-none-any.whl (11.7 MB)
Collecting traitlets>=4.3.0
  Using cached traitlets-5.1.1-py3-none-any.whl (102 kB)
Collecting traittypes>=0.0.6
  Using cached traittypes-0.2.1-py2.py3-none-any.whl (8.6 kB)
Collecting ipywebrtc
  Using cached ipywebrtc-0.6.0-py2.py3-none-any.whl (260 kB)
Collecting Pillow
  Using cached Pillow-9.0.1-cp310-cp310-win_amd64.whl (3.2 MB)
Collecting pythreejs>=1.0.0
  Using cached pythreejs-2.3.0-py2.py3-none-any.whl (3.4 MB)
Collecting ipyvue<2,>=1.5
  Using cached ipyvue-1.7.0-py2.py3-none-any.whl (2.7 MB)
Collecting jupyterlab-widgets>=1.0.0
  Using cached jupyterlab_widgets-1.0.2-py3-none-any.whl (243 kB)
Collecting ipython>=4.0.0
  Using cached ipython-8.1.0-py3-none-any.whl (750 kB)
Collecting nbformat>=4.2.0
  Using cached nbformat-5.1.3-py3-none-any.whl (178 kB)
Collecting ipython-genutils~=0.2.0
  Using cached ipython_genutils-0.2.0-py2.py3-none-any.whl (26 kB)
Collecting widgetsnbextension~=3.5.0
  Using cached widgetsnbextension-3.5.2-py2.py3-none-any.whl (1.6 MB)
Collecting debugpy<2.0,>=1.0.0
  Using cached debugpy-1.5.1-cp310-cp310-win_amd64.whl (4.4 MB)
Collecting jupyter-client<8.0
  Using cached jupyter_client-7.1.2-py3-none-any.whl (130 kB)
Collecting matplotlib-inline<0.2.0,>=0.1.0
  Using cached matplotlib_inline-0.1.3-py3-none-any.whl (8.2 kB)
Collecting tornado<7.0,>=4.2
  Using cached tornado-6.1.tar.gz (497 kB)
Collecting stack-data
  Using cached stack_data-0.2.0-py3-none-any.whl (21 kB)
Collecting prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0
  Using cached prompt_toolkit-3.0.28-py3-none-any.whl (380 kB)
Collecting backcall
  Using cached backcall-0.2.0-py2.py3-none-any.whl (11 kB)
Requirement already satisfied: setuptools>=18.5 in c:\data\venv\github-pages\lib\site-packages (from ipython>=4.0.0->ipywidgets->jupyter) (58.1.0)
Collecting pygments>=2.4.0
  Using cached Pygments-2.11.2-py3-none-any.whl (1.1 MB)
Collecting colorama
  Using cached colorama-0.4.4-py2.py3-none-any.whl (16 kB)
Collecting pickleshare
  Using cached pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB)
Collecting jedi>=0.16
  Using cached jedi-0.18.1-py2.py3-none-any.whl (1.6 MB)
Collecting decorator
  Using cached decorator-5.1.1-py3-none-any.whl (9.1 kB)
Collecting parso<0.9.0,>=0.8.0
  Using cached parso-0.8.3-py2.py3-none-any.whl (100 kB)
Collecting jupyter-core>=4.6.0
  Using cached jupyter_core-4.9.2-py3-none-any.whl (86 kB)
Collecting python-dateutil>=2.1
  Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting entrypoints
  Using cached entrypoints-0.4-py3-none-any.whl (5.3 kB)
Collecting pyzmq>=13
  Using cached pyzmq-22.3.0-cp310-cp310-win_amd64.whl (1.1 MB)
Collecting pywin32>=1.0
  Using cached pywin32-303-cp310-cp310-win_amd64.whl (9.2 MB)
Collecting jsonschema!=2.5.0,>=2.4
  Using cached jsonschema-4.4.0-py3-none-any.whl (72 kB)
Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0
  Using cached pyrsistent-0.18.1-cp310-cp310-win_amd64.whl (61 kB)
Collecting attrs>=17.4.0
  Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pytz>=2020.1
  Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB)
Collecting wcwidth
  Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting ipydatawidgets>=1.1.1
  Using cached ipydatawidgets-4.2.0-py2.py3-none-any.whl (275 kB)
Collecting numba
  Using cached numba-0.55.1-cp310-cp310-win_amd64.whl (2.4 MB)
Collecting jinja2
  Using cached Jinja2-3.0.3-py3-none-any.whl (133 kB)
Collecting cachetools
  Using cached cachetools-5.0.0-py3-none-any.whl (9.1 kB)
Collecting fastapi
  Using cached fastapi-0.74.1-py3-none-any.whl (53 kB)
Collecting uvicorn[standard]
  Using cached uvicorn-0.17.5-py3-none-any.whl (53 kB)
Collecting matplotlib>=1.3.1
  Using cached matplotlib-3.5.1-cp310-cp310-win_amd64.whl (7.2 MB)
Collecting kiwisolver>=1.0.1
  Using cached kiwisolver-1.3.2-cp310-cp310-win_amd64.whl (52 kB)
Collecting pyparsing>=2.2.1
  Using cached pyparsing-3.0.7-py3-none-any.whl (98 kB)
Collecting fonttools>=4.22.0
  Using cached fonttools-4.29.1-py3-none-any.whl (895 kB)
Collecting cycler>=0.10
  Using cached cycler-0.11.0-py3-none-any.whl (6.4 kB)
Collecting packaging>=20.0
  Using cached packaging-21.3-py3-none-any.whl (40 kB)
Collecting Send2Trash>=1.8.0
  Using cached Send2Trash-1.8.0-py3-none-any.whl (18 kB)
Collecting argon2-cffi
  Using cached argon2_cffi-21.3.0-py3-none-any.whl (14 kB)
Collecting prometheus-client
  Using cached prometheus_client-0.13.1-py3-none-any.whl (57 kB)
Collecting terminado>=0.8.3
  Using cached terminado-0.13.1-py3-none-any.whl (14 kB)
Collecting pywinpty>=1.1.0
  Using cached pywinpty-2.0.2-cp310-none-win_amd64.whl (1.4 MB)
Collecting argon2-cffi-bindings
  Using cached argon2_cffi_bindings-21.2.0-cp36-abi3-win_amd64.whl (30 kB)
Collecting cffi>=1.0.1
  Using cached cffi-1.15.0-cp310-cp310-win_amd64.whl (180 kB)
Collecting pycparser
  Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting pyerfa>=2.0
  Using cached pyerfa-2.0.0.1-cp310-cp310-win_amd64.whl (366 kB)
Collecting toolz>=0.8.2
  Using cached toolz-0.11.2-py3-none-any.whl (55 kB)
Collecting partd>=0.3.10
  Using cached partd-1.2.0-py3-none-any.whl (19 kB)
Collecting fsspec>=0.6.0
  Using cached fsspec-2022.2.0-py3-none-any.whl (134 kB)
Collecting locket
  Using cached locket-0.2.1-py2.py3-none-any.whl (4.1 kB)
Collecting starlette==0.17.1
  Using cached starlette-0.17.1-py3-none-any.whl (58 kB)
Collecting anyio<4,>=3.0.0
  Using cached anyio-3.5.0-py3-none-any.whl (79 kB)
Collecting sniffio>=1.1
  Using cached sniffio-1.2.0-py3-none-any.whl (10 kB)
Collecting idna>=2.8
  Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting xyzservices>=2021.8.1
  Using cached xyzservices-2022.2.0-py3-none-any.whl (35 kB)
Collecting MarkupSafe>=2.0
  Using cached MarkupSafe-2.1.0-cp310-cp310-win_amd64.whl (16 kB)
Collecting testpath
  Using cached testpath-0.6.0-py3-none-any.whl (83 kB)
Collecting pandocfilters>=1.4.1
  Using cached pandocfilters-1.5.0-py2.py3-none-any.whl (8.7 kB)
Collecting nbclient<0.6.0,>=0.5.0
  Using cached nbclient-0.5.11-py3-none-any.whl (71 kB)
Collecting defusedxml
  Using cached defusedxml-0.7.1-py2.py3-none-any.whl (25 kB)
Collecting mistune<2,>=0.8.1
  Using cached mistune-0.8.4-py2.py3-none-any.whl (16 kB)
Collecting bleach
  Using cached bleach-4.1.0-py2.py3-none-any.whl (157 kB)
Collecting jupyterlab-pygments
  Using cached jupyterlab_pygments-0.1.2-py2.py3-none-any.whl (4.6 kB)
Collecting webencodings
  Using cached webencodings-0.5.1-py2.py3-none-any.whl (11 kB)
Collecting numpy>=1.16
  Using cached numpy-1.21.5-cp310-cp310-win_amd64.whl (14.0 MB)
Collecting llvmlite<0.39,>=0.38.0rc1
  Using cached llvmlite-0.38.0-cp310-cp310-win_amd64.whl (23.2 MB)
Collecting python-utils>=3.0.0
  Using cached python_utils-3.1.0-py2.py3-none-any.whl (19 kB)
Collecting qtpy
  Using cached QtPy-2.0.1-py3-none-any.whl (65 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
  Using cached urllib3-1.26.8-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
  Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting commonmark<0.10.0,>=0.9.0
  Using cached commonmark-0.9.1-py2.py3-none-any.whl (51 kB)
Collecting executing
  Using cached executing-0.8.3-py2.py3-none-any.whl (16 kB)
Collecting pure-eval
  Using cached pure_eval-0.2.2-py3-none-any.whl (11 kB)
Collecting asttokens
  Using cached asttokens-2.0.5-py2.py3-none-any.whl (20 kB)
Collecting asgiref>=3.4.0
  Using cached asgiref-3.5.0-py3-none-any.whl (22 kB)
Collecting click>=7.0
  Using cached click-8.0.4-py3-none-any.whl (97 kB)
Collecting h11>=0.8
  Using cached h11-0.13.0-py3-none-any.whl (58 kB)
Collecting websockets>=10.0
  Using cached websockets-10.2-cp310-cp310-win_amd64.whl (97 kB)
Collecting watchgod>=0.6
  Using cached watchgod-0.7-py3-none-any.whl (11 kB)
Collecting httptools<0.4.0,>=0.2.0
  Using cached httptools-0.3.0-cp310-cp310-win_amd64.whl (141 kB)
Collecting python-dotenv>=0.13
  Using cached python_dotenv-0.19.2-py2.py3-none-any.whl (17 kB)
Using legacy 'setup.py install' for future, since package 'wheel' is not installed.
Using legacy 'setup.py install' for tornado, since package 'wheel' is not installed.
Using legacy 'setup.py install' for aplus, since package 'wheel' is not installed.
Building wheels for collected packages: vaex-core
  Building wheel for vaex-core (PEP 517) ... error
  ERROR: Command errored out with exit status 1:
   command: 'c:\Data\venv\github-pages\Scripts\python.exe' 'c:\Data\venv\github-pages\lib\site-packages\pip\_vendor\pep517\in_process\_in_process.py' build_wheel 'C:\Users\madsenbj\AppData\Local\Temp\tmpfkcd33uh'
       cwd: C:\Users\madsenbj\AppData\Local\Temp\pip-install-pmndbbpw\vaex-core_43eb4a13698048478681800aa74049df
  Complete output (260 lines):
  setup.py:4: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
    import imp
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build\lib.win-amd64-3.10
  creating build\lib.win-amd64-3.10\vaex
  copying vaex\agg.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\array_types.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\asyncio.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\benchmark.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\cache.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\column.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\config.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\convert.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\cpu.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\dataframe.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\dataframe_protocol.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\dataset.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\dataset_misc.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\dataset_mmap.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\dataset_utils.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\datatype.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\datatype_test.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\delayed.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\docstrings.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\encoding.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\events.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\execution.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\export.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\expression.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\expresso.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\formatting.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\functions.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\geo.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\grids.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\groupby.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\hash.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\image.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\itertools.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\join.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\json.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\kld.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\legacy.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\logging.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\memory.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\meta.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\metal.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\misc_cmdline.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\multiprocessing.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\multithreading.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\parallelize.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\progress.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\promise.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\registry.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\rolling.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\samp.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\schema.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\scopes.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\selections.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\serialize.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\settings.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\shift.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\stat.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\strings.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\struct.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\tasks.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\utils.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\version.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\_version.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\__init__.py -> build\lib.win-amd64-3.10\vaex
  copying vaex\__main__.py -> build\lib.win-amd64-3.10\vaex
  package init file 'vaex\arrow\__init__.py' not found (or not a regular file)
  creating build\lib.win-amd64-3.10\vaex\arrow
  copying vaex\arrow\convert.py -> build\lib.win-amd64-3.10\vaex\arrow
  copying vaex\arrow\dataset.py -> build\lib.win-amd64-3.10\vaex\arrow
  copying vaex\arrow\numpy_dispatch.py -> build\lib.win-amd64-3.10\vaex\arrow
  copying vaex\arrow\opener.py -> build\lib.win-amd64-3.10\vaex\arrow
  copying vaex\arrow\utils.py -> build\lib.win-amd64-3.10\vaex\arrow
  copying vaex\arrow\utils_test.py -> build\lib.win-amd64-3.10\vaex\arrow
  copying vaex\arrow\_version.py -> build\lib.win-amd64-3.10\vaex\arrow
  creating build\lib.win-amd64-3.10\vaex\core
  copying vaex\core\_version.py -> build\lib.win-amd64-3.10\vaex\core
  copying vaex\core\__init__.py -> build\lib.win-amd64-3.10\vaex\core
  creating build\lib.win-amd64-3.10\vaex\file
  copying vaex\file\asyncio.py -> build\lib.win-amd64-3.10\vaex\file
  copying vaex\file\cache.py -> build\lib.win-amd64-3.10\vaex\file
  copying vaex\file\column.py -> build\lib.win-amd64-3.10\vaex\file
  copying vaex\file\gcs.py -> build\lib.win-amd64-3.10\vaex\file
  copying vaex\file\s3.py -> build\lib.win-amd64-3.10\vaex\file
  copying vaex\file\s3arrow.py -> build\lib.win-amd64-3.10\vaex\file
  copying vaex\file\s3fs.py -> build\lib.win-amd64-3.10\vaex\file
  copying vaex\file\s3_test.py -> build\lib.win-amd64-3.10\vaex\file
  copying vaex\file\__init__.py -> build\lib.win-amd64-3.10\vaex\file
  creating build\lib.win-amd64-3.10\vaex\test
  copying vaex\test\all.py -> build\lib.win-amd64-3.10\vaex\test
  copying vaex\test\cmodule.py -> build\lib.win-amd64-3.10\vaex\test
  copying vaex\test\dataset.py -> build\lib.win-amd64-3.10\vaex\test
  copying vaex\test\expresso.py -> build\lib.win-amd64-3.10\vaex\test
  copying vaex\test\misc.py -> build\lib.win-amd64-3.10\vaex\test
  copying vaex\test\plot.py -> build\lib.win-amd64-3.10\vaex\test
  copying vaex\test\ui.py -> build\lib.win-amd64-3.10\vaex\test
  copying vaex\test\__init__.py -> build\lib.win-amd64-3.10\vaex\test
  copying vaex\test\__main__.py -> build\lib.win-amd64-3.10\vaex\test
  creating build\lib.win-amd64-3.10\vaex\ext
  copying vaex\ext\bokeh.py -> build\lib.win-amd64-3.10\vaex\ext
  copying vaex\ext\common.py -> build\lib.win-amd64-3.10\vaex\ext
  copying vaex\ext\ipyvolume.py -> build\lib.win-amd64-3.10\vaex\ext
  copying vaex\ext\jprops.py -> build\lib.win-amd64-3.10\vaex\ext
  copying vaex\ext\readcol.py -> build\lib.win-amd64-3.10\vaex\ext
  copying vaex\ext\__init__.py -> build\lib.win-amd64-3.10\vaex\ext
  creating build\lib.win-amd64-3.10\vaex\misc
  copying vaex\misc\expressions.py -> build\lib.win-amd64-3.10\vaex\misc
  copying vaex\misc\ordereddict.py -> build\lib.win-amd64-3.10\vaex\misc
  copying vaex\misc\pandawrap.py -> build\lib.win-amd64-3.10\vaex\misc
  copying vaex\misc\parallelize.py -> build\lib.win-amd64-3.10\vaex\misc
  copying vaex\misc\progressbar.py -> build\lib.win-amd64-3.10\vaex\misc
  copying vaex\misc\samp.py -> build\lib.win-amd64-3.10\vaex\misc
  copying vaex\misc\__init__.py -> build\lib.win-amd64-3.10\vaex\misc
  creating build\lib.win-amd64-3.10\vaex\datasets
  copying vaex\datasets\__init__.py -> build\lib.win-amd64-3.10\vaex\datasets
  running egg_info
  writing vaex_core.egg-info\PKG-INFO
  writing dependency_links to vaex_core.egg-info\dependency_links.txt
  writing entry points to vaex_core.egg-info\entry_points.txt
  writing requirements to vaex_core.egg-info\requires.txt
  writing top-level names to vaex_core.egg-info\top_level.txt
  reading manifest file 'vaex_core.egg-info\SOURCES.txt'
  reading manifest template 'MANIFEST.in'
  warning: no files found matching '*.c' under directory 'vendor'
  warning: no files found matching '*.h' under directory 'src'
  warning: no files found matching '*.c' under directory 'src'
  adding license file 'LICENSE.txt'
  writing manifest file 'vaex_core.egg-info\SOURCES.txt'
  copying vaex\datasets\iris.hdf5 -> build\lib.win-amd64-3.10\vaex\datasets
  copying vaex\datasets\titanic.hdf5 -> build\lib.win-amd64-3.10\vaex\datasets
  running build_ext
  building 'vaex.vaexfast' extension
  creating build\temp.win-amd64-3.10
  creating build\temp.win-amd64-3.10\Release
  creating build\temp.win-amd64-3.10\Release\src
  "C:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\VC\Tools\MSVC\14.29.30037\bin\HostX86\x64\cl.exe" /c /nologo /O2 /W3 /GL /DNDEBUG /MD -IC:\Users\madsenbj\AppData\Local\Temp\pip-build-env-it205hpj\overlay\Lib\site-packages\numpy\core\include -Ic:\Data\venv\github-pages\include -IC:\Users\madsenbj\AppData\Local\Programs\Python\Python310\include -IC:\Users\madsenbj\AppData\Local\Programs\Python\Python310\Include "-IC:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\VC\Tools\MSVC\14.29.30037\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\shared" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\winrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\cppwinrt" /EHsc /Tpsrc\vaexfast.cpp /Fobuild\temp.win-amd64-3.10\Release\src\vaexfast.obj /EHsc
  vaexfast.cpp
  src\vaexfast.cpp(18): warning C4005: 'INFINITY': macro redefinition
  C:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\ucrt\corecrt_math.h(88): note: see previous definition of 'INFINITY'
  C:\Users\madsenbj\AppData\Local\Temp\pip-build-env-it205hpj\overlay\Lib\site-packages\numpy\core\include\numpy\npy_1_7_deprecated_api.h(14) : Warning Msg: Using deprecated NumPy API, disable it with #define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION
  src\vaexfast.cpp(201): warning C4244: 'argument': conversion from '__int64' to 'int', possible loss of data
  src\vaexfast.cpp(532): warning C4244: 'argument': conversion from '__int64' to 'const int', possible loss of data
  src\vaexfast.cpp(956): warning C4244: '=': conversion from 'Py_ssize_t' to 'int', possible loss of data
  src\vaexfast.cpp(1798): warning C4244: 'argument': conversion from '__int64' to 'int', possible loss of data
  src\vaexfast.cpp(1798): warning C4244: 'argument': conversion from '__int64' to 'int', possible loss of data
  src\vaexfast.cpp(64): warning C4244: '=': conversion from 'npy_intp' to 'int', possible loss of data
  src\vaexfast.cpp(198): note: see reference to function template instantiation 'void object_to_numpy1d_nocopy<double>(T *&,PyObject *,__int64 &,int &,int)' being compiled
          with
          [
              T=double
          ]
  src\vaexfast.cpp(88): warning C4244: '=': conversion from 'npy_intp' to 'int', possible loss of data
  src\vaexfast.cpp(280): note: see reference to function template instantiation 'void object_to_numpy1d_nocopy_endian<double>(T *&,PyObject *,__int64 &,bool &,int &,int)' being compiled
          with
          [
              T=double
          ]
  src\vaexfast.cpp(105): warning C4244: 'initializing': conversion from 'npy_intp' to 'int', possible loss of data
  src\vaexfast.cpp(644): note: see reference to function template instantiation 'void object_to_numpy2d_nocopy<double>(T *&,PyObject *,int &,int &,int)' being compiled
          with
          [
              T=double
          ]
  src\vaexfast.cpp(108): warning C4244: 'initializing': conversion from 'npy_intp' to 'int', possible loss of data
  src\vaexfast.cpp(667): warning C4244: 'initializing': conversion from 'const double' to 'float', possible loss of data
  src\vaexfast.cpp(775): note: see reference to function template instantiation 'void histogram2d_f4<__int64>(const float *__restrict const ,const float *__restrict const ,const float *const ,const __int64,bool,bool,bool,Tout *__restrict const ,const int,const int,const double,const double,const double,const double,const __int64,const __int64)' being compiled
          with
          [
              Tout=__int64
          ]
  src\vaexfast.cpp(667): warning C4244: 'initializing': conversion from 'const double' to 'const float', possible loss of data
  src\vaexfast.cpp(668): warning C4244: 'initializing': conversion from 'const double' to 'float', possible loss of data
  src\vaexfast.cpp(668): warning C4244: 'initializing': conversion from 'const double' to 'const float', possible loss of data
  src\vaexfast.cpp(669): warning C4244: 'initializing': conversion from 'const double' to 'float', possible loss of data
  src\vaexfast.cpp(669): warning C4244: 'initializing': conversion from 'const double' to 'const float', possible loss of data
  src\vaexfast.cpp(670): warning C4244: 'initializing': conversion from 'const double' to 'float', possible loss of data
  src\vaexfast.cpp(670): warning C4244: 'initializing': conversion from 'const double' to 'const float', possible loss of data
  src\vaexfast.cpp(671): warning C4244: 'initializing': conversion from 'double' to 'float', possible loss of data
  src\vaexfast.cpp(671): warning C4244: 'initializing': conversion from 'double' to 'const float', possible loss of data
  src\vaexfast.cpp(672): warning C4244: 'initializing': conversion from 'double' to 'float', possible loss of data
  src\vaexfast.cpp(672): warning C4244: 'initializing': conversion from 'double' to 'const float', possible loss of data
  src\vaexfast.cpp(133): warning C4244: 'initializing': conversion from 'npy_intp' to 'int', possible loss of data
  src\vaexfast.cpp(887): note: see reference to function template instantiation 'void object_to_numpy3d_nocopy<double>(T *&,PyObject *,int &,int &,int &,int)' being compiled
          with
          [
              T=double
          ]
  src\vaexfast.cpp(136): warning C4244: 'initializing': conversion from 'npy_intp' to 'int', possible loss of data
  src\vaexfast.cpp(139): warning C4244: 'initializing': conversion from 'npy_intp' to 'int', possible loss of data
  src\vaexfast.cpp(174): warning C4244: '=': conversion from 'npy_intp' to 'int', possible loss of data
  src\vaexfast.cpp(983): note: see reference to function template instantiation 'void object_to_numpyNd_nocopy<double>(T *&,PyObject *,int,int &,int *,__int64 *,int)' being compiled
          with
          [
              T=double
          ]
  src\vaexfast.cpp(1335): warning C4244: '=': conversion from 'Py_ssize_t' to 'int', possible loss of data
  src\vaexfast.cpp(2072): note: see reference to function template instantiation 'PyObject *statisticNd_<double,NPY_DOUBLE>(PyObject *,PyObject *)' being compiled
  src\vaexfast.cpp(1338): warning C4244: '=': conversion from 'Py_ssize_t' to 'int', possible loss of data
  src\vaexfast.cpp(1149): warning C4244: 'initializing': conversion from 'double' to 'T', possible loss of data
          with
          [
              T=float
          ]
  src\vaexfast.cpp(1271): note: see reference to function template instantiation 'void statisticNd<T,op_add1<T,double,endian>,endian>(const T *__restrict const [],const T *__restrict const [],__int64,const int,const int,double *__restrict const ,const __int64 *__restrict const ,const int *__restrict const ,const T *__restrict const ,const T *__restrict const ,int)' being compiled
          with
          [
              T=float,
              endian=functor_double_to_native
          ]
  src\vaexfast.cpp(1308): note: see reference to function template instantiation 'void statisticNd_wrap_template_endian<T,functor_double_to_native>(const T *const [],const T *const [],__int64,int,int,double *,__int64 [],int [],T [],T [],int,int)' being compiled
          with
          [
              T=float
          ]
  src\vaexfast.cpp(1402): note: see reference to function template instantiation 'void statisticNd_wrap_template<T>(const T *const [],const T *const [],__int64,int,int,double *,__int64 [],int [],T [],T [],bool,int,int)' being compiled
          with
          [
              T=float
          ]
  src\vaexfast.cpp(2073): note: see reference to function template instantiation 'PyObject *statisticNd_<float,NPY_FLOAT>(PyObject *,PyObject *)' being compiled
  src\vaexfast.cpp(1178): warning C4244: 'initializing': conversion from 'double' to 'T', possible loss of data
          with
          [
              T=float
          ]
  src\vaexfast.cpp(1198): warning C4244: 'initializing': conversion from 'double' to 'T', possible loss of data
          with
          [
              T=float
          ]
  src\vaexfast.cpp(1216): warning C4244: 'initializing': conversion from 'double' to 'T', possible loss of data
          with
          [
              T=float
          ]
  "C:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\VC\Tools\MSVC\14.29.30037\bin\HostX86\x64\link.exe" /nologo /INCREMENTAL:NO /LTCG /DLL /MANIFEST:EMBED,ID=2 /MANIFESTUAC:NO /LIBPATH:c:\Data\venv\github-pages\libs /LIBPATH:C:\Users\madsenbj\AppData\Local\Programs\Python\Python310\libs /LIBPATH:C:\Users\madsenbj\AppData\Local\Programs\Python\Python310 /LIBPATH:c:\Data\venv\github-pages\PCbuild\amd64 "/LIBPATH:C:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\VC\Tools\MSVC\14.29.30037\lib\x64" "/LIBPATH:C:\Program Files (x86)\Windows Kits\10\lib\10.0.19041.0\ucrt\x64" "/LIBPATH:C:\Program Files (x86)\Windows Kits\10\lib\10.0.19041.0\um\x64" /EXPORT:PyInit_vaexfast build\temp.win-amd64-3.10\Release\src\vaexfast.obj /OUT:build\lib.win-amd64-3.10\vaex\vaexfast.cp310-win_amd64.pyd /IMPLIB:build\temp.win-amd64-3.10\Release\src\vaexfast.cp310-win_amd64.lib
     Creating library build\temp.win-amd64-3.10\Release\src\vaexfast.cp310-win_amd64.lib and object build\temp.win-amd64-3.10\Release\src\vaexfast.cp310-win_amd64.exp
  Generating code
  Finished generating code
  building 'vaex.superstrings' extension
  "C:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\VC\Tools\MSVC\14.29.30037\bin\HostX86\x64\cl.exe" /c /nologo /O2 /W3 /GL /DNDEBUG /MD -IC:\Users\madsenbj\AppData\Local\Temp\pip-build-env-it205hpj\overlay\Lib\site-packages\numpy\core\include -Ivendor/pybind11/include -Ivendor/pybind11/include -Ivendor/string-view-lite/include -Ivendor/boost -Ic:\Data\venv\github-pages\include -Ic:\Data\venv\github-pages\Library\include -Ivendor\pcre\Library\include -Ic:\Data\venv\github-pages\include -IC:\Users\madsenbj\AppData\Local\Programs\Python\Python310\include -IC:\Users\madsenbj\AppData\Local\Programs\Python\Python310\Include "-IC:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\VC\Tools\MSVC\14.29.30037\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\ucrt" "-IC:\Program Files 
(x86)\Windows Kits\10\include\10.0.19041.0\shared" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\winrt" "-IC:\Program Files 
(x86)\Windows Kits\10\include\10.0.19041.0\cppwinrt" /EHsc /Tpsrc\string_utils.cpp /Fobuild\temp.win-amd64-3.10\Release\src\string_utils.obj /EHsc
  string_utils.cpp
  C:\Users\madsenbj\AppData\Local\Temp\pip-install-pmndbbpw\vaex-core_43eb4a13698048478681800aa74049df\src\string_utils.hpp(208): warning C4244: '=': conversion from 'char32_t' to 'char', possible loss of data
  "C:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\VC\Tools\MSVC\14.29.30037\bin\HostX86\x64\cl.exe" /c /nologo /O2 /W3 /GL /DNDEBUG /MD -IC:\Users\madsenbj\AppData\Local\Temp\pip-build-env-it205hpj\overlay\Lib\site-packages\numpy\core\include -Ivendor/pybind11/include -Ivendor/pybind11/include -Ivendor/string-view-lite/include -Ivendor/boost -Ic:\Data\venv\github-pages\include -Ic:\Data\venv\github-pages\Library\include -Ivendor\pcre\Library\include -Ic:\Data\venv\github-pages\include -IC:\Users\madsenbj\AppData\Local\Programs\Python\Python310\include -IC:\Users\madsenbj\AppData\Local\Programs\Python\Python310\Include "-IC:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\VC\Tools\MSVC\14.29.30037\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\ucrt" "-IC:\Program Files 
(x86)\Windows Kits\10\include\10.0.19041.0\shared" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\winrt" "-IC:\Program Files 
(x86)\Windows Kits\10\include\10.0.19041.0\cppwinrt" /EHsc /Tpsrc\strings.cpp /Fobuild\temp.win-amd64-3.10\Release\src\strings.obj /EHsc
  strings.cpp
  vendor/pybind11/include\pybind11/numpy.h(35): error C2065: 'ssize_t': undeclared identifier
  vendor/pybind11/include\pybind11/numpy.h(35): error C2338: ssize_t != Py_intptr_t
  C:\Users\madsenbj\AppData\Local\Temp\pip-install-pmndbbpw\vaex-core_43eb4a13698048478681800aa74049df\src\string_utils.hpp(208): warning C4244: '=': conversion from 'char32_t' to 'char', possible loss of data
  vendor\pcre\Library\include\pcrecpp.h(701): warning C4251: 'pcrecpp::RE::pattern_': class 'std::basic_string<char,std::char_traits<char>,std::allocator<char>>' needs to have dll-interface to be used by clients of class 'pcrecpp::RE'
  C:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\VC\Tools\MSVC\14.29.30037\include\xstring(4905): note: see declaration of 'std::basic_string<char,std::char_traits<char>,std::allocator<char>>'  src\strings.cpp(273): warning C4018: '>': signed/unsigned mismatch
  src\strings.cpp(282): warning C4018: '>': signed/unsigned mismatch
  error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio\\2019\\BuildTools\\VC\\Tools\\MSVC\\14.29.30037\\bin\\HostX86\\x64\\cl.exe' failed with exit code 2
  ----------------------------------------
  ERROR: Failed building wheel for vaex-core
Failed to build vaex-core
ERROR: Could not build wheels for vaex-core which use PEP 517 and cannot be installed directly
WARNING: You are using pip version 21.2.4; however, version 22.0.3 is available.
You should consider upgrading via the 'c:\Data\venv\github-pages\Scripts\python.exe -m pip install --upgrade pip' command.

root-11 avatar Feb 28 '22 17:02 root-11

I've just repeated the install on python3.9.9 - no issues here.

c:\Data\venv\github-pages-39\Scripts\activate.bat         
(github-pages-39) C:\Data\github\github-pages\root-11.github.io>pip install jupyter vaex==4.8.0

root-11 avatar Feb 28 '22 18:02 root-11

Ran into the same issue when installing directly using pip. I think it's the gcc arguments - setting it to fail on warnings. Unfortunately 3.10.* includes quite a few deprecation warnings. I will try to compile from the latest source now.

jagtesh avatar Apr 14 '22 21:04 jagtesh

Oddly - the problem surfaced itself when I tired compiling from source. There was an error referring a pcre dependency. Upon research, it became apparent I needed to install a pcre development library libpcre3-dev.

Installing that fixed the errors building from source and also from pip!

NOTE: I encountered this issue on Ubuntu 20.04 LTS (amd64). You could be missing a dependency, or it could be an entirely different platform related issue (Windows).

jagtesh avatar Apr 15 '22 03:04 jagtesh

I just encountered the same error. It does not support Python 3.10.

image

giswqs avatar Apr 18 '22 13:04 giswqs

Yes, we don't support 3.10 yet. Since we have quite some dependencies, we often have to wait for them to be ready.

maartenbreddels avatar Apr 26 '22 14:04 maartenbreddels

Any timeline/updates on this one or perhaps a list of dependencies that are missing 3.10 support?

arunpersaud avatar Jul 10 '22 22:07 arunpersaud

@maartenbreddels > Yes, we don't support 3.10 yet. Since we have quite some dependencies, we often have to wait for them to be ready.

Maybe I missed someplace but it would useful if the supported python version was documented someplace. I didn't see it here or on your docs. It would safe time instead of searching for install errors.

tjquinn1 avatar Jul 28 '22 00:07 tjquinn1

@maartenbreddels Can you please mention in the README the list of supported pythons?

Thx

mangin avatar Nov 04 '22 13:11 mangin

We just did a release with 3.10 support, it's vaex version 4.16. It's not in CI yet, so support is slightly experimental. The test suite runs locally, so it's not totally untested, just having CI issues.

maartenbreddels avatar Dec 02 '22 19:12 maartenbreddels

Nice. Worked for me! :) Thanks

arunpersaud avatar Dec 04 '22 03:12 arunpersaud

Starting from the next release, we should see it on the main readme (see bb4203810b7f35cac6fa573ec7cc784d0bdf5786)

maartenbreddels avatar Dec 05 '22 13:12 maartenbreddels

It's shown on the main readme now: https://github.com/vaexio/vaex/#readme

maartenbreddels avatar Dec 13 '22 11:12 maartenbreddels