vaex icon indicating copy to clipboard operation
vaex copied to clipboard

[FEATURE-REQUEST] Support Google Colab installation without runtime restart

Open franz101 opened this issue 1 year ago • 3 comments

Description When running pip install vaex, the runtime of the colab is needed to restarted (see attachments)

Is your feature request related to a problem? Please describe. The problem is some dependencies update matplotlib to larger then 3.22 (which runs on Google Colab) Additional context Here is a Google Colab that shows the problem and a workaround

Example of runtime restart needed: Screenshot 2022-09-20 at 15 27 03

Example of installing the packages in a way matplotlib is not updated: Screenshot 2022-09-20 at 15 27 56

franz101 avatar Sep 20 '22 19:09 franz101

@maartenbreddels

franz101 avatar Sep 20 '22 19:09 franz101

I don't think we can do anything about that. It is their environment.

If somebody has an idea on how to fix this - please get in touch.

Edit: If you do not want to update or touch matplotlib in any way, just don't install vaex-viz. Install only vaex-core and perhaps vaex-hdf5 and vaex-ml depending on what you need.

JovanVeljanoski avatar Sep 20 '22 21:09 JovanVeljanoski

Strange issue, thanks for letting us know.

Maybe by using the solution here https://github.com/geoalchemy/geoalchemy2/pull/392 in vaex (instead of the slow pkg_resources) we can make this faster and also working on colab without requiring a restart.

I think this could be a good first issue for someone.

maartenbreddels avatar Sep 21 '22 10:09 maartenbreddels

Hey @maartenbreddels ,

thanks for the input. I have forked vaex and am experimenting with the different version implementation: https://github.com/franz101/vaex-colab/blob/f70f4a4e2ef6c4d2902239e183f5d7abd4bcc4d3/packages/vaex-core/vaex/version.py

But running the installation it fails during the vaex-meta setup: https://colab.research.google.com/drive/1WC-ROEunPKaxHD50b_vqxHS_3FT9METM#scrollTo=apSprOWRQ2qy

is this related to python 3.7 and not a venv?

franz101 avatar Oct 11 '22 13:10 franz101

Running setup.py develop for vaex-meta ERROR: Command errored out with exit status 1: /usr/bin/python3 -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/content/vaex-colab/setup.py'"'"'; file='"'"'/content/vaex-colab/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(file) if os.path.exists(file) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' develop --no-deps Check the logs for full command output.

franz101 avatar Oct 11 '22 13:10 franz101