vaex
vaex copied to clipboard
vaexio
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
**Description** Vaex correlation calculation completely ignores the rows or column with missing values; which is not desired behavior with real world data; Pandas have such functionality pandas_df.corr(min_periods=100), where min_periods defines...
I am having trouble working with `vaex` inside python's `mulitprocessing`'s `pool`. The expected behavior for `pool.map()` is to iterate through out the list supplied to it but that does not...
**Description** First thank you guys for this wonderful library. It does many pd operations pretty well given mem constraints (except maybe cumsum() which i am eagerly waiting.) I have a...
Hi all, First of all, thank you for this really cool lib. I discovered it few days ago, and I am starting to understand its philosophy. I face a problem,...
Hey, I was wondering what makes vaex fail to install on Python 3.11.2 ```shell Building wheel for vaex-core (pyproject.toml) ... error error: subprocess-exited-with-error × Building wheel for vaex-core (pyproject.toml) did...
**Description** Environment: IPython 8.15.0 + Python 3.10.13 I am encountering an issue where sorting a Vaex DataFrame and then attempting to print it results in running out of memory. I...
When I try to run `pip install vaex` in a fresh virtualenv on Python 3.11.3, Arch Linux, running gcc 13.1.1, I get the following build failure when trying to build...
I am getting a strange error on a fresh installation of Vaex with `pip install` **Description** I get `PydanticImportError`; see full log below **Software information** - Vaex version (`import vaex;...
**Description** Given the recent release of Python 3.12 with numerous improvements and changes, I propose that Vaex be updated to support this latest version. Ensuring compatibility will make Vaex available...
When I use python multi-process and vaex, I want to save the text as embedding. Everything is normal in the early stage of the program running, but after a while,...
