pyarrow topic

the portable Python dataframe library

ibis-project

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

vaexio

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, a...

uber

Converts a whole subdirectory with a big (or small) volume of PDF documents to a dataset (pandas DataFrame) with error tracking and choice of features

icaropires

Exploring Chicago crimes dataset with Jupyter notebooks, DuckDB, Malloy and new Panel/PyScript data and dashboard tools.

RandomFractals

Command-line interface to quickly generate fake CSV and JSON data

dacort

Work with bioinformatic files using Arrow, Polars, and/or DuckDB

wheretrue