partd
partd copied to clipboard
dask
Concurrent appendable key-value storage
**Describe the issue**: This is due to using the removed `configparser.SafeConfigParser`: ``` Traceback (most recent call last): File "/usr/lib/rpm/redhat/pyproject_buildrequires.py", line 555, in main generate_requires( File "/usr/lib/rpm/redhat/pyproject_buildrequires.py", line 451, in generate_requires...
running the following on Pandas 2.2.0.dev0+394.g820d5a902f: ```python import pandas as pd from partd import File, PandasColumns, PandasBlocks p = PandasBlocks(File("foo")) p.append({'x': pd.DataFrame({'x': [1]})}) p.get('x') ``` results in the following warnings:...
On create github release entry is created email notification to those whom have set in your repo the web UI Watch->Releases. gh release can contain additional comments (li changelog) or...
Fixes: #68 (Untested on other Python versions than 3.12)
When doing shuffle operations on non-pandas dataframes, we run into issues in partd due to its pandas-specific serialization logic; for example, when trying to do `groupby.apply` operations with dask-cudf, we...
Hello, Rebecca Palmer noticed out that test_serialization in partd version 1.2.0's tests occasionally fail on ppc64el and s390x . ( https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1005045 ) ``` =================================== FAILURES =================================== ______________________________ test_serialization ______________________________ def...
would there be interest in adding zstd to partd. At lowish compression levels I've found it to have better compression and around twice as fast as snappy.
When dask uses partd for eg shuffle operations, the dataframes always come back as a `pandas.DataFrame`, even if a subclass was stored (xref https://github.com/geopandas/dask-geopandas/issues/59#issuecomment-864469674). For example: ``` import geopandas gdf...
**tl;dr:** - Introduces a `safer_eval` function to replace `eval` (the former still relies on the latter, as `ast.literal_eval` is not suitable enough). - Applies `isort==4.3.21` to all files that have...
