arquero
arquero copied to clipboard
Feather format written by PyArrow 7.0.0 cannot be opened in Arquero
Hi,
with pyarrow
v7.0.0:
import seaborn as sns
import pyarrow as arrow
iris = sns.load_dataset("iris")
pf.write_feather(iris, 'iris.feather')
The resultant file is then loaded into arquero
in an Observable notebook. The table has the correct columnar structure but the internal data is in a different format.
I think this is related to #270? And hopefully resolved in #277? Hope it can get PRed soon!
PS I use pyarrow
to (lightly) munge and convert a 4GB dataset to a smaller 36MB feather file, and I'd like to start building a dashboard with it, using arquero
as the analytics engine.
Thanks for all the hard work!
I see that with arquero>=5.0
, this issue is resolved, with the caveat that only uncompressed Feather files can be read in for the time being!