vscode-data-preview icon indicating copy to clipboard operation
vscode-data-preview copied to clipboard

Pandas Parquet not shown ("loading data" forever)

Open turbotimon opened this issue 1 year ago β€’ 4 comments

Problem: When I save a pandas.DataFrame with df.to_parquet (using pyarrow as backend), it can not be opened with DataPreview:

  • DataPreview is empty and showing "Loading data.." in the footer forever
  • It does not matter how big the dataframe is, also very small ones are not loaded
  • I tried it with suffix .parquet as well as .arrow

Console Log:

>Β window.WebComponentsReady

 data viewer initialized!

> document.readystatechange complete

 data.view:complete!

> loadDataInfo()

 data url: file:///home/test.parquet
 data table: 

> restoreConfig(
{})

> 

Any recommendation how to fix?

BTW: Really like the extension!

turbotimon avatar Dec 29 '23 10:12 turbotimon

Parquet viewing doesn't work on Windows or mac.

kzeitz avatar Feb 17 '24 19:02 kzeitz

but I'm using Linux (NixOS 23.11) and it's not working

turbotimon avatar Feb 19 '24 08:02 turbotimon

@kzeitz that would be something pretty important to note in the extension page.

D3SL avatar Jun 25 '24 14:06 D3SL

meanwhile, for anyone looking for a vscode extension that handles parquet well, i can recommend Data Wrangler

turbotimon avatar Jun 26 '24 13:06 turbotimon