parquet-wasm icon indicating copy to clipboard operation
parquet-wasm copied to clipboard

Published 20 hours ago • verified publisher icon kylebarron

ESM Example

Open kylebarron opened this issue 2 years ago • 2 comments

Should find a smaller Parquet file or better notify that this will download a 270MB file 😄

This expands in memory to a 755MB Arrow file. It takes 6s in WASM vs 1.25s in Pyarrow with threads turned off. That extra time might be in copying the buffer to/from WASM memory?

Closes #12

kylebarron avatar Mar 07 '22 06:03 kylebarron

Is it not possible to write the IPC stream directly to a Uint8Array rather than a vector? Not super familiar with rust/wasm at all but was going to look into this tomorrow. Just wanted to check if there was some reason you hadn't first.

akash329d avatar Jun 09 '22 07:06 akash329d

@akash329d I don't think your question is related to this PR; I moved your question to #133

kylebarron avatar Jun 09 '22 16:06 kylebarron