Kyle Barron

Failing tests with lower max_error

2

When trying to add more tests to compare against Martini output, I'm getting slightly smaller `vertices` and `triangles` arrays (on the order of 25 fewer elements for `vertices`) for smaller...

Try fetch polyfill in node again

2

https://rustwasm.github.io/wasm-pack/book/prerequisites/considerations.html Currently the async API of the arrow2 bindings doesn't work in Node. Does it work if you polyfill all of these? ```js const fetch = require('node-fetch'); // ES Module...

E.g. with a geo-arrow file in the browser, it seems to be missing geo metadata

Had a new thought today: Can we use the Arrow C data interface with WebAssembly?? References: - https://radu-matei.com/blog/practical-guide-to-wasm-memory/ - https://github.com/DeMille/wasm-ffi/blob/master/docs/rust/main.rs - https://demille.github.io/wasm-ffi/docs/rust/ - - https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/WebAssembly/Memory - https://github.com/jorgecarleitao/arrow2/blob/main/examples/ffi.rs - https://docs.rs/arrow2/latest/arrow2/ffi/index.html

https://arrow.apache.org/docs/python/parquet.html#writing-metadata-and-common-medata-files

Write IPC stream directly to a `Uint8Array` rather than a vector?

1

Is it not possible to write the IPC stream directly to a `Uint8Array` rather than a vector? Not super familiar with rust/wasm at all but was going to look into...

ESM Example

2

Should find a smaller Parquet file or better notify that this will download a 270MB file 😄 This expands in memory to a 755MB Arrow file. It takes 6s in...

see https://docs.rs/arrow2/latest/arrow2/io/parquet/read/fn.read_columns_many.html#implementation if you look at the implementation of `read_columns`, it basically just fetches the byte range described in the column chunk metadata. the implication of this is that if...

``` cargo run --example parquet_read --features io_parquet,io_parquet_compression -- 1-partition-lz4.parquet ```