perspective icon indicating copy to clipboard operation
perspective copied to clipboard

Apache Arrow featherV2 read function

Open public-tatsuya-noyori opened this issue 3 years ago • 3 comments

When I read Apache Arrow featherV2, I get the following error.

Table initialization failed: Error: Abort(): Failed to read file record batch: NotImplemented: LZ4 codec support not built

It would be appreciated if you could implement Apache Arrow featherV2 read function.

public-tatsuya-noyori avatar Jun 21 '21 22:06 public-tatsuya-noyori

The solution here might be to bump the Arrow version. This project seems to still use 1.0.1, and LZ4 compression seems to have been enabled by default in Arrow version 4.0.0

nevi-me avatar Jun 25 '21 08:06 nevi-me

@public-tatsuya-noyori can you provide an arrow file? we just upgraded to 5.0 on master, so we can see if this is fixed with the new arrow version

timkpaine avatar Oct 13 '21 18:10 timkpaine

I am certain this still won't work even with Arrow 5.0. We don't yet build LZ4 for wasm for starters, it is "enabled" by default in that the python API will default the compression kwarg but even this depends on the python bindings for LZ4.

texodus avatar Oct 13 '21 18:10 texodus

Fixed in #2339

texodus avatar Nov 23 '23 23:11 texodus