Ziggy Jonsson
Ziggy Jonsson
On the second point, [here](https://github.com/ZJONSSON/parquetjs/commit/62a60ff4bf842f410e28226744220062f492d27e) is a quick branch (very much wip) on the optimization of simultaneous requests. Any reads with close to consecutive segments, i.e. the `offset` of next...
see also https://github.com/ZJONSSON/parquetjs/issues/24#issuecomment-416009322
You might want to check out this PR here https://github.com/ironSource/parquetjs/pull/56 which has some fixes to RLE encoding and does verification of the generated files with parquet-mr. I think you should...
Also - if you want to avoid the headache of building and configuring parquet-tools you can simply add this to your `.bashrc` (or paste in console) and use docker to...
You can find dictionary work here https://github.com/ZJONSSON/parquetjs/blob/master/lib/reader.js#L581-L591 - not yet a PR to this repo. (the master is published as /parquetjs-lite)
@shyim @dg3feiko Did you check out the https://github.com/ironSource/parquetjs/issues/67 - might be related
there is also https://github.com/ironSource/parquetjs/pull/43 you could try to install a fork that has all my outstanding PRs here merged to master (including the 43) ``` npm install zjonsson/parquetjs ```
So I encountered the same issue and spend some time getting it to work. Here is a solution that seems to work at least for my case of lists with...
The problem seems to be with how the reader reconstructs the schema from the parquet file. If I log the original fields from the schema (i.e. `console.log(schema.fields)`), I get: ```...