Johan Peltenburg

Results 11 comments of Johan Peltenburg

seems it also applies to the read converter

I'm not able to reproduce this. Could you please run this in gdb and post a backtrace?

Could you try to use the `names.rb` file from this branch and see if that fixes the issue? https://github.com/abs-tudelft/fletcher/tree/bad_alloc Thanks!

From the backtrace I see that somewhere deep down in the Arrow code its trying to allocate a very large array ``` 0x00007ffff5c694be in operator new (sz=18446744073709551608) at ../../.././libstdc++-v3/libsupc++/new_op.cc:54 ```...

If you add this line to `common/cpp/src/fletcher/arrow-utils.cc:244` ``` std::cout Read(file->GetSize().ValueOrDie()).ValueOrDie()->ToHexString()

That is weird. If the file were empty, I would expect the following error: ``` [ERROR]: Could not open RecordBatchFileReader. ARROW:[Invalid: File is too small: 0] ``` Just to be...

Sorry, I had the wrong line number there. Can you plug it in on line 236, just after: ``` std::shared_ptr file = result.ValueOrDie(); ```

Alright, thanks. The file looks to be loaded properly there... Could you please describe how you've built and/or installed Arrow? Thanks.

I'm afraid that I can't do much more than this without being able to reproduce the issue myself. If I were to be able to reproduce this, I would go...

This is due to the config string generating an extra bit for validity bitmaps that are not present on the command stream to array readers. There is a test for...