arrow-julia

arrow-julia copied to clipboard

Reported on discourse: https://discourse.julialang.org/t/how-well-apache-arrow-s-zero-copy-methodology-is-supported/59797/17?u=quinnj by @nilshg

quinnj

Support Arrow Flight RPC

7

quinnj

should be fairly straightforward built on top of C data interface

quinnj

Support C data interface

4

@sa- and I have started work in #178 and #179

quinnj

Implement C Data integration

2

This starts work towards supporting teh C data interface for the arrow format, as documented [here](https://arrow.apache.org/docs/format/CDataInterface.html#). Currently in this PR, it includes struct definitions and basic methods to allow getting...

quinnj

Invalid arrow file produced when writing partitioned with a dictionary-encoded column?

3

I was testing with writing partitioned data from Julia using Arrow.jl. When a column is dictionary-encoded it seems the resulting arrow file can not be read by PyArrow: ``` using...

paulmelis

quinnj

Does this pkg provide the plasma In-Memory Object Store?

2

Hello, just wondering if it's in like in the pyarrow package. https://arrow.apache.org/docs/python/plasma.html Thx!

mkschulze

error earlier when number of entries don't match across all fields

1

right now it throws confusing messages: ``` julia> Arrow.write(tempname(), df) ERROR: UndefRefError: access to undefined reference Stacktrace: [1] getindex @ ./array.jl:924 [inlined] [2] iterate @ ~/.julia/packages/Arrow/SFb8h/src/arraytypes/list.jl:171 [inlined] [3] Arrow.ToList(input::Arrow.ToList{Vector{Bool}, false,...

Moelf

Need to improve code review/release process and reduce developer productivity friction

9

In https://github.com/apache/arrow-julia/issues/284, I originally raised some concerns about the health and long-term maintainability of the package under the apache organization. Having let that sit for a while, I'm again raising...

quinnj