arrow-julia icon indicating copy to clipboard operation
arrow-julia copied to clipboard

Arrow stream writer and reader implementation questions

Open schaefer01 opened this issue 1 year ago • 0 comments

I was using the python arrow function record_batch and find that this does not exist in julia, but there is an arrow table function. However they don’t behave the same way.

I have a customer requirement (that I can neither explain nor defend) of using arrow to make a stream writer and reader of io bytes rather than just use julia bytes This works using python arrows and batch_record batch = pa.record_batch([data_in],names=[‘f0’])

My question is, is the problem syntax (typing it wrong) or semantics (just not possible to do because functionality was not ported)?

my julia code is as follows: blksz = (32 * 1024)

A = rand(ComplexF16, blksz)

B = reinterpret(Float16, A)

C = reinterpret(UInt8, B)

tbl = Arrow.Table(C)

→ MethodError: no method matching open(::Base.ReinterpretArray{UInt8, 1, ComplexF16, Vector{ComplexF16}, false}, ::String

schaefer01 avatar Jul 10 '23 15:07 schaefer01