arrow-julia

arrow-julia copied to clipboard

Question on `Date` encoding

10

I'm trying to use Arrow to send data between a Julia (Arrows.jl) and a Rust (Polars) app. However, when I write a table containing Date, it is read by Polars...

simsurace

I'm so glad someone implemented Arrow for Julia. Thanks! And I think the intro to the User Manual is the clearest I've come across to help understand the what and...

bdklahn

Store ZDT with a UTC, not local, timestamp

2

Closes #327 This changes the representation of zone-aware datetimes to store a UTC timestamp + zone. Previously Arrow.jl used the _local_ timestamp + zone, which leads to ambiguity failures around...

tpgillam

xref: https://github.com/JuliaCloud/AWSS3.jl/issues/263 The fix seems to be change `::Type{Union{Missing, T}}` to `::Type{

palday

DST ambiguities in ZonedDateTime not supported

3

It seems like the ArrowTypes representation of ZonedDateTime doesn't include enough information to resolve ambiguities around DST, e.g.: ```julia julia> zdt = ZonedDateTime(DateTime(2020, 11, 1, 6), tz"America/New_York"; from_utc=true) 2020-11-01T01:00:00-05:00 julia>...

tpgillam

hi :) as indicated in the Tables.jl docs, for large dataframes (>10k columns), Tables.Schema stores its values in .storenames and .storedtypes instead of the type parameters. This needs to be...

0xYUANTI

I'm loading a table from feather file in a straightforward way ``` df = filename |> Arrow.Table |> DataFrame ``` and attempting to filter it based on the values of...

markmbaum

@kleinschmidt and I came up with ```julia using Arrow: ArrowTypes macro arrow_record(T1) T = esc(T1) name = :(Symbol("JuliaLang.", @__MODULE__, ".", string(parentmodule($T), '.', nameof($T)))) return quote ArrowTypes.arrowname(::Type{$T}) = $name ArrowTypes.ArrowType(::Type{$T}) =...

ericphanson

Hey 👋 `(U)Int128` are currently serialized by setting the `bit_width=128`. That works perfectly fine with Julia, but as soon as serialized arrow batches are read from another language, such as...

bachdavi

Change scoped enums behavior

7

Implement suggestions for https://github.com/apache/arrow-julia/issues/308

jonalm