Migrating to the Arrow mono-repo

[pdeffebach]

Discussion on discourse here indicated that there is nothing stopping us in theory from having all code live in Apache Arrow's mono-repo but have the Julia package be a subset of that.

Is there a plan to make that the case? It would be nice for Julia's data-frame saving package be backed by a funded organization that hopes to ensure cross-platform use.

[aschmu]

Yes I think this is very important as dataframes doesn't yet have an implementation as efficient in Julia as you'd find in R (via data.table or dplyr) or python via pandas. It would probably good to develop an alternative dataframe library backed by arrow that would be columnar by design and hence much more suited for high performance analytics. Given Julia's succint syntax, it could be a first class citizen for data munging in a way that python couldn't given its metaprogramming abilities.