vortex
vortex copied to clipboard
A toolkit for working with compressed array data
We should support converting between strict sorted integers and boolean masks. We may need an array type to go in both directions? This could allow us to remove the RoaringUInt...
Right now when creating Bytes based buffers we lose the alignment information. There has been no movement on issue to allow this https://github.com/tokio-rs/bytes/issues/437 which would mean that unless allocator_api is...
Currently the chunks in a ChunkedArray mean something different from the atomic serialized chunks. I propose we call the latter "batches", akin to record batches except with no requirement to...
In ChunkedArray, there's a leading zero so it's a little confusing.
Currently "filter_indices", but applies a predicate and returns a boolean.
I notice that the `map` type does not appear in the `Logical Types`, do we have some plan of it?
We currently implement naive serde using Rust serde + flexbuffers by default. Many arrays can pack their metadata much more tightly. This is an overview issue to track auditing each...