vortex
vortex copied to clipboard
A toolkit for working with compressed array data
And PyPi
Similar to special-casing validity, we can special-case indices to something like this: ```rust enum Indices { Stride(...), Ranges(...), Array(ArrayRef), } ``` This would then be passed as an argument to...
E.g., `cargo +nightly miri test -p vortex-array` Won't work for `enc-alp` or any other crate that makes function calls via FFI, but still worth verifying the "core" module(s)
Pull what we want to expose into vortex::* or a prelude
Rather than row-groups as we do now
Right now we always get optional iterator, however, the optional value can be elided if we know the type is non nullable.
We need to decide to what level of fidelity we want to enforce alignment. Currently, we enforce nothing but then occasionally run into interop issues with Arrow. To work around...