Andrew Duffy
Andrew Duffy
Oh I completely missed they got removed in this commit https://github.com/spiraldb/vortex/commit/0c4d74eb7afa359775493dea8d8de77841e727f5#diff-50c86b7ed8ac2cf95bd48334961bf0530cdc77b5a56f852c5c61b89d735fd711L31-L33
The failure is occurring in the `type` property accessor on `ArrowDtype`. I'm not familiar enough with Pandas internals to be sure, but my suspicion is that this if statement should...
I don't have permissions to add but this should include the Arrow label
https://github.com/apache/arrow-rs/blob/master/arrow-ord/src/rank.rs#L25-L48 Arrow does smallest by default, most do largest by default. In Arrow it's configurable
@claude is this true
The other thing that might be helpful is implementing [SparseScheme](https://github.com/vortex-data/vortex/blob/develop/vortex-btrblocks/src/integer.rs#L448) in the compressor for types other than Int.