Nicholas Gates

Results 138 comments of Nicholas Gates

Not sure what you're suggesting @robert3005 ? I think I agree with @a10y that we can treat bloom filters specially? The problem we may have is that LayoutReaders are a...

Random access is quite a big regression too. I would have expected the opposite. Is that also the same thing as clickbench regressions?

You should be able to use [this function](https://docs.rs/vortex-file/0.53.0/vortex_file/struct.VortexWriteOptions.html#method.writer) to create a push-based Writer. You can then flush your own `Write` object as you wish. Does that help? Note that this...

That's a very good point... It's not possible with our current logic to grab hold of the writer in the middle to flush it. We may need to change the...

Apologies, I didn't realise folks were making use of the Python bindings! I will bring back this behaviour. Note also there have been other breaking changes to the Python API,...

To be a little more helpful, `vortex.io` is now a Python package, and therefore you need to import it as `from vortex import io` or `import vortex.io; vortex.io.blah(...)` `import vortex;...

I actually want to fix this so that `import vortex; vortex.io` works. I think I prefer it vs the current Python package model where you must separately import the io...

I'm assuming this is Vortex Python? I don't believe there's an easy function exposed at the moment (would be trivial to add) to convert between RecordBatch and Vortex Array. Longer...