Thor

Thanks! Sorry I missed the previous message, I'll dig into this more. Do you have a profile you can share with this high memory usage? Can upload to [pprof.me](https://pprof.me)

Also, could you send the commit sha you're running on, and the flags you're using to run it?

Closing this issue as I believe much of the memory pressure has been resolved by various improvements since this issue. Please re-open with additional information if you're able to recreate...

Closing as I believe this has been addressed with many changes, notably the new index.

I tried, but it ended up being more of a can of worms since our aggregations don't work at concurrency 1. And in testing in prod I ran into additional...

Removing stale because this is still currently broken.

Closing this in favor of #769

Updating it to slice the records instead of marking full rows as null ``` name old time/op new time/op delta FilterData-10 5.00ms ± 2% 0.39ms ± 2% -92.13% (p=0.000 n=10+10)...

Sorry, apparently fat fingered the close button. I played around with this today ```go func filter(ctx context.Context, pool memory.Allocator, filterExpr BooleanExpression, ar arrow.Record) (arrow.Record, bool, error) { bitmap, err :=...

Yea and link it here so we know if/when we can actually implement this.