Phillip Cloud
Phillip Cloud
So, I guess the current state is that you cannot: 1. stream out record batches of temporary objects 2. process those batches in Python 3. insert the processed batch back...
Just tried with https://pypi.org/project/duckdb/1.0.1.dev167/ and I'm seeing the same results.
Probably, I'm not sure what the original motivation was for their use.
> I am curious about the use of negative lags - would it be possible to perform the desired operations by using a positive lag and swapping the semantics of...
Tried out 861cbbc and I see around a 6x improvement for positive lags, great work!
@cosmicBboy Hey 👋🏻! This looks pretty interesting! Is there anything we can do over in ibis to help enable this? Happy to help!
@tswast Out of curiosity are there any performance concerns here? Exact count distinct is already expensive, but just curious if the overhead of string encoding would show up here for...
Thanks for really digging in here, the analysis is much appreciated. I'm inclined to merge this as is after review and address performance concerns as they arise. I suspect we...
> > Thanks for really digging in here, the analysis is much appreciated. I'm inclined to merge this as is after review and address performance concerns as they arise. >...
The workaround sounds good to me. I think that can be done in a follow up! @ssabdb If you're feeling up for that, would be greatly appreciated!