Adam Faulkner comments

Results 5 comments of


                                            Adam Faulkner

panic in `push_down_filter`

Hi, I think you need to apply the same fix as https://github.com/delta-io/delta-rs/pull/2604 for `DeltaTableProvider`.

Merge is slower than expected and loads more than expected into memory.

Thanks for the reply @ion-elgreco , why does it need to scan the entire table into memory before it starts writing data? Is this just a lack of optimization, or...

Merge is slower than expected and loads more than expected into memory.

> It needs to scan the entire table because it needs to find out which rows the merge into condition applies to. I understand this. However, it doesn't need to...

Merge is slower than expected and loads more than expected into memory.

To answer my own questions here: > why does it need to scan the entire table into memory before it starts writing data `MergeBarrier` holds on to all records for...

Previously valid queries now fail with "does not satisfy parent distribution requirements: SinglePartition"

Hello! I actually have a fix now: https://github.com/delta-io/delta-rs/pull/2830