electric icon indicating copy to clipboard operation
electric copied to clipboard

Avoid holding whole transaction in consumer memory

Open robacourt opened this issue 2 months ago • 0 comments

Part of #3413 and following on from #3414 . The consumer only buffers when the shape depends on subqueries. If the shape does not depend on subqueries, changes are written straight to storage. Storage will also need to be informed of the commit so that it can calculate chunk boundaries.

robacourt avatar Nov 11 '25 09:11 robacourt