databend icon indicating copy to clipboard operation
databend copied to clipboard

Feature: Introduce a new `PipelineContext` for each pipeline

Open leiysky opened this issue 3 years ago • 2 comments

There was a discussion about this in https://github.com/datafuselabs/databend/issues/741.

The shared and local QueryContext is not clear, we'd better extract the local information(e.g. partition info) to a pipeline-local PipelineContext.

leiysky avatar May 23 '22 09:05 leiysky

cc @BohuTANG @sundy-li @zhang2014

leiysky avatar May 23 '22 09:05 leiysky

Our goal is to move the state into the processor. Including "partition info", which has been implemented in some table engines.

By the way:

  • QueryContext: one-to-one with sub queries.
  • QueryContextShared: shared for sub queries in one query

for example: SELECT (SELECT 1) FROM table, in this case SELECT 1 has a QueryContext, SELECT (SELECT 1) FROM table has a QueryContext, They share a QueryContextShared

zhang2014 avatar May 23 '22 11:05 zhang2014