databend icon indicating copy to clipboard operation
databend copied to clipboard

Tracking: catalog for stage/location special data source

Open BohuTANG opened this issue 2 years ago • 4 comments

Summary

Some cases make the databend as a query engine from different data sources:

Case 1:

SELECT parse_json($1) FROM @stage/@location

Case 2:

COPY INTO <t1> SELECT parse_json($1) FROM @stage/@location

Before this work is done, these issues will be blocked:

  • [ ] https://github.com/datafuselabs/databend/issues/7228 (cc @ariesdevil )
  • [ ] https://github.com/datafuselabs/databend/issues/7211 (cc @doki23 )
  • [ ] https://github.com/datafuselabs/databend/issues/6395 (cc @RinChanNOWWW )
  • [ ] https://github.com/datafuselabs/databend/issues/7323
  • [ ] https://github.com/datafuselabs/databend/issues/6345 (cc @Xuanwo)

BohuTANG avatar Sep 06 '22 08:09 BohuTANG

cc @sundy-li @zhang2014

BohuTANG avatar Sep 06 '22 08:09 BohuTANG

I'm thinking of doing it in #7211. But it's great if someone more familiar with meta will take this issue.

doki23 avatar Sep 06 '22 11:09 doki23

I'm thinking of doing it in #7211. But it's great if someone more familiar with meta will take this issue.

Thanks for the syncing, @dantengsky is more familiar with it. He plans to give some details or some work about it.

BohuTANG avatar Sep 06 '22 12:09 BohuTANG

@doki23 @BohuTANG

I am doing some POC works now, hopefully PR will be opened soon... :)

dantengsky avatar Sep 07 '22 02:09 dantengsky