starrocks-kubernetes-operator
starrocks-kubernetes-operator copied to clipboard
Enhance CREATE PIPE to process INSERT Select from starrocks tables as well
CREATE PIPE is awesome help to load data from s3 compatible object storage. It basically processes INSERT SELECT from FILES. An enhancement to it to allow INSERT SELECT form TABLES/VIEWS would make starrocks very powerful and cater to 10x times use cases in implementing systems like Data Vault 2.0 data warehouses.
Please consider this at a priority as high as possible.
I believe you can already do this. https://docs.starrocks.io/docs/loading/InsertInto/#insert-data-via-insert-into-select
Hi Albert, I'm asking for a PIPE for it. CREATE PIPE ..INSERT ...SELECT ..from <starrocks table/view> is not supported currently.
CREATE PIPE ..INSERT ...SELECT ..from FILES(
On Sun, Dec 24, 2023 at 6:12 PM Albert T. Wong @.***> wrote:
I believe you can already do this. https://docs.starrocks.io/docs/loading/InsertInto/#insert-data-via-insert-into-select
— Reply to this email directly, view it on GitHub https://github.com/StarRocks/starrocks-kubernetes-operator/issues/382#issuecomment-1868609549, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALQ7IASN5HMBKTSMAD574GLYLCZG7AVCNFSM6AAAAABBBIPAJ6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNRYGYYDSNJUHE . You are receiving this because you authored the thread.Message ID: @.***>
Since PIPE just got released in 3.2, it may take another release for this feature to be implemented.
Thanks for being on it. Can you give a date so I can plan my development around it.
Since StarRocks is a community project, dates come from the committers and vendors who write code for the project.
Hello, I am not sure if the latest version of StarRocks has resolved your issue. If it hasn't been resolved, I suggest you can go to https://github.com/StarRocks/starrocks and raise this issue again. Because this project is the StarRocks Kubernetes Operator, it mainly deals with issues related to deployment and Kubernetes. @AsaiWiz