incubator-streampark icon indicating copy to clipboard operation
incubator-streampark copied to clipboard

remove 'mast have insert statement' limit

Open ziqiang-wang opened this issue 2 years ago • 5 comments

We don't mast write insert statement in flink sql job. Each Flink SQL statement is executed immediately and individually, with corresponding effects.

ziqiang-wang avatar Aug 01 '22 08:08 ziqiang-wang

@ziqiang-wang Are you saying that pure create statements can be committed select statements can also be committed

MonsterChenzhuo avatar Aug 08 '22 01:08 MonsterChenzhuo

@MonsterChenzhuo The results of the SELECT statement cannot be collected locally, so the platform does not support the SELECT statement yet. Each statement is executed immediately. For example, if the 'Create Hive Catalog' statement is written first and then the 'Create Table' statement is written, the metadata of the table will written to the Hive metadata.

ziqiang-wang avatar Aug 09 '22 04:08 ziqiang-wang

@ziqiang-wang He solved what pain point problem, I did not he understand his applicable scenario

MonsterChenzhuo avatar Aug 11 '22 07:08 MonsterChenzhuo

The current version requires an insert operation so that the job can run

wolfboys avatar Aug 11 '22 08:08 wolfboys

This change was not necessary, I just discovered this feature.

For example, I created the Hive Catalog, and then only run some create table statement. Then other tasks do not need to write create table statement, and directly write an INSERT statement to run the job, which can reduce the redundancy of create table statements in job development.

ziqiang-wang avatar Aug 12 '22 11:08 ziqiang-wang