Zongwen Li

Results 52 comments of Zongwen Li

> @ashulin hi, is it possible to identify the source of meta data in the schema definition and treat it as a normal field,Load when it needs to be processed...

Results of online meeting discussions: Using tools to standardize commit message(e.g. git hook)

IMO, add a catalog storage to save the **options** of the [CatalogFactory](https://github.com/apache/incubator-seatunnel/blob/dev/seatunnel-api/src/main/java/org/apache/seatunnel/api/table/factory/CatalogFactory.java) We can directly use CatalogFactory to verify the correctness of the options

The current plugin configuration has some custom handling, which may be related to the issue;

The format might need to be like this ```json { "env": { "spark.app.name": "SeaTunnel", "spark.executor.instances": 2, "spark.executor.cores": 1, "spark.executor.memory": "1g" }, "source": [{ "Fake": { "result_table_name": "my_dataset", "plugin_name": "Fake" }...

`org.apache.seatunnel.api.table.factory.Factory` can be used directly, this can also support the options of catalog and format. (can see https://github.com/apache/incubator-seatunnel/issues/2490), I think this is necessary. **Discover the existing source, sink, and catalog**...