seatunnel [Discuss][RoadMap] SeaTunnel Q4 RoadMap

Hi everyone. Here we can discuss the roadmap of SeaTunnel in Q4.

SeaTunnel API & SeaTunnel Connector

[ ] CDC Connector MySQL https://github.com/apache/incubator-seatunnel/issues/2394
[x] Transform API https://github.com/apache/incubator-seatunnel/issues/2678
[ ] Transform V2 Flink Translation
[ ] Transform V2 Spark Translation
[ ] Database Synchronization Connector (batch mode)
[ ] More Source & Sink & Transform Connector https://github.com/apache/incubator-seatunnel/issues/3018
[ ] Support Connector Metrics
[ ] Support TableSourceFactory and can get the Connector Option Rules.
[ ] Support TableSinkFactory and can get the Connector Option Rules.

SeaTunnel Web Server

submodule: https://github.com/apache/incubator-seatunnel-web

[x] #3374
[ ] Release MVP version, and improve the fellings.

SeaTunnel Engine

[x] Release MVP version
[x] Support Transform Action
[x] Support EventType API(For CDC connector we need know Update/Insert/Delete type)
[ ] Run on k8s
[x] Performance testing & Performance optimization
[ ] Support IMap Storage By JDBC #3870
[ ] #3871

Spark/Flink new version support

[x] #2733
[ ] Support Spark3 https://github.com/apache/incubator-seatunnel/issues/2189
[ ] Support Flink 1.15.X https://github.com/apache/incubator-seatunnel/issues/2927

Sep 14 '22 10:09 EricJoy2048

Improve end-to-end testing of connector-v2 in a multi-engine environment; Now developers need to write a lot of repeated code to test different engines, if we support more version engine, this will generate more repeated test code;

Sep 14 '22 10:09 ashulin

SeaTunnel Web Server: Release MVP version, and improve the fellings.

Sep 14 '22 11:09 dijiekstra

@ashulin @CalvinKirs How about storage Snapshot by JDBC?

Sep 15 '22 08:09 EricJoy2048

Support Flink 1.15.X #2927

Oct 24 '22 01:10 liugddx

Run on k8s is anyone working on this, if not, I think I can make it happen

Nov 23 '22 16:11 MonsterChenzhuo

Support Cache between source and sink What are the requirements for this feature ？ up to now ， ST Connector is mostly BatchMode ,Is this Feature for in case Sink Speed Less Than Source？ if so， Control Source Speed can solve it with low memory use。 @EricJoy2048