seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Feature][st-engine] Support for transform-v2 API

Open hailin0 opened this issue 2 years ago • 4 comments

Purpose of this pull request

Reference #2678

Release binary package: - Move engine starter jar from lib/ to starter/ dir - Outpout seatunnel-transforms-v2.jar to lib/ dir

Maven modules: - Add seatunnel-transforms-v2 module - Add seatunnel-transforms-v2-e2e module

Engine Starter: - Add lib/ to task execute classpath

ST-Engine: - Support for Split、Replace、Filter transform

E2E: - Copy seatunnel-transforms-v2.jar into container lib/ dir - Improve get project root path for e2e test module

Check list

  • [x] Code changed are covered with tests, or it does not need tests for reason:
  • [ ] If any new Jar binary package adding in your PR, please add License Notice according New License Guide
  • [ ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/incubator-seatunnel/tree/dev/docs

hailin0 avatar Oct 19 '22 14:10 hailin0

image

hailin0 avatar Oct 21 '22 09:10 hailin0

@EricJoy2048 @ashulin @Hisoka-X @ic4y @CalvinKirs tx. PTAL

hailin0 avatar Oct 24 '22 02:10 hailin0

@531651225 @TaoZex @TyrantLucifer @liugddx @laglangyue th. PTAL

hailin0 avatar Oct 24 '22 02:10 hailin0

@EricJoy2048 Are we should support repartition type transform in this version?

Hisoka-X avatar Oct 24 '22 09:10 Hisoka-X

@EricJoy2048 Are we should support repartition type transform in this version?

I suggest to add the support of repartition transform in the subsequent plans.

EricJoy2048 avatar Oct 31 '22 09:10 EricJoy2048