inlong icon indicating copy to clipboard operation
inlong copied to clipboard

[INLONG-10195][Sort] Hudi connector support audit ID

Open XiaoYou201 opened this issue 1 year ago • 0 comments

Prepare a Pull Request

  • [INLONG-10195][Sort] Hudi connector support audit ID

  • Fixes #10195

  • Parent issue: https://github.com/apache/inlong/issues/8803

Motivation

Hudi connector not support audit function. So this pr will make it support audit function.

Modifications

Modify Hudi connector sink.when sinkreceive data, it will send audit information at same time.Some implement are as follows:

Program will get the audit information from the incoming sql statement and pass it to the StreamWriteFunction class. During StreamWrite , the program will report the number of data received. image

XiaoYou201 avatar May 16 '24 04:05 XiaoYou201