inlong
inlong copied to clipboard
[INLONG-10195][Sort] Hudi connector support audit ID
Prepare a Pull Request
-
[INLONG-10195][Sort] Hudi connector support audit ID
-
Fixes #10195
-
Parent issue: https://github.com/apache/inlong/issues/8803
Motivation
Hudi connector not support audit function. So this pr will make it support audit function.
Modifications
Modify Hudi connector sink.when sinkreceive data, it will send audit information at same time.Some implement are as follows:
Program will get the audit information from the incoming sql statement and pass it to the StreamWriteFunction class. During StreamWrite , the program will report the number of data received.