inlong
inlong copied to clipboard
[INLONG-5043][Manager] Add Apache Doris load node management
Prepare a Pull Request
- Fix #5043
Motivation
To surport the ability to Doris data integration, we need to add Apache Doris Load Node for management
Design
The design mainly follows the document Manager Plugin
- Add corresponding SinkType enumeration in enumeration type org.apache.inlong.manager.common.Enums.
- In org.apache.inlong.manager.common.Pojo.Sink,create folder path,create the corresponding entity class.
- In the org.Apache.Inlong.Manager.Service.Sink path, created under the corresponding tools
- Support data source to LoadNode conversion function, reference code org.Apache. Inlong.Manager.Service.Sort.Util.LoadNodeUtils
Implementation
- Add DORIS in enumeration type org.apache.inlong.manager.common.enums.SinkType
- Create folder "Doris" in org.apache.inlong.manager.common.pojo.sink, and create corresponding entity class:
- DorisSink
- DorisSinkDTO
- DorisSinkRequest
- DorisColumnInfo
- DorisTableInfo
- Create folder "doris" in org.apache.inlong.manager.service.sink and implement the class:
- DorisSinkOperator
- Add createLoadNode function in org.apache.inlong.manager.service.sort.util.LoadNodeUtils, it is like as follows:
public static DorisLoadNode createLoadNode(DorisSink dorisSink, List<FieldInfo> fieldInfos,
List<FieldRelation> fieldRelations, Map<String, String> properties){
\\TODO
}