inlong
inlong copied to clipboard
Apache InLong - a one-stop, full-scenario integration framework for massive data
### Describe the proposal The Manager component uses SDK to execute processes for different services, like Pulsar/Kafka/Elasticsearch... Using SDK will cause many dependencies, and we could modify the calling method...
### Description DataInlong wants to support more sources and sinks in 2024. DMV8 cdc connector is a new cdc connector which is tested but still needs more finetuning. it has...
### Description Dameng connector inlong manager and inlong common changes ### Use case _No response_ ### Are you willing to submit PR? - [X] Yes, I am willing to submit...
### Description Add ElasticSearch connector on Flink 1.15 ### Use case Add ElasticSearch connector on Flink 1.15 ### Are you willing to submit PR? - [X] Yes, I am willing...
### What happened According to the official website, "Data Nodes" should include "Extract Nodes" and "Load Nodes". However, when creating the "Ingestion" task, data nodes cannot be selected on the...
### Description Doris full database migration missing audit data  ### InLong Component InLong Sort ### Are you willing to submit PR? - [ ] Yes, I am willing to...
### Description - Different sink types correspond to different audit IDs, so the `Manager` will send this ID to `Sort`, but some sort-connectors do not support the use of this...
### What happened When I used Elasticsearch as the data node, the configuration process encountered the following error: [ ] 2023-11-07 08:19:08.132 - INFO [inlong-mq-process-0] a.i.m.s.r.s.e.ElasticsearchApi:166 - create test_pulsar_table_es:true [...
[Improve][Sort] Errors in UT test logs for sort-end-to-end-tests, but UT results show as successful
### Description - Case 1 https://github.com/apache/inlong/actions/runs/7081425279/job/19270686450  - Case https://github.com/apache/inlong/actions/runs/7081189588/job/19270165431?pr=9395  Errors in UT test logs for sort-end-to-end-tests, but UT results show as successful. ### InLong Component InLong Sort ###...
### Description Support write watermark in the snapshot. Many thanks to @XuQianJin-Stars for his contribution  ### Use case _No response_ ### Are you willing to submit PR? - [X]...