inlong

inlong copied to clipboard

[Feature][Dashboard] Batch Data Stream Management

2

### Description _No response_ ### Use case _No response_ ### Are you willing to submit PR? - [ ] Yes, I am willing to submit a PR! ### Code of...

dockerzhang

[Feature][Dashboard] Refactor format configuration interface of InlongStream

2

### Description The formats supported by each storage are different, and the configuration items of each format are also different. For the convenience of configuration: 1. The format is selected...

featzhang

[Feature][Agent] Provides hierarchical guarantee capacity

3

### Description When use agent to collect data, such as File Agent. There are multi collection tasks in an Agent process, but the importance of each task is different. when...

wangpeix

[Feature][Agent] Support filter function

3

### Description When some data is not needed, there is no need to send to downstream. So, the Agent may need to support discarding some unwanted data. ### Use case...

wangpeix

[Feature][Manager] Support data is sent by Key

1

### Description Support data is sent by key. For example, agent can send by key to mq. and sort can send by key to es. ### Use case _No response_...

wangpeix

[Feature][Dashboard] Support all configrations and cascading of MQ format

1

### Description The MQ message format in the Stream configuration is planned to be modified to the cascading mode, and the corresponding configuration parameters will pop up when the user...

featzhang

[Feature][Manager][Sort] Resource adaptive adjustment for Hudi

1

### Description Hudi flink jobs often have unreasonable resource allocation. Too much allocation will lead to a waste of resources, and too little will lead to back pressure or OOM....

featzhang

[Feature][Sort] Adjust sort resources according to data scale

1

### Description Currently, the total amount of resources for the Flink Sort Job comes from the configuration file `flink-sort-plugin.properties`, so all submitted sort jobs will use the same amount of...

featzhang

[Feature][Sort] Support TiDB

1

### Description Support TiDB ### Use case _No response_ ### Are you willing to submit PR? - [X] Yes, I am willing to submit a PR! ### Code of Conduct...

chestnut-c

[Feature][SortStandalone] Complete depolyment docs

1

### Description _No response_ ### Use case _No response_ ### Are you willing to submit PR? - [X] Yes, I am willing to submit a PR! ### Code of Conduct...

vernedeng