incubator-streampark
incubator-streampark copied to clipboard
apache
[Task Scheduling] Support scheduling database SQL
Search before asking
- [X] I had searched in the feature and found no similar feature requirement.
Description
At present, the landing scenarios of Flink are limited. Batch processing still requires the help of database SQL and other technologies. It is expected that the scheduled scheduling function of database SQL can be added.
Usage Scenario
No response
Related issues
No response
Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
Hi @ChenpiDog , I'm sorry, I don't understand your mean:Batch processing still requires the help of database SQL and other technologies..
Do you want to schedule your Flink Batch job with other scheduling frameworks? If yes, you can follow this issue. #640
@1996fanrui It is hoped that streampark can schedule database sql to achieve unified scheduling and management of batch tasks and stream processing tasks, otherwise, additional tools such as airflow will have to be used.
Hi @ChenpiDog , I'm sorry, I don't understand your mean:
Batch processing still requires the help of database SQL and other technologies..Do you want to schedule your Flink Batch job with other scheduling frameworks? If yes, you can follow this issue. #640
I mean that the batch processing capability of flink is limited, and the database sql used in production does batch processing.