cubefs
[Question]: who is the producer of topic(flink-task-app)?
What would you like to ask or discuss?
who is the producer of topic(flink-task-app)? i could't find the relevant code. main branch : \task-flink\src\main\java\com\oppo\cloud\flink\consumer\ConsumerMessage.java line 68 thanks
What would you like to ask or discuss?
who is the producer of topic(flink-task-app)? i could't find the relevant code. main branch : \task-flink\src\main\java\com\oppo\cloud\flink\consumer\ConsumerMessage.java line 68 thanks
The code is in the file https://github.com/cubefs/compass/blob/main/task-syncer/src/main/java/com/oppo/cloud/syncer/service/impl/TaskInstanceService.java#L109C39-L109C57.
What would you like to ask or discuss?
who is the producer of topic(flink-task-app)? i could't find the relevant code. main branch : \task-flink\src\main\java\com\oppo\cloud\flink\consumer\ConsumerMessage.java line 68 thanks
@yuehan-mm receiveFlinkTaskApp method is no longer used,we should delete this method later. receiveDsTaskApplication method is used to sync flink metadata,it consumes task-application topic data which is produced by LogParserServiceImpl.addTaskApplication method.
TaskInstanceService
@zebozhuang i konw this class. but it is writes to topic(task-instance), not flink-task-app
What would you like to ask or discuss?
who is the producer of topic(flink-task-app)? i could't find the relevant code. main branch : \task-flink\src\main\java\com\oppo\cloud\flink\consumer\ConsumerMessage.java line 68 thanks
@yuehan-mm receiveFlinkTaskApp method is no longer used,we should delete this method later. receiveDsTaskApplication method is used to sync flink metadata,it consumes task-application topic data which is produced by LogParserServiceImpl.addTaskApplication method.
thanks for replay @Yves-yuan
What would you like to ask or discuss?
who is the producer of topic(flink-task-app)? i could't find the relevant code. main branch : \task-flink\src\main\java\com\oppo\cloud\flink\consumer\ConsumerMessage.java line 68 thanks
@yuehan-mm receiveFlinkTaskApp method is no longer used,we should delete this method later. receiveDsTaskApplication method is used to sync flink metadata,it consumes task-application topic data which is produced by LogParserServiceImpl.addTaskApplication method.
This means the Flink resource diagnostic module can only work with scheduler (Airflow,DolphinScheduler etc) , is it right?
