amazon-managed-service-for-apache-flink-examples icon indicating copy to clipboard operation
amazon-managed-service-for-apache-flink-examples copied to clipboard

Add an Apache Paimon CDC Ingestion using MSF Example

Open Moonlight-CL opened this issue 8 months ago • 2 comments

Purpose of the change

*Add an Example of Apache Paimon CDC Ingestion using MSF *

Verifying this change

  1. Tested on Managed Service for Apache Flink

Significant changes

  • [x] Completely new example
  • [ ] Updated an existing example to newer Flink version or dependencies versions
  • [ ] Improved an existing example
  • [ ] Modified the runtime configuration of an existing example (i.e. added/removed/modified any runtime properties)
  • [ ] Modified the expected input or output of an existing example (e.g. modified the source or sink, modified the record schema)

Moonlight-CL avatar Mar 17 '25 02:03 Moonlight-CL

Does this work on Amazon Managed Service for Apache Flink? I see the readme mention "copying hive-site.xml from your EMR cluster. Flink on EMR is a different service. This repo is exclusively about Managed Service for Apache Flink

nicusX avatar Apr 03 '25 17:04 nicusX

Does this work on Amazon Managed Service for Apache Flink? I see the readme mention "copying hive-site.xml from your EMR cluster. Flink on EMR is a different service. This repo is exclusively about Managed Service for Apache Flink

Hi nicuX, Yes, this works on Amazon Managed Service for Apache Flink(MSF), if we want to sync Paimon meta data to Glue Data Catalog , we need copy hive-site.xml to project, Paimon Hive Catalog will read connection info from this xml file.

Moonlight-CL avatar Apr 04 '25 09:04 Moonlight-CL