project-website icon indicating copy to clipboard operation
project-website copied to clipboard

Published 20 hours ago • verified publisher icon opensearch-project

Kafka Connect for OpenSearch Integration

Open jaehyeon-kim opened this issue 1 year ago • 1 comments

Describe the blog post your would like to write We will discuss how to develop a data pipeline that ingest data from Kafka topics into OpenSearch using Kafka Connect. In Part 1, I will illustrate local development using Docker while it'll be deployed to AWS using Amazon MSK and Amazon OpenSearch Service in part 2.

What is the title of the blog post?

Ingest data from Kafka into OpenSearch using Kafka Connect

  • Part 1 - Local Development
  • Part 2 - AWS Deployment

Who are the authors?

What is the proposed posting date?

  • Part 1 - Late September 2023
  • Part 2 - Mid to Late October 2023

jaehyeon-kim avatar Aug 17 '23 23:08 jaehyeon-kim

Hi @pajuric

I created a PR for initial discussion - https://github.com/opensearch-project/project-website/pull/2198

Currently it only includes part 1 and part 2 can be added shortly.

BTW I was not able to check the post on the development server (docker-compose) due to the following error. Can you inform me how to fix it?

image

Cheers, Jaehyeon

jaehyeon-kim avatar Sep 23 '23 19:09 jaehyeon-kim