eventmesh icon indicating copy to clipboard operation
eventmesh copied to clipboard

[Feature] Integrate milvus as one of eventmesh connector plugin

Open xwm1992 opened this issue 1 year ago • 6 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

Feature Request

We can implement milvus source/sink connector in eventmesh-connectors module.

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

xwm1992 avatar Jun 26 '23 02:06 xwm1992

plz assign me, i want to try it, and pull request in the future.

pmupkin avatar Jun 26 '23 03:06 pmupkin

plz assign me, i want to try it, and pull request in the future.

welcome and looking forward your pr.

xwm1992 avatar Jun 26 '23 03:06 xwm1992

@pmupkin Hi! May I kindly inquire about the current progress? Your update would be greatly appreciated. Thank you!

Pil0tXia avatar Jan 10 '24 10:01 Pil0tXia

@pmupkin Hi! May I kindly inquire about the current progress? Your update would be greatly appreciated. Thank you!

Now, Milvus doesn't fully support CDC yet. There's no JDK implementation for Java, and the support on their website isn't enough to get the source working. The sink part is done, but I'm waiting to finish the source before pushing both together. Of course, If you know the relateive information about milvus-cdc, plz let me know. @Pil0tXia

pmupkin avatar Jan 10 '24 15:01 pmupkin

@pmupkin That's great! You may go ahead and submit the sink connector to let the community understand your design. This will also make it easier to assess whether we need to implement the Milvus source connector.

Pil0tXia avatar Jan 10 '24 18:01 Pil0tXia

@Pil0tXia I've learned about some progress on Milvus-CDC. I'll try to implement Milvus source as soon as possible and push it together shortly

pmupkin avatar Jan 20 '24 03:01 pmupkin