risingwave icon indicating copy to clipboard operation
risingwave copied to clipboard

reimplement elastic-search and open-search sink with rust sdk

Open wenym1 opened this issue 8 months ago • 0 comments

Is your feature request related to a problem? Please describe.

To support async truncation on es sink for https://github.com/risingwavelabs/risingwave/issues/17095, it's better to reimplement es sink with rust sdk, which provides async functionality.

Currently, though data is written with java sdk, the json index is already built with rust code, so there should not involve too much work of extra development.

elastic-search: https://docs.rs/elasticsearch/latest/elasticsearch/ open-search: https://docs.rs/opensearch/latest/opensearch/#structs

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

wenym1 avatar Jun 25 '24 07:06 wenym1