tremor-runtime icon indicating copy to clipboard operation
tremor-runtime copied to clipboard

Use official elasticsearch rust client for elastic offramp

Open anupdhml opened this issue 5 years ago • 4 comments
trafficstars

There's an official elasticsearch rust client now: https://github.com/elastic/elasticsearch-rs

It's still in alpha but should be sufficient for our bulk indexing use in the elastic offramp. Looks to be more actively maintained than the client we use currently, and will help with issues like https://github.com/wayfair-tremor/tremor-runtime/issues/408.

anupdhml avatar Aug 31 '20 15:08 anupdhml

Hello, I'm going to give this a try, it looks like that can be done by following rustc errors so it will probably be good for getting familiar with the code

SpyrosRoum avatar Mar 12 '21 08:03 SpyrosRoum

Awesome, that'd be great :). If you've any questions or run into problems feel free to ping any of us on discord (or here)

Licenser avatar Mar 12 '21 09:03 Licenser

As a note, we're looking into extending functionality for delete and update on the sink/offramp so it'd be great to have those in a refresh as well :)

Licenser avatar Mar 12 '21 09:03 Licenser

That's good to know. I currently have some issues because I don't know how elasticsearch works and its concepts but once I get past that I'll what I can do about expanding the functionality!

SpyrosRoum avatar Mar 12 '21 10:03 SpyrosRoum

We use the official client now.

mfelsche avatar Sep 21 '22 07:09 mfelsche