rsyslog icon indicating copy to clipboard operation
rsyslog copied to clipboard

Add output support for AWS Kinesis

Open frankfarrell opened this issue 7 years ago • 10 comments

frankfarrell avatar Sep 17 '18 12:09 frankfarrell

Kinesis like all aws services works over a REST interface and records could be batched. Perhaps the most useful thing in general would be a general http output module and it should be easy enough to create a kinesis output based on that. I'd be very happy to contribute but I'm not much of a c programmer

frankfarrell avatar Sep 18 '18 09:09 frankfarrell

sounds like omhttp or omhttpfs contributed modules? https://github.com/rsyslog/rsyslog/tree/master/contrib

rgerhards avatar Sep 18 '18 09:09 rgerhards

Thanks for the pointer, I will try to get it to work!

frankfarrell avatar Sep 18 '18 09:09 frankfarrell

omhttp isn't listed in the 8.39 documentation. Has a release with omhttp been made yet? https://www.rsyslog.com/doc/v8-stable/configuration/modules/idx_output.html

darakian avatar Nov 09 '18 21:11 darakian

It's a contributed module, so it is included but that's it. It depends on users and contributors to grow.

HTH Rainer

Sent from phone, thus brief.

Am Fr., 9. Nov. 2018, 22:10 hat Jon Moroney [email protected] geschrieben:

omhttp isn't listed in the 8.39 documentation. Has a release with omhttp been made yet? https://www.rsyslog.com/doc/v8-stable/configuration/modules/idx_output.html

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/rsyslog/rsyslog/issues/3024#issuecomment-437496064, or mute the thread https://github.com/notifications/unsubscribe-auth/ABadi6ZUoTSLLC5kyPasq0VdhHoLuyskks5ute8qgaJpZM4WrxYF .

rgerhards avatar Nov 09 '18 21:11 rgerhards

Is there documentation on using omhttp available anywhere? If so where would I find it?

darakian avatar Nov 13 '18 17:11 darakian

I would suggest contacting the original contributor @ctramnitz, see https://github.com/rsyslog/rsyslog/pull/2782

If there is someone willing to add documentation, I can help with some basic information on the module (based on what I can see in the source), but I really have no idea what exactly it does and what the use case is. But note that I really would like to have someone contribute the doc if I look into it.

@PascalWithopf would you be willing to add a small page with whatever little you know about the module? It should state that the page is incomplete, but maybe that motivates future contributors...

rgerhards avatar Nov 21 '18 16:11 rgerhards

@rgerhards I added a basic documentation.

ghost avatar Nov 22 '18 08:11 ghost

I added a basic documentation.

Where's that, then?

bby-bishopclark avatar Jul 03 '19 23:07 bby-bishopclark

I added a basic documentation.

Where's that, then?

For anyone looking - it is now here: https://www.rsyslog.com/doc/configuration/modules/omhttp.html

I have yet to try it out with Kinesis, though.

guss77 avatar May 06 '25 14:05 guss77