Support fluent protocol consumer

[salekseev]

Please add support for fluent protocol consumer based on https://github.com/fluent/fluentd-forwarder

[arnecls]

Do you simply want to read the data from the fluentd protocol or do you want to forward them? To forward the messages (without modifications) you could use a socket consumer + producer. If you want to just read+decdode messages to put them somewhere else I'm wondering a bit about the usecase as fluentd's architecture is very similar to gollum (as far as I can see).

[salekseev]

I would like to be able to read data in fluent format, decode and put them into kafka to be able to replace fluentd with gollum without changing applications code as a single compiled binary (gollum) is much easier to deploy to hosts. Also docker natively supports fluent protocol for it's logs (https://docs.docker.com/engine/admin/logging/fluentd/), this way gollum could also be used to collect logs from containers.

[arnecls]

Sounds like a valid point. As with the other 0.5.0 scheduled issues this will be implemented after the rework has finished (which we are actually quite close to). If anyone is willing to do that for the 0.4.5 branch I would be very grateful.

[salekseev]

Just wanted to share another example of using the code at https://github.com/sensorbee/fluentd/blob/master/source.go