Kustomize base for fluent-bit

[solsson]

I've gone through the PRs filed since I participated in early yaml work here, and unsurprisingly the duplication is a maintenance problem. I think Kustomize is a good fit for eleminating that duplication.

Log processing is prone to heavy customization. I see a few use cases for this repo:

• Examples of how to run in Kubernetes.
• A quick start for common dev environments.
• A base for actual production setups, where key parts are overridden with in-house config.

A Kustomize base that in itself isn't functional is a good start for all three of them. Operators and stack-specific helm charts like Grafana's may be more widely used for production, but if we can avoid duplication in this repo it IMO offers a straightforward way for the community to share experiences.

[solsson]

I find the test-logger deployment from https://github.com/GoogleCloudPlatform/community/tree/master/tutorials/kubernetes-engine-customize-fluentbit really useful for developing a pipeline.

[solsson]

Work is complete, but obviously needs validation by others. A merge to master would affect online docs which I suppose is quite an undertaking.

It's been interesting to see how far across blogs and helm charts my early yaml from this repo has proliferated. For example when researching I've seen the unconventional volume name varlogcontainers in many places and the mistaken duplicate "wildcard tolerations" quite a few times :smile:.

I think this PR meets its three goals (above). I'll keep it as default branch in https://github.com/Yolean/fluent-bit-kubernetes-logging for easy access to example yaml, regardless if some of this work is merged or not. We're upgrading our production setup, which had degraded quite a bit, to use the online base.