Add HPA support to Fluentd

[kaiohenricunha]

Is your feature request related to a problem? Please describe.

Scaling Fluentd is done manually up to now.

When traffic increases quickly, Fluentd CPU and memory usage can overwhelm the pod(s).

Describe the solution you'd like

Be able to easily enable auto scaling like this.

Additional context

HPA for StatefulSets is now supported:

https://kubernetes.io/docs/tasks/run-application/horizontal-pod-autoscale/

[husnialhamdani]

Hi @benjaminhuo, What to changes here, is it modifying the Helm chart of Fluentd? Could you please advise?, Thanks.

[benjaminhuo]

Hi @benjaminhuo, What to changes here, is it modifying the Helm chart of Fluentd? Could you please advise?, Thanks.

@husnialhamdani Possibly we need to add HPA spec in FluentdSpec and create/update/delete HPA resources accordingly in Fluentd controller.

@wanjunlei What do you think?