fluent-bit icon indicating copy to clipboard operation
fluent-bit copied to clipboard

Retrieve Kubernetes pod IP address if it is set in status.podIP

Open kgtw opened this issue 5 years ago • 23 comments

This PR exposes the Kubernetes pod IP address if it has been set.

Fixes: https://github.com/fluent/fluent-bit/issues/2301


Enter [N/A] in the box, if an item is not applicable to your change.

Testing Before we can approve your change; please submit the following in a comment:

  • [ N/A ] Example configuration file for the change
  • [ N/A ] Debug log output from testing the change
  • [ N/A ] Attached Valgrind output that shows no leaks or memory corruption was found

Documentation

  • [ N/A ] Documentation required for this feature

Fluent Bit is licensed under Apache 2.0, by submitting this pull request I understand that this code will be released under the terms of that license.

kgtw avatar Nov 18 '20 00:11 kgtw

@edsiper @fujimotos @koleini any chance of getting a review on this?

kgtw avatar Feb 04 '21 09:02 kgtw

This PR is stale because it has been open 45 days with no activity. Remove stale label or comment or this will be closed in 10 days.

github-actions[bot] avatar Mar 23 '21 02:03 github-actions[bot]

@edsiper @fujimotos @koleini ?

kgtw avatar Mar 23 '21 08:03 kgtw

This PR is stale because it has been open 45 days with no activity. Remove stale label or comment or this will be closed in 10 days.

github-actions[bot] avatar Apr 27 '21 01:04 github-actions[bot]

@edsiper @fujimotos @koleini any chance of getting a review on this?

kgtw avatar Jul 29 '21 16:07 kgtw

@kgtw thanks for such useful improvement, I hope it will be reviewed and merged.

artemlive avatar Aug 06 '21 14:08 artemlive

This PR is stale because it has been open 45 days with no activity. Remove stale label or comment or this will be closed in 10 days.

github-actions[bot] avatar Oct 06 '21 01:10 github-actions[bot]

Can we get some response about this PR? It's something really needed for fluent-bit users.

Promtrail already supports it and it's a shame if we're forced to migrate "just cause" we can't have a pod IP.

syndbg avatar Nov 01 '21 10:11 syndbg

@kgtw thanks for such useful improvement, I hope it will be reviewed and merged.

askuy avatar Mar 21 '22 10:03 askuy

@edsiper how about this PR?

sevennt avatar Mar 21 '22 10:03 sevennt

Hello. Any news on this PR?

raxidex avatar May 26 '22 13:05 raxidex

@edsiper @fujimotos @koleini Any chance that this PR gets merged? It is funny that in the documentation it is stated

Our Kubernetes Filter plugin is fully inspired by the Fluentd Kubernetes Metadata Filter written by Jimmi Dyson.

but the pod IP is missing in the Kubernetes filter for Fluent Bit. Depending on the use case the pod IP is an important piece of metadata.

Thanks.

dan-leanix avatar Jun 13 '22 06:06 dan-leanix

Can you rebase to force the various checks to run? I'm guessing it was Github issues at the time.

patrick-stephens avatar Jun 23 '22 12:06 patrick-stephens

Can you rebase to force the various checks to run? I'm guessing it was Github issues at the time.

@kgtw FYI.

dan-leanix avatar Jun 27 '22 07:06 dan-leanix

@patrick-stephens I guess someone from the reviewers' list needs to approve the PR first before the various checks can run. At least that is what I read from the Action itself.

-> https://github.com/fluent/fluent-bit/actions/runs/2568072268

image

dan-leanix avatar Jul 15 '22 14:07 dan-leanix

@dan-leanix yeah it's to help with security and prevent spurious PRs causing issues as they will run on the Fluent resources. Plus quite often an initial review will highlight some issues that need resolving immediately anyway so not worth running until those are done.

patrick-stephens avatar Jul 15 '22 14:07 patrick-stephens

Thanks, @patrick-stephens for the explanation. It makes total sense.

@kgtw Seems to be that the issue with the tests is that the expected record does not match the actual record. Hence, the expected record is missing the pod_ip.

 filter_kubernetes.c:156: Check comparing expected record with actual record... failed

dan-leanix avatar Jul 18 '22 12:07 dan-leanix

Hi @kgtw, would it be possible to finish this PR? Thanks for the effort

raxidex avatar Oct 07 '22 15:10 raxidex

This PR is stale because it has been open 45 days with no activity. Remove stale label or comment or this will be closed in 10 days.

github-actions[bot] avatar Jan 06 '23 02:01 github-actions[bot]

@edsiper I know this PR is quite old, but would this be something you'd be up to adding to fluent-bit? It would help a lot with migrating from fluentd.

mrueg avatar Jun 25 '24 05:06 mrueg

Is there any path forward with this pull request? We're also migrating from fluentd, and this field is missing in fluent bit. It would be great to get some feedback so that someone else can take over the PR if the original contributor is unavailable.

ivanvc avatar Jun 28 '24 20:06 ivanvc

Waiting for this PR. We are migrating to fluent-bit

ziyuen avatar Jul 12 '24 03:07 ziyuen

Hi to all who've commented 👋

If there is anybody who would like to take over, feel free to. I've since moved on to other engineering domains so am no longer active in this space.

After this PR had no interest from the maintainers within the first two years of it being opened I gave up any hope of it ever being merged.

I still believe the intent behind this PR holds merit that many would benefit from and hope that the maintainers see from the continued activity within this PR that people are still looking for a solution.

kgtw avatar Jul 27 '24 06:07 kgtw

The code looks ok to me, however the unit test seems not to consider a proper input file and just validate the output, I have my doubts. Unit test is pending.

edsiper avatar Nov 13 '24 18:11 edsiper