fluent-plugin-kafka
fluent-plugin-kafka copied to clipboard
Support for wildcard `topic_key`
Is your feature request related to a problem? Please describe.
If I have a wildcard <match zeek.**>
for @type kafka2
, it would be great to have a way for topic_key
to simply mirror the actual topic that is picked up.
Describe the solution you'd like
<match zeek.**>
@type kafka2
...
# write events to this kafka topic
topic_key TODO # < HERE
<buffer TODO>
@type file
path /var/log/td-agent/buffer/td
flush_interval 10s
</buffer>
default_topic TODO
</match>
Describe alternatives you've considered
none
Additional context
none
This issue has been automatically marked as stale because it has been open 90 days with no activity. Remove stale label or comment or this issue will be closed in 30 days
This issue has been automatically marked as stale because it has been open 90 days with no activity. Remove stale label or comment or this issue will be closed in 30 days
This issue was automatically closed because of stale in 30 days
Hey @brsolomon-deloitte, we should be able to achieve the same effect by using the topic
parameter
e.g.
<match **>
# etc
topic "${tag}"
<buffer tag>
# etc
</buffer>
</match>
The topic
parameter is not currently documented but we'll work on that.