fluent-bit-docs icon indicating copy to clipboard operation
fluent-bit-docs copied to clipboard

out_kafka: add support for dynamic/static headers

Open DIFRIN opened this issue 1 year ago • 5 comments

Add support for dynamic or static header for the kafka output plugin

Example: 'docker run --rm --network kafka_default -e value_test='${text}' -it fluent/fluent-bit-local:latest -i dummy -p dummy='{"text": "hello world"}' -p samples=1 -o kafka -p brokers=kafka:9092 -p topics=test_fluentbit -p header="key2 <text>" -vvv'

Gives kafka-console-consumer --topic test_fluentbit --bootstrap-server kafka:9092 --property print.headers=true key2:hello world {"@timestamp":1710505560.027627,"text":"hello world"}

DIFRIN avatar Mar 15 '24 12:03 DIFRIN

Hi @DIFRIN, please sort the DCO issue.

lecaros avatar Apr 17 '24 14:04 lecaros

Hi @lecaros

DCO ok. Can you please review my merge request at fluent-bit repo

DIFRIN avatar May 29 '24 19:05 DIFRIN

@DIFRIN can you please resolve the conflicts here? I've nudged you on the code PR for the same conflict resolution task https://github.com/fluent/fluent-bit/pull/8583. Both needed to merge.

eschabell avatar Oct 21 '25 14:10 eschabell

The conflicts were due to formatting changes for style, I went ahead and fixed the conflicts in the interest of keeping things moving.

There's one addition to the table that should be doublechecked by a dev-type person.

esmerel avatar Oct 21 '25 18:10 esmerel

I think we're still waiting on the code merge

patrick-stephens avatar Oct 21 '25 19:10 patrick-stephens