blocky icon indicating copy to clipboard operation
blocky copied to clipboard

[Enhancement] Add kafka querylog functionality

Open rmellmer opened this issue 2 years ago • 4 comments

For my use-case, I wanted to be able to log DNS queries to a Kafka stream for further analysis. Figured others might find this feature useful as well.

rmellmer avatar Mar 30 '22 16:03 rmellmer

Hi, thanks for you work! I think it can be useful if someone has the kafka stack running. Just curious: what is your toolset to analyse queries from blocky?

The build fails currently, I assume this is the issue with "musl" flag and different linux distros? Did you try to use another go library for Kafka (for example kafka-go), which are not relying on libkafka/musl?

0xERR0R avatar Apr 01 '22 14:04 0xERR0R

@0xERR0R My toolset has honestly just been using dig to make queries to the application, and examining the results on the kafka stream I have running on my dev host.

I was hoping that the official confluent kafka library would work, but it seems that as you mentioned, that the reliance on librdkafka is going to be an issue with the build. My use case was to run it in alpine linux, which the musl build flag is appropriate for, but seems that it can't easily be cross-compatible without specifying different build flags depending on the platform. I haven't tried using a different Kafka library yet, but I'll take a stab at that here and will update the branch if I can get it working with the kafka-go library.

rmellmer avatar Apr 01 '22 17:04 rmellmer

Hi! New here and just found this issue! Sorry for the intrusion, just a minor comment suggesting to take a look at franz-go, so far the best experience I had with a Golang kafka driver! Cheers!

victoraugustolls avatar Jun 24 '22 02:06 victoraugustolls

This PR is stale because it has been open 45 days with no activity. Remove stale label or comment or this will be closed in 10 days.

github-actions[bot] avatar Aug 08 '22 04:08 github-actions[bot]

This PR was closed because it has been stalled for 10 days with no activity.

github-actions[bot] avatar Aug 18 '22 04:08 github-actions[bot]