nginx-kafka-log-module

nginx-kafka-log-module copied to clipboard

Auto reconnect issue

2

We have passed several tests with this module under some pretty heavy load without any problem. By the way, I found a connection issue with Kafka server after some long...

moweonlee

rdkafka properties as directive parameters

6

Revamp configuration directives with properties parsed by rdkafka Motivation is ability to set properties at configuration time. Currently a known set is hardcoded in configuration parsing together with string/int types...

larry-cdn77

Work in if section or new option for kafka_log

2

Thanks for the module! But, please, add the ability to work inside if. This will help to cancel the logging of some requests: ``` server { set $kafka_log 1; location...

k0st1an

nginx-plus 1.13.4 compile errors

5

Hi, Thanks for the module! I'm trying to compile the module for nginx-plus 1.13.4 and I get the following errors: $ make modules /Applications/Xcode.app/Contents/Developer/usr/bin/make -f objs/Makefile modules cc -c -fPIC...

joshgibs

dlopen() "/etc/nginx/modules/ngx_http_kafka_log_module.so" failed (/etc/nginx/modules/ngx_http_kafka_log_module.so: undefined symbol: rd_kafka_flush

3

Hello. I've tried to build your module dynamically and build was successful. But on inserting: ``` load_module /etc/nginx/modules/ngx_http_kafka_log_module.so; ``` I've got error: ``` dlopen() "/etc/nginx/modules/ngx_http_kafka_log_module.so" failed (/etc/nginx/modules/ngx_http_kafka_log_module.so: undefined symbol: rd_kafka_flush...

Hubbitus

How to connect to kafka with SSL certificates?

1

If I understand correctly, all configuration defined in https://github.com/kaltura/nginx-kafka-log-module/blob/master/ngx_http_kafka_log_module.c and there is no mechanism to pass arbitrary parameters into librdkafka library? For example, option like `security.protocol`.

Hubbitus

does it support batching ?

1

Does kafka module use batching, while sending data. Moreover, the parameter kafka_log_kafka_buffer_max_messages have any role in batching ?

notshivansh

location -> if(...) {kafka_log} - kafka_log directive is not allowed here

1

I'm trying to do: ``` location / { if ($download_url) { kafka_log kafka:topic $download_log; } } ``` but got error: `"kafka_log" directive is not allowed here` So, what should I...

marinaaaniram