pipeline_kafka

pipeline_kafka copied to clipboard

I am having problems getting pipeline_kafka to work on OSX 10.12.3. I follow the instructions in the readme, and when I try to start up with shared_preload_library set, or create the extension, I get the following error:-

ERROR: could not load library "/usr/local/lib/pipelinedb/lib/pipelinedb/pipeline_kafka.so": dlopen(/usr/local/lib/pipelinedb/lib/pipelinedb/pipeline_kafka.so, 10): Symbol not found: _sasl_client_init Referenced from: /usr/local/lib/pipelinedb/lib/pipelinedb/pipeline_kafka.so Expected in: flat namespace in /usr/local/lib/pipelinedb/lib/pipelinedb/pipeline_kafka.so

I have tried the following various options:-

1. Followed instructions in your readme - i.e. clone the specific branch of librdkafka, configure, make and install.
2. Installed librdkafka using homebrew.
3. Followed suggestion in issue 1387 to build librdkafka with the disable_ssl option

None of these work. So, any other ideas?

@mmcalli can you share the ./configure output you get when building librdkafka? Here's how we build librdkafka for the pipeline_kafka that's included in our Docker image:

https://github.com/pipelinedb/pipelinedb/blob/master/pkg/docker/Dockerfile#L104

have the same problem in os x

In case others stumble upon this, building librdkafka with the configure line linked by @derekjn and then building pipeline_kafka against that worked for me (Mac OSX High Sierra).

@mmcalli can you share the ./configure output you get when building librdkafka? Here's how we build librdkafka for the pipeline_kafka that's included in our Docker image:

https://github.com/pipelinedb/pipelinedb/blob/master/pkg/docker/Dockerfile#L104

the link is not found when i installed librdkafka-0.9.5.x and pipeline_kafka-0.9.5,pipelinedb version is 9.5 ,after add to pipelinedb.conf ,restart pipelinedb,get an error: FATAL:could not load library "/pipelinedb/lib/pipelinedb/pipeline_kafka.so":/pipelinedb/lib/pipelinedb/pipeline_kafka.so:undefined symbol:inflate

sorry, I was so careless,the quesion is solved.

@val-sy "/pipelinedb/lib/pipelinedb/pipeline_kafka.so":/pipelinedb/lib/pipelinedb/pipeline_kafka.so:undefined symbol:inflate

How do you solve this problem？