spark-rabbitmq

spark-rabbitmq copied to clipboard

val receiverStream = RabbitMQUtils.createStream(ssc, Map( "hosts" -> hosts, "queueName" -> queueName, "exchangeName" -> exchangeName, "exchangeType" -> exchangeType, "**_vHost_**" -> vHost, "userName" -> userName, "password" -> password )) vhost is wrong...

steelxiang

Please release a version with support for Apache Spark 2.2.x

4

Please release a version with support for Apache Spark 2.2.x

vetler

Streaming job fails due to connection shutdown

5

We have a spark rabbitmq streamin job which is occasionally failing due to the exception: ` java.lang.Exception: An error happen while getting next delivery: clean connection shutdown; protocol method: #method(reply-code=200,...

atfire

Replaced MaxReceiveTime for maxReceiveTime.

yenki

Getting RabbitMQ Message Delivery Tag

4

https://stackoverflow.com/questions/47026864/getting-rabbitmq-message-delivery-tag-stratio-spark-rabbitmq

mantovani

Hi, If the spark streaming job fails, the messages in the buffer will be lost. What are the current workarounds? Is it possible to only send an ack back for...

kaveh-hariri

java.lang.ClassNotFoundException: org.apache.spark.streaming.rabbitmq.RabbitMQUtils

1

Hi all, I wrote a simple custom receiver to grab messages from RabbitMQ into spark streaming (using spark-rabbitmq 0.5.1, and spark 2.0.2). However, when I run the file, I get...

rkamaleswaran

Error creating channel and connection: connection is already closed due to connection error; cause: com.rabbitmq.client.impl.UnknownChannelException: Unknown channel number 1

6

spark-rabbitmq version - 0.5.1 spark version - 2.1.0 (scala version - 2.11.8) rabbitmq version - 3.5.6 I'm using Distributed approach for streaming - List distributedKeys = new LinkedList(); distributedKeys.add(new JavaRabbitMQDistributedKey(prop.getProperty("queue.name"),...

alankala

java.lang.OutOfMemoryError: GC overhead limit exceeded

11

I use: spark1.6.0 spark-rabbitmq 0.4.0 My program ran for 24 hours before it was reported wrong.Please help me. My error log: `17/09/13 17:15:43 WARN spark.HeartbeatReceiver: Removing executor 6 with no...

Alanthur

Consumers/Executors hanging

3

Hi, I'm using the distributed approach, 1 queue, 10 consumers/containers. After some time, a consumer will "hang" in the sense that the streaming window closes and moves on, but the...

kaveh-hariri