high memory usage with no_ack=True

[christianwinkel]

Hi

I'm using amqpstorm 2.2.0 to consume messages from RabbitMQ. I need a high rate of messages. With no_ack=false I increased the QOS value higher and higher to get better message rates. With ack I can reach up to 1.5k msg/s

Then I tried with no_ack=True and got the rates (4k/s) I needed. But the QUS value is ignored and it seems that amqpstorm reads all messages from RabbitMQ to its local queue. The memory usage of my script raises until the system crasches ( this only happens if the rabbit queue is very big, after pausing the consumer for a few days). Is there a way to limit the amount of used memory in amqpstorm basic.consume?

Chris

[eandersson]

This is indeed a side effect of the current implementation when using no-ack set to True. I'll look into implementing some sort of back pressure functionality that could be used to prevent excessive message buildup.