RabbitMQ Shovel Message Rate

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
Report Content as Inappropriate

RabbitMQ Shovel Message Rate

This post has NOT been accepted by the mailing list yet.
Hello folks,

I have a queue with the following parameters:

x-ha-policy: all
durable: true

There is a static shovel configured to process this queue and another server is set as destination. The shovel configuration:

{sources, [ {broker, "amqp://web:web@thisserver/%2F"} ]},
{destinations, [ {broker, "amqp://web:web@remoteserver/%2F"} ]},
{queue, <<"queuename">>},
{prefetch_count, 10},
{publish_fields, [ {exchange, <<"exchangename">>} ]},
{reconnect_delay, 5}

My problem is that the deliver / get and ack rates never go over 50/s for the "queuename" queue, therefore causing a huge build-up (7 million) in the queue.

I wonder if changing the prefetch_count will increase the message rate?

Also "Ack required" is enabled for the consumer of the queue. The default value for this is: on_confirm. If the messages are forced to be acknowledged, does it limit the message rates?