正常情况下,rabbitmq server(broker)会盲目地,按照message数目平均地分发message给consumer,而不考虑有的message处理起来比较耗时,有的处理起来很快,
场景问题是,假设有两个consumers,consumerA和consumerB,4条messages,evenly, message1,message3会分发给consumerA去处理,message2,message4会分发给consumerB去处理,有的时候,message1,message3处理起来很简单,耗时很少,几秒钟就处理完毕,message2,message4处理比较耗时,每条message都得处理几分钟,则由于rabbitmq默认只会按照数目平均的分发给consumers,这样会导致consumerA 几秒钟就处理完message1和3,休息,而consumerB还在处理message2中,message4还没开始处理,导致不公平。通常情况下,rabbitmq server只会just blindly dispatches every n-th messageto the n-th consumer.
解决方法:通过channel.basicQos(1);来保证RabbitMQ not to give more thanone message to a worker at a time. Or, in other words, don't dispatcha new message to a worker until it has processed and acknowledged theprevious one. Instead, it will dispatch it to the next worker that is not still busy. 如果不设置这个参数,则rabbitmq会数目均匀的一次性平均分发给各个consumers
int prefetchCount = 1;
channel.basicQos(prefetchCount);
由于queue的size有限,当queue里面的messages满了,你需要增加consumers个数来处理message或者其他的strategy
Using message acknowledgments and prefetchCount you can set up awork queue. The durability options let the tasks survive even ifRabbitMQ is restarted.
reference: http://www.rabbitmq.com/tutorials/tutorial-two-java.html