CODEWITHSUNDEEP
rabbitmqapache-storm
Alan Hortz
Alan Hortz

Reputation: 85

In an Apache Storm topology, is there an internal queue between a spout and a bolt?

In order to be compliant with a specific RabbitMQ Message broker implementation, it is critical that the spout consume and acknowledge as fast as possible the broadcasted messages.

The specs of the Message Broker instance insists on the fact that the consumer must implement an in memory queue in order to not delay the acknowledgement in case of a slow processing time.

Is there such an implicit queue between a spout and a bolt ? Do I have to implement an in-memory queue within the bolt ?

Upvotes: 0

Views: 493

Answers (1)

Subos
Subos

Reputation: 89

There is a queue between spouts and bolts, as stated here.

If this won't help you, you can create a internal buffer in the spout and ack as soon as you insert the tuple in that internal buffer.

Upvotes: 2

Related Questions