Chandrasekhar Vasamsetti
Reputation: 69
How to limit the number of messages from RabbitMQ to spark streaming
I am getting all the messages from the RabbitMQ when the connection is established. I want to limit the number of messages fetch the RabbitMQ.
Upvotes: 1
Views: 95
Answers (1)
Sachin Thapa
Reputation: 3709
You can set following parameter
maxMessagesPerPartition - Maximum number of messages
See spark-rabbitmq for more details.
Hoping this helps.
Upvotes: 1
Related Questions
- How to put limit on the message size for RabbitMQ?
- Limit how many RabbitMQ messages I get from the server
- How to limit the number of consumed messaged in rabbitmq?
- RabbitMQ - Is there a way to limit the number of messages in a queue?
- x-max-length for spark-rabbitmq_1.6 doesn't work
- How do I ack messages with RabbitMQ and Apache Spark?
- How to limit concurrent message consuming based on a criteria
- Reading message from RabbitMq via Apache Spark Streaming
- Spark Streaming Continuous Job
- NodeJS + RabbitMQ - How to limit the number of messages a receiver processes