CODEWITHSUNDEEP
apache-kafkakafka-consumer-api
Vawani
Vawani

Reputation: 399

Can I use Kafka queue in my Rest WEBSERVICE

I have a rest based application deployed in server(tomcat) , Every request comes to server it takes 1 second of time to serve, now I have a issue, sometimes Server receive more request then it is capable of serving which making server non responsive. Now I was thinking if I can store the requests in a queue so that server can pull request and serve that request and handle the pick time issue.

Now I was thinking can Kafka be helpful for this, if yes any pointer where I can start.

Upvotes: 5

Views: 3297

Answers (2)

Kaushal
Kaushal

Reputation: 1349

You can use Kafka (or any other messaging system for this ex- ActiveMQ, RabbitMQ etc).

When WebService receives request, add request (with all details required to process it) in Kafka queue (using Kafka message producer details)

Separate service (having Kafka consumer details) will read from topic(queue) and process it.

In case need to send message to client when request is processed, server can push information to client using WebSocket (Or client can poll for request status however this need request status endpoint and will cause load on that endpoint).

Upvotes: 4

ImbaBalboa
ImbaBalboa

Reputation: 867

Apache Kafka would be helpful in your case. If you use a Kafka broker, it will allow you to face with a peak of requests. The requests will be stored in a queue as you mentionned and be treated by your server at its own speed.

As your are using tomcat, I guess you developped your server in Java. Apache Kafka propose a Java API which is quite easy to use.

Upvotes: 0

Related Questions