CODEWITHSUNDEEP
rabbitmqakkaapache-kafkavert.xdistributed-system
Sweeky Gupta
Sweeky Gupta

Reputation: 1

Choice decision between different types of distributed frameworks available

How should one decide between rabbit mq, kafka , akka and vertx or chose a combination of a few of these? I have a use case where I want to get huge (half a TB each day) market data using a java client API provided by an upstream. We have currently implemented a distributed etl using Akka but want to know what other improvements or better choices or combination of choices(like akka+kafka) can be considered.

Upvotes: 0

Views: 382

Answers (1)

Michal Borowiecki
Michal Borowiecki

Reputation: 4314

Regarding the choice between akka and vert.x the following Devoxx talk is to the point: https://www.youtube.com/watch?v=EMv_8dxSqdE

It compares concurrency models, among them event bus (vert.x being the example) and actor systems (akka being the example).

In the summary slide (1h00m40s into the talk), the difference is summarised in that akka provides hierarchical supervision for error-handling, that being presented as an advantage over vert.x

akka-stream-kafka (formerly reactive-kafka) feels like a natural fit to bridge the two and we are happy users of it, but cannot comment on how it compares to rabbitmq.

Upvotes: 1

Related Questions