CODEWITHSUNDEEP
amazon-web-servicesapache-flinkamazon-emramazon-kinesis-firehose
Turvo
Turvo

Reputation: 211

What is the difference between AWS Elastic MapReduce and AWS Kinesis Data Analytics?

I'm executing a Flink Job with this tools. I think both can do exactly the same with the proper configuration. Does Kinesis Data Analytics do something that EMR can not do or vice versa?

Amazon Kinesis Data Analytics is the easiest way to analyze streaming data, gain actionable insights, and respond to your business and customer needs in real time.

Amazon Elastic Map Reduce provides a managed Hadoop framework that makes it easy, fast, and cost-effective to process vast amounts of data across dynamically scalable Amazon EC2 instances. You can also run other popular distributed frameworks such as Apache Spark, HBase, Presto, and Flink in EMR.

Upvotes: 10

Views: 5759

Answers (3)

hopeIsTheonlyWeapon
hopeIsTheonlyWeapon

Reputation: 567

The major difference is maintainability and management from your side.

If you want more independent management and more control then I would say go for AWS EMR. Where its your responsibility to manage the EMR infrastructure as well as the Apache Flink cluster in it.

But if you want less control and more focus on application development and you need to deliver faster(tight deadline) then KDA is the way to go. Here AWS provides all the bells and whistles you need for running your application. This also easily sets up with AWS s3 as code source and provides a bare minimum Configuration Management using the UI.

It scales automatically as well.(Need to understand KCU though).

It provides the same Flink dashboard where you can monitor your application and AWS Cloudwatch integration for debugging your application.

Please go through this nice presentation and let me know it that helps.

Please let me know.

https://www.youtube.com/watch?v=c_LswkrwOvk

Upvotes: 1

code_titan
code_titan

Reputation: 23

I will say one major difference between the two is that Kinesis does not provide a hosted Hadoop service unlike Elastic MapReduce (now EMR)

Upvotes: 0

Olalekan Sogunle
Olalekan Sogunle

Reputation: 2357

Got this same question also. This video was helpful in explaining with a real architecture scenario and AWS explanation here tries to explain how Kinesis and EMR can fit together with possible use cases.

Upvotes: -1

Related Questions