CODEWITHSUNDEEP
hadoopamazon-ec2emr
chuckfinley
chuckfinley

Reputation: 763

Amazon Elastic Mapreduce default configurations

Are the Hadoop configuration defaults (core-site.xml, yarn-site.xml, etc) published by Amazon? I've seen select parameters published but not the total default configurations.

Upvotes: 2

Views: 1501

Answers (1)

Sandesh Deshmane
Sandesh Deshmane

Reputation: 2305

you will find defaults config at amazon emr documentation page at below link http://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/TaskConfiguration_H2.html

There is way you can find config for job that is triggerd. You can visit to S3 Location where logs are saved. There you will find j-yourjoblogsfilelocation/jobs/job_1403597560615_0001_conf.xml. The _conf.xml has all config that are passed to job. They are the defaults config unless we overwrite them. So this will be different as per box config we choose. e.g memory configs may be different

Upvotes: 1

Related Questions