java_enthu
Reputation: 2327
Configuring AWS cluster using automation script
We are looking for the possibility of an automation script which we can give how many master and data nodes we need and it would configure a cluster. Probably giving the credentials in a properties file.
Currently our approach is to login to the console and configure the Hadoop cluster. It would be great if there could be an automated way around it.
Upvotes: 0
Views: 218
Answers (1)
cjackson
Reputation: 1637
I've seen this done very nicely using Foreman, Chef, and Ambari Blueprints. Foreman was used to provision the VMs, Chef scripts were used to install Ambari, configure the Ambari blueprint, and to create the cluster using the Blueprint.
Upvotes: 1
Related Questions
- How to Set an existing ECS cluster to a compute environment in AWS Batch
- How to pass scripts during AWS ECS clusters provisioning?
- Running script on EC2 launch automatically during cluster creation
- Script for automation start and stop AWS EC2 instance
- Hadoop command to run bash script in hadoop cluster
- Configure ECS Cluster Instance Configuration using YAML file
- Creating a cluster using Amazon ECS CLI
- How to set amazon ami's hadoop configuration by using java code
- Need help to setup hadoop cluster in aws
- Configuring hadoop manually on ec2