CODEWITHSUNDEEP
amazon-web-servicesapache-sparkamazon-ec2
Dave Trower
Dave Trower

Reputation: 21

AWS Spark standalone cluster does not start

I have an ASW EC2 node. I have installed Apache spark on the node.

I use a command like this to start the cluster:

spark-ec2/spark-ec2 -k NAME_OF_KEY_PAIR --identity-file=PATH_TO_PEM_FILE --region=us-west-2 --zone=us-west-2a --copy-aws-credentials start NAME_OF_YOUR_CLUSTER

When I start the cluster, I get a message like this:

Connection to ec2-34-214-104-6.us-west-2.compute.amazonaws.com closed.

Spark standalone cluster started at http://ec2-38-218-104-6.us-west-2.compute.amazonaws.com:8080.

Ganglia started at http://ec2-388-218-104-6.us-west-2.compute.amazonaws.com:5080/ganglia.

However, there is nothing running on the URL given for the spark stand alone cluster. The Ganglia URL does work though.

Upvotes: 1

Views: 120

Answers (1)

Kush Vyas
Kush Vyas

Reputation: 6079

Are you sure the required ports are open in the instance ? By Default Only SSH is open that is also bound to your IP.

Try reading through this AWS Documentation

Thanks

Upvotes: 1

Related Questions