CODEWITHSUNDEEP
hadoopcloudera
Hoon
Hoon

Reputation: 1611

how do I set servers for hadoop? (CDH)

I am running 3 instances using AWS EC2 (m1.small -- 20GB HDD & 1.7 GB RAM).

On the cluster, there will be hadoop, mapReduce, and several monitoring processes.

This is how I split :

1 Master server

2 Slave servers

Because of the server's spec, I think it is kind of burden for the master server to run those 8 jobs. How do I divide them? Should I make another server to allocate monitoring processes?

Upvotes: 0

Views: 178

Answers (1)

Venkat
Venkat

Reputation: 1810

Having NameNode & SeondaryNameNode on same server does not serve any purpose.

With 1.7 GB ram /machine i don't think you can do much. You need more nodes or higher configuration. 8GB/ Node i think should be minimum.

You can assign some services to slave nodes also.

Upvotes: 1

Related Questions