Vova Bilyachat
Vova Bilyachat

Reputation: 19494

Elasticsearch cluster

I have ES cluster with 5 machines. One of that machines is always using more resources than other for instance now i see that average load is CPU 7%, Memory 65,

But i have node4 which is strange because it using 30% of CPU and 86% of memory.

Machines are totally the same, configuration the same only node4 is only data node. And when I compare node4 with other in marvel they are doing almost the same tasks..

Any suggestion how to debug and see why its using more than other?

PS. Reason why i care because few times my cluster dies because of node4, I did some improvements in app, but still i want to understand what is going on with node4.

Upvotes: 1

Views: 106

Answers (1)

Andrei Stefan
Andrei Stefan

Reputation: 52368

Two things about your cluster:

  • This is wrong: "all requests are sent to master (node1, node2)"! You should send the requests in round robin fashion to all the nodes holding data, otherwise you 'll have nodes that simply do more work than others
  • You are wasting memory and overall resources by having a lot of small shards... You should consider moving to 1 primary and 1 replica for your indices. The default (5 primaries, 1 replica) is too much. Your indices are way too small to have 5 shards.

Upvotes: 1

Related Questions