Ankur Mahajan
Ankur Mahajan

Reputation: 3596

Elasticsearch total shard count impact on an index search speed

I know that the shard count and size has a significant impact on the search performance (speed) and cluster recovery.

Does the total number of shard count impact the search speed? Let me simplify it assume I have 5 indices with 5 primary shards each and I am searching in indice1 only and assume it return me the response in 500ms. Will this be same (500ms) if I add 5 more indices? I know the recovery time would increase but not sure about a specific indice search performance.

Any help would be highly appricated.

Upvotes: 0

Views: 599

Answers (1)

Val
Val

Reputation: 217254

Common sense would imply that searching on more data takes longer, however, it's impossible to answer without also knowing:

  • the number of nodes (more nodes can parallelize searches on several shards)
  • their hardware specs (ram and cpu play a role in how many concurrent searches can happen on a single node)
  • if any write operations also happen at the same time (taking resources away from search threads)
  • etc...

The best you can do is to actually create a test case (using e.g. Rally) and test this on your own infrastructure.

Upvotes: 2

Related Questions