CODEWITHSUNDEEP
elasticsearch
Yuseferi
Yuseferi

Reputation: 8670

consequences of increasing max_result_window on elastic search

we have an index which default max_result_window was set up to 10000, but our data is increasing and we expect we have more than 1 Million Docs there, on of our requirements is scroll all data from the start to end with 1000 in each epic , our documents are not very big and I'll write down one example on following :

{
"serp_query": "c=44444&ct=333333",
"uid": "5815697",
"notify_status": 0,
"created_at": "2018-02-04 10:00:00"
}

I've set max_result_window to 10,000,000 but at this time we have almost 50K docs in our Index, I've read the some texts about consequences of this increasing

Values higher than can consume significant chunks of heap memory per search and per shard executing the search. It’s safest to leave this value as it is an use the scroll api for any deep scrolling https://www.elastic.co/guide/en/elasticsearch/reference/2.x/breaking_21_search_changes.html#_from_size_limits

But we our Documents are not too big and our Elastic Server has 16GB dedicated RAM and guess there is not problem, I'm writing to ask two questions,

our query is not very complicated, loop on all data ordered by "created_at" descending and get 1000 Docs in each epic.

FYI: our elastic search engine version in 2.7

Upvotes: 5

Views: 1891

Answers (1)

Yuseferi
Yuseferi

Reputation: 8670

Just to share the Result with others,

If the Document is not very big and your queries are not very complicated increasing max_result_window has not big effect on performance.

Upvotes: 3

Related Questions