CODEWITHSUNDEEP
elasticsearchelasticsearch-5
Longxing Wei
Longxing Wei

Reputation: 171

How to improve index performance in Elasticsearch with too many fields?

I have an index with thousands of columns. I try to index 10,000,000 documents in the cluster. It costs about 3 hours.

I tried some methods to turning the index speed and it is still slow.

How can I turning the speed for such an index with thousands of fields and more than 100,000,000 documents?

Upvotes: 0

Views: 124

Answers (1)

leandrojmp
leandrojmp

Reputation: 7463

What is the hardware configuration of your cluster? How much memory does the Java Heap have? How many cores? What is the speed of your disk?

Also, where is your infrastructure? On premises or a cloud service?

You really need all the fields in the document? How is the mapping of your index?

If you already tried the methods to improve performance, maybe there is not much else you can do, millions of documents which thousands of fields each one will really take time to index.

Upvotes: 1

Related Questions