CODEWITHSUNDEEP
elasticsearchlogstash
stecog
stecog

Reputation: 2344

"Too many open files" on Elasticsearch

i have a cluster ES and from 2 days ago i have this error:

[2016-03-14 15:08:48,342][WARN ][cluster.action.shard] [node-01] [logstash-2016.03.14][2] received shard failed for [logstash-2016.03.14][2], node[72oHnFiXTVqgXaUYKTAu2Q], [P], s[INITIALIZING], indexUUID [AKybrAEZRXebyRxcmzTqJQ], reason [Failed to start shard, message [IndexShardGatewayRecoveryException[[logstash-2016.03.14][2] failed recovery]; nested: EngineCreationFailureException[[logstash-2016.03.14][2] failed to open reader on writer]; nested: FileSystemException[/var/lib/elasticsearch/elasticsearch/nodes/0/indices/logstash-2016.03.14/2/index/_lg_Lucene410_0.dvm: Too many open files]; ]]

If i run curl -XGET 'http://localhost:9200/_nodes?os=true&process=true&pretty=true' | grep "max_file_descriptors" i have this output:

"max_file_descriptors" : 65535,
"max_file_descriptors" : 65535,

To the file /etc/security/limit.conf i already have:

elasticsearch - nofile 65535
elasticsearch - memlock unlimited

If i check the status of index i have some index RED....consequently logstash goes wrong and crashes all

Upvotes: 0

Views: 4084

Answers (1)

nevsv
nevsv

Reputation: 2466

Just set elasticsearch - nofile to unlimited. And make sure you running with the right user.

Upvotes: 1

Related Questions