Reputation: 601
I would like to know if we can deploy logstash, elasticsearch and kibana in the same machine and also setting up 2 nodes of elasticsearch in this machine. The idea is I want to give 31Go Ram for each node and 4Go Ram to Logstash and let 30Go free. I have a machine with 8vCPUs,96Go Ram and 250GB HDD.
Do you think is a good idea? and my logstach could index files from 10 filebeat running on 10 servers?
Upvotes: 0
Views: 736
Reputation: 2439
It totally depends to your usage, type of your nodes. data, master, cordinating only, ingest node?
Read this documentation, you will have idea about nodes: Nodes|Elasticsearch Reference
A benefit of having master node on different machines is about the handling failover scenarios for cluster management. Having data nodes on different machines will give you data replication elasticity, by sharing shards on different machines it will distribute executions. In my opinion there is no any rationale having es nodes in the same machine.
A few advice:
Elasticsearch uses filesystem cache for I/O operations, which means "you should make sure that at least half the available memory goes to the filesystem cache".
Increase index memory buffer size: Index Buffer|Elasticsearch Reference
Increase index thread pool size: Thread Pool|Elasticsearch Reference
Upvotes: 1
Reputation: 1424
Yes, you can deploy logstash, elasticsearch and kibana in the same machine as long as you have enough resource in your machine to support it. All depends on the data you have to work on and available resources.
Upvotes: 1