Reputation: 3001
We are using Apache Ignite on our C++ application on a 32-bit ARM linux machine.
Our application is closing abruptly after certain number of entries in Database(4400 entries) and application is being terminated with "Buffer Overflow" error.
There is no other information in ignite logs or system logs. No dump file is also being generated. The below is all that we see in the log
*** buffer overflow detected
***: /opt/XXX/XXXXx terminated
When we disable the persistency there is no abrupt shutdown.
We have also observed that while persistency is enabled and write operations are being performed on DB, there are too many files opened in /proc/fd
for ignite and when the write operation is stopped also the number of files open is not decreasing.
My understanding is that these files should get closed by ignite after a certain time right? Do you have any idea why it is happening ? Also any help on "buffer overflow" issue?
Upvotes: 0
Views: 108
Reputation: 3591
It seems that you've encountered an issue with too many open files by a single user. Ignite required many open file descriptors to operate when persistence is enabled, since there is a file for every partition. So, if you have 10 partitioned caches on a one-node cluster, then it will need at least 10240 open file descriptors.
Try increasing the limits by running the following command:
ulimit -u 1000000
You can find more information in the following questions:
Ignite occur exception in Ubuntu VM when persistent: Too many open files
Ignite node is failing with "Too many open files" error
Upvotes: 0