CODEWITHSUNDEEP
pythonlinuxbenchmarkinginotify
Edward Williams
Edward Williams

Reputation: 606

Benchmarking System performance of Python System

I'm looking at using inotify to watch about 200,000 directories for new files. On creation, the script watching will process the file and then it will be removed. Because it is part of a more compex system with many processes, I want to benchmark this and get system performance statistics on cpu, memory, disk, etc while the tests are run.

I'm planning on running the inotify script as a daemon and having a second script generating test files in several of the directories (randomly selected before the test).

I'm after suggestions for the best way to benchmark the performance of something like this, especially the impact it has on the Linux server it's running on.

Upvotes: 0

Views: 873

Answers (1)

Brent Washburne
Brent Washburne

Reputation: 13148

I would try and remove as many other processes as possible in order to get a repeatable benchmark. For example, I would set up a separate, dedicated server with an NFS mount to the directories. This server would only run inotify and the Python script. For simple server measurements, I would use top or ps to monitor CPU and memory.

The real test is how quickly your script "drains" the directories, which depends entirely on your process. You could profile the script and see where it's spending the time.

Upvotes: 1

Related Questions