CODEWITHSUNDEEP
macosunixrsyncfindernas
nimuc
nimuc

Reputation: 21

rsync: Performance issues with large files

rsync is much slower than expected in my use case:

I'm facing the problem of frequently copying multiple hundred huge media files (each way bigger than 100GB) from a Synology NAS to a local Thunderbolt RAID via LAN using a Mac. I've tried many different options ranging from Finder to rsync. None of which seem to work great (or even good).

Surprisingly just copying using Mac OS Finder is the fastest option that I tested so far. It averages at about 100MB/s. But for many reasons (error handling, no checksums, .DS-Store problems, etc) this method is not at all satisfactory.

Although I do not need to sync anything (just copy entire directories from A to B), rsync has exactly what I need in terms of features but it seems to be way too slow for this kind of task. It averages at about 50-70MB/s (-vaEWh --progress).

My question is: Am I holding it wrong or is rsync not the right tool for this? What else could be used to copy many very large files at speeds above 100MB/s with a decent amount of monitoring and logging?

Thanks for any helpful tips!

Upvotes: 2

Views: 2926

Answers (1)

Brian Monroe
Brian Monroe

Reputation: 21

Apparently the rsync that Apple ships has some known issues with speed. While I haven't tried it others are reporting that installing rsync through ports is resolving the issue.

http://www.laszlopusztai.net/2015/02/19/fixing-extremely-slow-rsync-on-os-x/

Upvotes: 2

Related Questions