CODEWITHSUNDEEP
concurrencysshrsyncfile-transfer
The Surrican
The Surrican

Reputation: 29856

Speed up rsync by running multiple instances at once?

I have to transfer a big directory to another server.

My problem is that i cannot use the full bandwidth that would be available, because one concurrent tcp stream does not get as fast.

Basically the functionality that any download manager nowadays supports.

Therefore I would like to do concurrent data streams.

However I cannot find a program that supports this, so I thought about just running multiple instances or rsync at once.

Is this a good idea or can you point me into the direction of a more suitable tool?

Upvotes: 2

Views: 7859

Answers (1)

ams
ams

Reputation: 25559

I don't know of another tool, but two rsync sessions in parallel would certainly be fine.

However, you'd need partition the directory carefully. Two rsyncs with identical parameters would be counter-productive, or just broken (potentially).

Also, watch out for SSH connection sharing. It's very useful for quick authentication, but I'm not sure if you don't end up sending all the data down the same TCP stream.

Upvotes: 2

Related Questions