Alternative to scp, transferring files between linux machines by opening parallel connections

Question

Is there an alternative to SCP, to transfer any large file from 1 machine to a different machine by opening parallel connections and also be able to pause and resume this download?

Please don't give this to severfault.com. I am not a system administrator. I am a developer but trying to transfer the database dumps between backup hosts and the servers.

Thank you

Answer 1

You could try using the split(1) to break this file apart and then use SCP pieces in parallel. your file could then be combined into one single file on this destination machine by 'cat'.

# on local host

split -b 1M large.file large.file. # split into 1MiB chunks

for f in large.file.*; do scp $f remote_host: & done

# on remote host

cat large.file.* > large.file

Come and join Linux training to gain great knowledge. 

Do check out the video below