efficiently create multiple copies of one file
Hi Forums,
I've got a problem that my google-fu can't solve:
- I've got a large file (15GB) on server A.
- I want anywhere between two and eight indentical copies of this file on server B.
I see a couple of slow easy ways to do this:
1) scp the file 8 times. (booo...)
2) scp the file once and copy it locally however many times it's needed. (better, since the HDD speed is much greater than the network speed)
But I want to do it the hard fast way:
-simultaneously write the scp'd file to many different files on server B as the data is coming in.
Is there a utility to do this? Maybe I could pipe it through tar somehow? I could probably write something in python to do this, but why re-invent the wheel if it already exists :)
Rock on!