Best practice for bulk data transfer

Mike McCarty mike.mccarty at sbcglobal.net
Mon Feb 20 19:53:41 UTC 2006


Andrew wrote:
> I just need to transfer a couple hundred thousand files off a **REALLY**
> slow server to a faster server and to be able to document that file x on
> slow server is identical to file x on faster server. It is not a forensics
> problem per se -- but I do need to prove/document the process -- so I'm
> thinking md5sums.
> 
> /** begin simplification **/
> 
> Procedure 1: The slow option
> 
> [slow server] calc md5sums > list && nc list > faster_server
> [slow server] rsync files to faster at server over a 10T crossover cable
> [faster server] check md5sums against list

This is the option I'd use.
Umm, in the amount of time we've been discussing this, you could
have already transferred the files this way, I suppose.

[snip]

Mike
-- 
p="p=%c%s%c;main(){printf(p,34,p,34);}";main(){printf(p,34,p,34);}
This message made from 100% recycled bits.
You have found the bank of Larn.
I can explain it for you, but I can't understand it for you.
I speak only for myself, and I am unanimous in that!




More information about the fedora-list mailing list