rsync benchmarking

[Ivan Krstić]

On Jun 28, 2007, at 3:55 AM, Martin Langhoff wrote:
> rsync itself does all of that, and it's pretty efficient at it.

No it doesn't; such functionality only exists in rsync 3.0. See the  
comments from Tridge. Right now, if you let rsync 2.x sync a tree, it  
will go and read (data structures for) the whole tree in memory  
regardless of how large it is. Scott fixes this by externally  
breaking down the tree into smaller chunks and then rsyncing those  
individually, such that the memory consumption during any particular  
rsync operation remains relatively small.

--
Ivan Krstić <krstic at solarsail.hcs.harvard.edu> | GPG: 0x147C722D