copying milllions of small files and millions of dirs

[aurfalien]

On Aug 15, 2013, at 11:46 PM, Nicolas KOWALSKI wrote:

> On Thu, Aug 15, 2013 at 11:13:25AM -0700, aurfalien wrote:
>> Is there a faster way to copy files over NFS?
> 
> I would use find+cpio. This handles hard links, permissions, and in case 
> of later runs, will not copy files if they already exist on the 
> destination.
> 
> # cd /source/dir
> # find . | cpio -pvdm /destination/dir


Old thread I know but cpio has proven twice as fast as rsync.

Trusty ol cpio.

Gonna try cpdup next.

- aurf