copying milllions of small files and millions of dirs

[Warren Block]

On Mon, 19 Aug 2013, Mark Felder wrote:

> On Fri, Aug 16, 2013, at 1:46, Nicolas KOWALSKI wrote:
>> On Thu, Aug 15, 2013 at 11:13:25AM -0700, aurfalien wrote:
>>> Is there a faster way to copy files over NFS?
>>
>> I would use find+cpio. This handles hard links, permissions, and in case
>> of later runs, will not copy files if they already exist on the
>> destination.
>>
>> # cd /source/dir
>> # find . | cpio -pvdm /destination/dir
>>
>
> I always found sysutils/cpdup to be faster than rsync.

sysutils/clone may do better as well.