From nobody Sun Nov 13 01:53:47 2022
X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N8wTc4dSRz4fhdv
	for <freebsd-fs@mlmmj.nyi.freebsd.org>; Sun, 13 Nov 2022 01:53:56 +0000 (UTC)
	(envelope-from bfriesen@simple.dallas.tx.us)
Received: from smtp.simplesystems.org (smtp.simplesystems.org [65.66.246.90])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(Client did not present a certificate)
	by mx1.freebsd.org (Postfix) with ESMTPS id 4N8wTb3FPKz4NVy
	for <freebsd-fs@FreeBSD.org>; Sun, 13 Nov 2022 01:53:55 +0000 (UTC)
	(envelope-from bfriesen@simple.dallas.tx.us)
Authentication-Results: mx1.freebsd.org;
	dkim=none;
	spf=pass (mx1.freebsd.org: domain of bfriesen@simple.dallas.tx.us designates 65.66.246.90 as permitted sender) smtp.mailfrom=bfriesen@simple.dallas.tx.us;
	dmarc=none
Received: from scrappy.simplesystems.org (scrappy.simplesystems.org [65.66.246.73])
	by smtp.simplesystems.org (8.14.4+Sun/8.14.4) with ESMTP id 2AD1rlR6019797;
	Sat, 12 Nov 2022 19:53:48 -0600 (CST)
Date: Sat, 12 Nov 2022 19:53:47 -0600 (CST)
From: Bob Friesenhahn <bfriesen@simple.dallas.tx.us>
X-X-Sender: bfriesen@scrappy.simplesystems.org
To: andy thomas <andy@time-domain.co.uk>
cc: freebsd-fs@FreeBSD.org
Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync
In-Reply-To: <alpine.BSF.2.22.395.2211112008220.30520@mail0.time-domain.net>
Message-ID: <alpine.GSO.2.20.2211121949060.7126@scrappy.simplesystems.org>
References: <alpine.BSF.2.22.395.2211111709230.29479@mail0.time-domain.net> <CAOgwaMuoLQ9Er67Y+=q+f9724v2WT3L5v5TZaRVXq+=1vEyJ+A@mail.gmail.com> <alpine.BSF.2.22.395.2211112008220.30520@mail0.time-domain.net>
User-Agent: Alpine 2.20 (GSO 67 2015-01-07)
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Archive: https://lists.freebsd.org/archives/freebsd-fs
List-Help: <mailto:freebsd-fs+help@freebsd.org>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Subscribe: <mailto:freebsd-fs+subscribe@freebsd.org>
List-Unsubscribe: <mailto:freebsd-fs+unsubscribe@freebsd.org>
Sender: owner-freebsd-fs@freebsd.org
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII; format=flowed
X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (smtp.simplesystems.org [65.66.246.90]); Sat, 12 Nov 2022 19:53:48 -0600 (CST)
X-Spamd-Bar: ---
X-Spamd-Result: default: False [-3.21 / 15.00];
	NEURAL_HAM_SHORT(-1.00)[-1.000];
	NEURAL_HAM_LONG(-0.99)[-0.988];
	NEURAL_HAM_MEDIUM(-0.92)[-0.918];
	R_SPF_ALLOW(-0.20)[+mx];
	MIME_GOOD(-0.10)[text/plain];
	MLMMJ_DEST(0.00)[freebsd-fs@FreeBSD.org];
	R_DKIM_NA(0.00)[];
	FROM_EQ_ENVFROM(0.00)[];
	RCPT_COUNT_TWO(0.00)[2];
	MIME_TRACE(0.00)[0:+];
	RCVD_TLS_LAST(0.00)[];
	DMARC_NA(0.00)[dallas.tx.us];
	ASN(0.00)[asn:7018, ipnet:65.64.0.0/13, country:US];
	ARC_NA(0.00)[];
	TO_MATCH_ENVRCPT_SOME(0.00)[];
	FROM_HAS_DN(0.00)[];
	TO_DN_SOME(0.00)[];
	RCVD_COUNT_TWO(0.00)[2]
X-Rspamd-Queue-Id: 4N8wTb3FPKz4NVy
X-ThisMailContainsUnwantedMimeParts: N

On Fri, 11 Nov 2022, andy thomas wrote:

> Yes, I can confirm the rsync --delete option is being used and in fact, 'du' 
> reports some of the mirrored folders as having identical sizes on both 
> servers, mainly those containing only small amounts of data.

I forgot to mention that a proven solution when using rsync is to use 
the '--inplace --no-whole-file' options.  These options help rsync to 
avoid doing wasteful things when updating existing files on a ZFS 
filesystem.

Bob
-- 
Bob Friesenhahn
bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/
GraphicsMagick Maintainer,    http://www.GraphicsMagick.org/
Public Key,     http://www.simplesystems.org/users/bfriesen/public-key.txt