From nobody Mon Jul 15 08:41:07 2024
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WMwf92BFMz5QQZj
	for <freebsd-stable@mlmmj.nyi.freebsd.org>; Mon, 15 Jul 2024 08:41:21 +0000 (UTC)
	(envelope-from jason@tubnor.net)
Received: from mail.tubnor.net (mail.tubnor.net [103.236.162.16])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512)
	(Client did not present a certificate)
	by mx1.freebsd.org (Postfix) with ESMTPS id 4WMwf81mpcz4r9d
	for <freebsd-stable@freebsd.org>; Mon, 15 Jul 2024 08:41:19 +0000 (UTC)
	(envelope-from jason@tubnor.net)
Authentication-Results: mx1.freebsd.org;
	none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tubnor.net; s=20220915;
	t=1721032867;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 in-reply-to:in-reply-to:references:references;
	bh=QIT50sdUrjL0baZiXhpRT537mHaWl09fqQa+N8XtqFw=;
	b=S0CeKCEnVX9ELNXveg99IlcCjwdD+bwx+KdkVmvd/AMjOvPFI/r4a6HjnUJmACgdobJnCd
	LxW88fjUqp2xVbeCa1euOn/5Li7dY/TYOKCrJCHGeB04iAmmYHo8pn5KYv7oXf7EiPh87L
	z8speJoRXfQ49YAtISRnLRSrJxuRqH4=
Received: from [IPV6:2403:5812:73e6:1:9027:c672:210b:50b3] (<unknown> [2403:5812:73e6:1:9027:c672:210b:50b3])
	by mel01.ar18.net (OpenSMTPD) with ESMTPSA id c3b22763 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO);
	Mon, 15 Jul 2024 18:41:06 +1000 (AEST)
Content-Type: multipart/alternative;
 boundary="------------9hZ3ONBn9Gi0sAlLBwBHRgUS"
Message-ID: <b8d25aa4-4f66-440e-b2ba-043c4dcfed69@tubnor.net>
Date: Mon, 15 Jul 2024 18:41:07 +1000
List-Id: Production branch of FreeBSD source code <freebsd-stable.freebsd.org>
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: <mailto:stable+help@freebsd.org>
List-Post: <mailto:stable@freebsd.org>
List-Subscribe: <mailto:stable+subscribe@freebsd.org>
List-Unsubscribe: <mailto:stable+unsubscribe@freebsd.org>
X-BeenThere: freebsd-stable@freebsd.org
Sender: owner-freebsd-stable@FreeBSD.org
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: Possible bug in zfs send or pipe implementation?
To: Garrett Wollman <wollman@bimajority.org>,
 Rick Macklem <rick.macklem@gmail.com>
Cc: freebsd-stable@freebsd.org
References: <26259.12713.114036.564205@hergotha.csail.mit.edu>
 <CAM5tNy4pPF9mHdXM5W6gjztm4_TtFfXnOLu3cdkqvaRf3Ab5uA@mail.gmail.com>
 <26259.17366.276955.824313@hergotha.csail.mit.edu>
 <CAM5tNy5m9-rqNTWJP5wAs9FewB6=FW9XbAe4V7qLgnrYJkSFKA@mail.gmail.com>
 <26260.24797.484878.694868@hergotha.csail.mit.edu>
Content-Language: en-US
From: Jason Tubnor <jason@tubnor.net>
In-Reply-To: <26260.24797.484878.694868@hergotha.csail.mit.edu>
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	TAGGED_RCPT(0.00)[];
	ASN(0.00)[asn:133159, ipnet:103.236.162.0/23, country:AU]
X-Rspamd-Queue-Id: 4WMwf81mpcz4r9d

This is a multi-part message in MIME format.
--------------9hZ3ONBn9Gi0sAlLBwBHRgUS
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit


On 15/07/2024 9:35 am, Garrett Wollman wrote:
> I'm currently running syncoid with `--quiet`, which removes `pv` from
> the pipeline.  It seems to be moving along, but of course I can't
> easily tell what it's doing.
>
> Without `pv` in the way, the process reading the pipe is `lzop`
> instead, which doesn't try to do any fancy select() stuff, it's just a
> normal filter reading data from stdin and writing compressed data to
> stdout, in sequence.

I'm having the same issue here. I thought it was just my hardware and/or 
syncoid that was having this issue on 3.5TB dataset replications.

I'll try the quiet mode to see if removing PV solves the problem. I'm 
also using compression=none so I won't see lzop.

Cheers.

--------------9hZ3ONBn9Gi0sAlLBwBHRgUS
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 7bit

<!DOCTYPE html>
<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p><br>
    </p>
    <div class="moz-cite-prefix">On 15/07/2024 9:35 am, Garrett Wollman
      wrote:<br>
    </div>
    <blockquote type="cite"
      cite="mid:26260.24797.484878.694868@hergotha.csail.mit.edu">
      <pre class="moz-quote-pre" wrap="">I'm currently running syncoid with `--quiet`, which removes `pv` from
the pipeline.  It seems to be moving along, but of course I can't
easily tell what it's doing.

Without `pv` in the way, the process reading the pipe is `lzop`
instead, which doesn't try to do any fancy select() stuff, it's just a
normal filter reading data from stdin and writing compressed data to
stdout, in sequence.
</pre>
    </blockquote>
    <p>I'm having the same issue here. I thought it was just my hardware
      and/or syncoid that was having this issue on 3.5TB dataset
      replications.</p>
    <p>I'll try the quiet mode to see if removing PV solves the problem.
      I'm also using compression=none so I won't see lzop.</p>
    <p>Cheers.<br>
    </p>
    <blockquote type="cite"
      cite="mid:26260.24797.484878.694868@hergotha.csail.mit.edu">
      <pre class="moz-quote-pre" wrap=""><span
      style="white-space: pre-wrap">
</span></pre>
    </blockquote>
  </body>
</html>

--------------9hZ3ONBn9Gi0sAlLBwBHRgUS--