From nobody Mon Feb 07 12:29:32 2022 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F3E9619AFDF9 for ; Mon, 7 Feb 2022 12:29:33 +0000 (UTC) (envelope-from jamie@catflap.org) Received: from donotpassgo.dyslexicfish.net (donotpassgo.dyslexicfish.net [IPv6:2001:19f0:300:2185:123::1]) by mx1.freebsd.org (Postfix) with ESMTP id 4Jslnn21Mpz4Rmg for ; Mon, 7 Feb 2022 12:29:33 +0000 (UTC) (envelope-from jamie@catflap.org) Received: from donotpassgo.dyslexicfish.net (donotpassgo.dyslexicfish.net [104.207.135.49]) by donotpassgo.dyslexicfish.net (8.14.5/8.14.5) with ESMTP id 217CTX4c072477 for ; Mon, 7 Feb 2022 12:29:33 GMT (envelope-from jamie@donotpassgo.dyslexicfish.net) Received: (from jamie@localhost) by donotpassgo.dyslexicfish.net (8.14.5/8.14.5/Submit) id 217CTWBe072476 for freebsd-current@FreeBSD.org; Mon, 7 Feb 2022 12:29:32 GMT (envelope-from jamie) From: Jamie Landeg-Jones Message-Id: <202202071229.217CTWBe072476@donotpassgo.dyslexicfish.net> Date: Mon, 07 Feb 2022 12:29:32 +0000 Organization: Dyslexic Fish To: freebsd-current@FreeBSD.org Subject: Re: USB Disk Stalls on -current References: <7e8459e4-d708-7750-402c-cda2adf6199f@freebsd.org> <60ebd011-c2b8-3524-1476-123f11128ffe@freebsd.org> In-Reply-To: User-Agent: Heirloom mailx 12.4 7/29/08 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.7 (donotpassgo.dyslexicfish.net [104.207.135.49]); Mon, 07 Feb 2022 12:29:33 +0000 (GMT) X-Rspamd-Queue-Id: 4Jslnn21Mpz4Rmg X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=catflap.org; spf=pass (mx1.freebsd.org: domain of jamie@catflap.org designates 2001:19f0:300:2185:123::1 as permitted sender) smtp.mailfrom=jamie@catflap.org X-Spamd-Result: default: False [0.28 / 15.00]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[jamie]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx:dyslexicfish.net:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; TO_DN_NONE(0.00)[]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; RCPT_COUNT_ONE(0.00)[1]; HAS_ORG_HEADER(0.00)[]; NEURAL_SPAM_SHORT(0.97)[0.973]; NEURAL_HAM_LONG(-0.99)[-0.994]; DMARC_POLICY_ALLOW(-0.50)[catflap.org,none]; MLMMJ_DEST(0.00)[freebsd-current]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:20473, ipnet:2001:19f0::/38, country:US]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N grarpamp wrote: > Yes, some USB hw is very flaky, > but ZFS can work great on these... For what it's worth, I have had for 2.5 years, tracking stable, a NAS hanging off a single NUC usb port, with 14 hard disks, 12 of which are used for 2 ZFS, spools, of two 3X2 mirror spools. Albeit, I'm using USB3 During heavy writes, I often get: [1429164] (da10:umass-sim10:10:0:0): WRITE(16). CDB: 8a 00 00 00 00 02 04 39 b2 80 00 00 01 00 00 00 [1429164] (da10:umass-sim10:10:0:0): CAM status: CCB request completed with an error [1429164] (da10:umass-sim10:10:0:0): Retrying command, 14 more tries remain , but with no errors or timeouts. I scrub regularly etc. It rarely has to attempt a retry more than once (although I did bump "kern.cam.da.retry_count" up to 15 a while back while dealing with another issue, and never changed it back) I only get about 300MB/s maximum on file reads though, but the current USB daisychaining I use isn't ideal. (Each raw disk individually give 150MB/s) The only issue I have is occasionally the main USB hub craps out, and all the disks disappear for a few seconds. When it recovers, and the OS sees the disks again, things remain weird until a reboot. cheers, Jamie