From nobody Wed Oct 19 13:31:24 2022 X-Original-To: freebsd-scsi@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mss870TW1z4fyLn for ; Wed, 19 Oct 2022 13:31:35 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from cu1176c.smtpx.saremail.com (cu1176c.smtpx.saremail.com [195.16.148.151]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mss8570ZMz3JCR for ; Wed, 19 Oct 2022 13:31:33 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from smtpclient.apple (unknown [192.148.167.11]) by sieve-smtp-backend02.sarenet.es (Postfix) with ESMTPA id 3A7A960C713; Wed, 19 Oct 2022 15:31:25 +0200 (CEST) From: Borja Marcos Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: SCSI subsystem List-Archive: https://lists.freebsd.org/archives/freebsd-scsi List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-scsi@freebsd.org X-BeenThere: freebsd-scsi@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.1\)) Date: Wed, 19 Oct 2022 15:31:24 +0200 Subject: Broadcom AERO SAS adapter: JBOD personality bug Message-Id: To: "freebsd-scsi@freebsd.org" X-Mailer: Apple Mail (2.3696.120.41.1.1) X-Rspamd-Queue-Id: 4Mss8570ZMz3JCR X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=sarenet.es; spf=pass (mx1.freebsd.org: domain of borjam@sarenet.es designates 195.16.148.151 as permitted sender) smtp.mailfrom=borjam@sarenet.es X-Spamd-Result: default: False [-2.79 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.989]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[sarenet.es,none]; SUBJECT_ENDS_SPACES(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24]; MIME_GOOD(-0.10)[text/plain]; TO_DN_EQ_ADDR_ALL(0.00)[]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-scsi@FreeBSD.org]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Hi, Hope someone from Broadcom is still lurking here ;) I have seen a problem with a new Broadcom Aero SAS adapter on FreeBSD. I = first detected it on TruNAS 12 but the issue affects FreeBSD 13.1 as well. The card came with RAID firmware installed (dealer fault, but with crazy = delivery times now I am afraid we must swallow it) but fortunately it has =E2=80=9CPersonalities=E2=80=9D.=20 So, if I set it up in =E2=80=9CJBOD personality=E2=80=9D it does behave = like a plain HBA. Good! However, I have noticed a problem in the JBOD personality. I am not sure = whether it is a firmware bug, a design error or a problem with the mrsas driver although after a quick look at the = source code I don=E2=80=99t think the driver can solve this. After a disk failure (for example, pulling a disk from the backplane) = the controller will mark it as UNCONFIGURED BAD. Which is a dead end that may require a system reboot = or at least using a tool such as StorCli (if it is possible, I haven=E2=80=99t verified that yet). If this is a design decision I THINK THIS IS A MISTAKE. If the JBOD = personality is equivalent to an HBA (it should be!) the controller firmware should not interfere with decisions made by = the operating system itself. As for the mrsas driver, I am not sure, is there a possibility to add a = tunable so that can ignore the =E2=80=9Cunconfigured badness=E2=80=9D and proceed?=20 The controller is a Broadcom AERO 10E2 Firmware: 5.180.02-2512 NVDATA version: 5.1800.21-0642 Thanks! Borja Marcos.