From nobody Mon Feb 03 18:24:10 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ymvzj4sgZz5mKpV for ; Mon, 03 Feb 2025 18:24:49 +0000 (UTC) (envelope-from freebsd@walstatt-de.de) Received: from smtp052.goneo.de (smtp052.goneo.de [85.220.129.60]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ymvzh2mNzz3Yvh for ; Mon, 03 Feb 2025 18:24:48 +0000 (UTC) (envelope-from freebsd@walstatt-de.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=walstatt-de.de header.s=DKIM001 header.b=pCDU+Nst; spf=pass (mx1.freebsd.org: domain of freebsd@walstatt-de.de designates 85.220.129.60 as permitted sender) smtp.mailfrom=freebsd@walstatt-de.de; dmarc=none Received: from hub1.goneo.de (hub1.goneo.de [85.220.129.52]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (No client certificate requested) by smtp5.goneo.de (Postfix) with ESMTPS id 7D90C240C4F for ; Mon, 3 Feb 2025 19:24:46 +0100 (CET) Received: from hub1.goneo.de (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (No client certificate requested) by hub1.goneo.de (Postfix) with ESMTPS id AE94824086C for ; Mon, 3 Feb 2025 19:24:44 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=walstatt-de.de; s=DKIM001; t=1738607084; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=CgzsrjkYG/YO3+kv1E0LreGjGgZIAqSvOYmP1q+eQgM=; b=pCDU+NstNtEb/QHslLLsqmmJgB7LX9epCs5r6pxKohmlY85k+cmQvOvfEk86halfPWOhY+ j4OJO9cUJB1GzrZ6WoiiZMjqVbi8iRFaIhzg/FsIjqq9ZAvaIJjkI+J7Nzcz3hf2q9Gmc/ jsSExtW3awG0C+XQkeuyy5g9EPzlS1cAsR37fVfjEpKEsj7UgkUMQGVCb3lZOO+mgvM7PV f3eLl4qPCJOa8yYXsL6FbmkqOMy0ntTU1jwnF75htu/zueCeCwQ8mnnkmNa1AnfLtKQaQB fu16wZiH5KEyxPWK8CiroMg0xFLf0jckn5uxkwIPK/dGemzAhaV6/v7CGDFIjw== Received: from thor.sb211.local (dynamic-2a02-3100-1847-4702-418c-2c49-f819-715a.310.pool.telefonica.de [IPv6:2a02:3100:1847:4702:418c:2c49:f819:715a]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (prime256v1) server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by hub1.goneo.de (Postfix) with ESMTPSA id 79D8C24029B for ; Mon, 3 Feb 2025 19:24:44 +0100 (CET) Date: Mon, 3 Feb 2025 19:24:10 +0100 From: A FreeBSD User To: freebsd-current@freebsd.org Subject: Re: ZFS: Rescue FAULTED Pool Message-ID: <20250203192437.36135323@thor.sb211.local> In-Reply-To: <62da6831-fbc8-4bab-9a4c-6b0ec9dd3585@blastwave.org> References: <20250129112701.0c4a3236@freyja> <20250130123354.2d767c7c@thor.sb211.local> <980401eb-f8f6-44c7-8ee1-5ff0c9e1c35c@freebsd.org> <20250201095656.1bdfbe5f@thor.sb211.local> <62da6831-fbc8-4bab-9a4c-6b0ec9dd3585@blastwave.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_/M3cVul93=Xotfz1RpL_RS5X"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Rspamd-UID: a062de X-Rspamd-UID: 0963d5 X-Spamd-Result: default: False [-6.69 / 15.00]; SIGNED_PGP(-2.00)[]; RBL_SENDERSCORE_REPUT_9(-1.00)[85.220.129.60:from]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.986]; R_SPF_ALLOW(-0.20)[+ip4:85.220.129.0/25]; R_DKIM_ALLOW(-0.20)[walstatt-de.de:s=DKIM001]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[85.220.129.60:from]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MISSING_XM_UA(0.00)[]; ASN(0.00)[asn:25394, ipnet:85.220.128.0/17, country:DE]; DMARC_NA(0.00)[walstatt-de.de]; RCVD_TLS_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[walstatt-de.de:+] X-Spamd-Bar: ------ X-Rspamd-Queue-Id: 4Ymvzh2mNzz3Yvh --Sig_/M3cVul93=Xotfz1RpL_RS5X Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable Am Sat, 1 Feb 2025 09:10:25 -0500 Dennis Clarke schrieb: > >> > >> The most useful thing to share right now would be the output of `zpool > >> import` (with no pool name) on the rebooted system. > >> > >> That will show where the issues are, and suggest how they might be sol= ved. > >> =20 > >=20 > > Hello, this exactly happens when trying to import the pool. Prior to th= e loss, device da1p1 > > has been faulted with numbers in the colum/columns "corrupted data"/fur= ther not seen now. > >=20 > >=20 > > ~# zpool import > > pool: BUNKER00 > > id: XXXXXXXXXXXXXXXXXXXX > > state: FAULTED > > status: The pool metadata is corrupted. > > action: The pool cannot be imported due to damaged devices or data. > > The pool may be active on another system, but can be imported = using > > the '-f' flag. > > see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-72 > > config: > >=20 > > BUNKER00 FAULTED corrupted data > > raidz1-0 ONLINE > > da2p1 ONLINE > > da3p1 ONLINE > > da4p1 ONLINE > > da7p1 ONLINE > > da6p1 ONLINE > > da1p1 ONLINE > > da5p1 ONLINE > >=20 > >=20 > > ~# zpool import -f BUNKER00 > > cannot import 'BUNKER00': I/O error > > Destroy and re-create the pool from > > a backup source. > >=20 > >=20 > > ~# zpool import -F BUNKER00 > > cannot import 'BUNKER00': one or more devices is currently unavailable > > =20 >=20 > This is indeed a sad situation. You have a raidz1 pool with one or > MORE devices that seem to have left the stage. I suspect more than one. >=20 > I can only guess what you see from "camcontrol devlist" as well as > data from "gpart show -l" where we would see the partition data along > with and GPT labels. If in fact you used GPT scheme. You have a list of > devices that all say "p1" there and so I guess you made some sort of a > partition table. ZFS does not need that but it can be nice to have. In > any case, it really does look like you have _more_ than one failure in > there somewhere and only dmesg and some separate tests on each device > would reveal the truth. >=20 >=20 > -- > Dennis Clarke > RISC-V/SPARC/PPC/ARM/CISC > UNIX and Linux spoken >=20 >=20 Hello all! Thank you for your tips! Luckily, "zpool import -FX" as suggested herein did after a while (60-80 mi= nutes) the trick! There might be some data losses - but compared to the alternative bareable. Thank you very much! Kind regards, Oliver --=20 A FreeBSD user --Sig_/M3cVul93=Xotfz1RpL_RS5X Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iHUEARYKAB0WIQRQheDybVktG5eW/1Kxzvs8OqokrwUCZ6EJ5QAKCRCxzvs8Oqok r7s3AQDE7f7eaByBVr197yoIBqDMhT1VQdW7KUQ3weMd0W67GwEAjnmf4bhZCyXY 5Mi/4Q6+65A8jRf74a0bwPIksBQDMAg= =F0IF -----END PGP SIGNATURE----- --Sig_/M3cVul93=Xotfz1RpL_RS5X--