From nobody Thu Apr 18 14:21:14 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VL0M02RZdz5GxhJ for ; Thu, 18 Apr 2024 14:21:16 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VL0Lz0vWqz4XwL for ; Thu, 18 Apr 2024 14:21:15 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 43IELFM6014075 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL); Thu, 18 Apr 2024 10:21:15 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:48c2:ffd8:e147:2c2e] ([IPv6:2607:f3e0:0:4:48c2:ffd8:e147:2c2e]) by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 43IELEAJ099626 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Thu, 18 Apr 2024 10:21:14 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: Date: Thu, 18 Apr 2024 10:21:14 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: zfs boot error on mirrored drive From: mike tancsa To: FreeBSD-STABLE Mailing List References: <82761f2b-475f-43ab-b045-95c60c330db7@sentex.net> <0c069bca-b512-457b-8934-66b859f449db@sentex.net> Content-Language: en-US Autocrypt: addr=mike@sentex.net; keydata= xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg== In-Reply-To: <0c069bca-b512-457b-8934-66b859f449db@sentex.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.86 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.39 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received]; XM_UA_NO_VERSION(0.01)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; FREEFALL_USER(0.00)[mike]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; TO_DN_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DMARC_NA(0.00)[sentex.net]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4VL0Lz0vWqz4XwL On 4/18/2024 10:09 AM, mike tancsa wrote: > On 4/18/2024 10:04 AM, Miroslav Lachman wrote: >> I am not a ZFS expert but can this be stored in a >> /etc/zfs/zpool.cache? (or in a different path, I remember zpool.cache >> was stored somewhere else in older versions of FreeBSD, maybe >> /boot/zfs/zpool.cache) >> You can try to delete zpool.cache (just rename so you can move it >> back), import and export should re-create it. >> > I dont have one in /etc just in /boot/zfs.  Doing a strings on that > file, I dont see reference to zbackup1 however, just the real pool, > zroot. So strange. I am guessing its stored somewhere specifically on > the individual drives? > OK a little further.  Looking at the output of zdb -l /dev/ada0 I see LABEL 1 has the old info where as zdb -l /dev/ada1 only shows the active pool zroot. So I guess the question is how do I get rid of LABEL 1 on ada0. I guess I could offline the disk, do a full zpool-labelclear on /dev/ada0 and then "replace" ada0p3 with ada0p3.  But I wonder if there is a more surgical way to do it ?  zdb -l /dev/ada0 failed to unpack label 0 ------------------------------------ LABEL 1 ------------------------------------     version: 5000     name: 'zbackup1'     state: 0     txg: 37258100     pool_guid: 5819795054093255811     hostid: 2940363587     hostname: 'otherhost.sentex.ca'     top_guid: 15407571356201067876     guid: 7177971506633653196     hole_array[0]: 1     vdev_children: 3     vdev_tree:         type: 'raidz'         id: 2         guid: 15407571356201067876         nparity: 2         metaslab_array: 115         metaslab_shift: 36         ashift: 9         asize: 12002364751872         is_log: 0         create_txg: 263935         children[0]:             type: 'disk'             id: 0             guid: 9271219886945262566             path: '/dev/da5'             phys_path: '/dev/diskid/DISK-%20%20%20%20%20WD-WCC1P1023355'             whole_disk: 1             DTL: 618             create_txg: 263935         children[1]:             type: 'disk'             id: 1             guid: 8131984913529158308             path: '/dev/mfisyspd8'             phys_path: '/dev/diskid/DISK-%20%20%20%20%20WD-WMAWP0126093'             whole_disk: 1             DTL: 617             create_txg: 263935         children[2]:             type: 'disk'             id: 2             guid: 10328589068509663454             path: '/dev/mfisyspd7'             phys_path: '/dev/diskid/DISK-%20%20%20%20%20WD-WMAWP0079293'             whole_disk: 1             DTL: 616             create_txg: 263935         children[3]:             type: 'disk'             id: 3             guid: 3414086086163178196             path: '/dev/mfisyspd6'             phys_path: '/dev/diskid/DISK-%20%20%20%20%20WD-WMAUR0331605'             whole_disk: 1             DTL: 615             create_txg: 263935         children[4]:             type: 'disk'             id: 4             guid: 7177971506633653196             path: '/dev/mfisyspd9'             phys_path: '/dev/diskid/DISK-%20%20%20%20%20WD-WMAUR0387259'             whole_disk: 1             DTL: 614             create_txg: 263935         children[5]:             type: 'disk'             id: 5             guid: 17460231907795801757             path: '/dev/da8p1'             whole_disk: 1             not_present: 1             DTL: 262356             create_txg: 263935     features_for_read:         com.delphix:hole_birth         com.delphix:embedded_data     labels = 1 ------------------------------------ LABEL 2 ------------------------------------     version: 5000     name: 'zroot'     state: 0     txg: 61126347     pool_guid: 13987985424735542345     errata: 0     hostname: ''     top_guid: 17259639802746798684     guid: 18413289395104510392     vdev_children: 1     vdev_tree:         type: 'mirror'         id: 0         guid: 17259639802746798684         metaslab_array: 34         metaslab_shift: 34         ashift: 12         asize: 1978918240256         is_log: 0         create_txg: 4         children[0]:             type: 'disk'             id: 0             guid: 18413289395104510392             path: '/dev/ada0p3'             phys_path: 'id1,enc@n3061686369656d30/type@0/slot@1/elmdesc@Slot_00/p3'             whole_disk: 1             DTL: 110             create_txg: 4         children[1]:             type: 'disk'             id: 1             guid: 9245256067651064428             path: '/dev/ada1p3'             phys_path: 'id1,enc@n3061686369656d30/type@0/slot@2/elmdesc@Slot_01/p3'             whole_disk: 1             DTL: 4403             create_txg: 4     features_for_read:         com.delphix:hole_birth         com.delphix:embedded_data     labels = 2 3