From nobody Tue Nov 05 19:09:00 2024 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XjdDJ71Fxz5cSnD for ; Tue, 05 Nov 2024 19:09:04 +0000 (UTC) (envelope-from void@f-m.fm) Received: from fhigh-a8-smtp.messagingengine.com (fhigh-a8-smtp.messagingengine.com [103.168.172.159]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4XjdDH6Xy7z4MVT for ; Tue, 5 Nov 2024 19:09:03 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=cwL18W1M; dkim=pass header.d=messagingengine.com header.s=fm3 header.b="j ZPgOI2"; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 103.168.172.159 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from phl-compute-09.internal (phl-compute-09.phl.internal [10.202.2.49]) by mailfhigh.phl.internal (Postfix) with ESMTP id 08C8D1140237 for ; Tue, 5 Nov 2024 14:09:03 -0500 (EST) Received: from phl-mailfrontend-02 ([10.202.2.163]) by phl-compute-09.internal (MEProxy); Tue, 05 Nov 2024 14:09:03 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :message-id:mime-version:reply-to:subject:subject:to:to; s=fm3; t=1730833743; x=1730920143; bh=xbANKzbjXoa2PnFr1a+2AXRcHwvZWwAW VRTiUPvIg1o=; b=cwL18W1MeApDg1F+G9n57fzBd6BzcN+E5aMHVQOHAtHP1BGs jGbksSElIzFztn8YkTN7tgEbdy+WSnXQjHt7T1KmKYEdh7Jfn4GEpVBXNQlVU8of CwTQx3SGIIpQM8h+nrrCEoG9lCVgYHUBaRbwyYP6dgjH1XusuJU4Cc5Ojj+oNFxS WcSPqlFdXdhUkGSY7gtJ9zkZUczXkr+sL6x2sGtW7V8rqyBJ1bAgPIWvX2ZB4Us0 nNOnFXoMoPEtYbglnOu9RoOHL0o1deD1dJGEkA2k6qL0HaWmhm/deomjbgolzM4G BMaV2oi6j+VaOGJmtG95lnRok1ZIFdEaRvD0Pg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:message-id :mime-version:reply-to:subject:subject:to:to:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t=1730833743; x= 1730920143; bh=xbANKzbjXoa2PnFr1a+2AXRcHwvZWwAWVRTiUPvIg1o=; b=j ZPgOI2r8ekV7JW1pnuaf48h4jO6t4OuzDmOF2jccQBTUaywN9pLo6S/BjGjfXEI4 b6hdcNO22Pnx4zO55qQRof/LWmkWQIIuYka4lpyUhARTq9h32kEOagdFSqRVAOGR xiFWdY7gzNsHl8+LdfuSPohI6vwVaBbfFeYqHSVzQJ1xVumpbclH3EKhrs6gAnHD qTpa5oeuQCTj+qjqjLE2gK/esQSr/T7Xe0pWGRZIW/wYI0p92JKFVKL1T5CjRe4A ZEv3AEGnwWcHtWizQ1AclSa3d6qXPOqgtYlKhKhq7g3wY2Ua5mw3ZUZyGRabh3Fz +yCl1yebTL1VHYFt5MPrQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefuddrtddtgdelvdcutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpggftfghnshhusghstghrihgsvgdpuffr tefokffrpgfnqfghnecuuegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukf ggtggusehttdertddttddvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhm qeenucggtffrrghtthgvrhhnpeevudffiedvffffgffhgeefjeefffdtieetheetkeefhf dvfefgtedtueehgeffueenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgr ihhlfhhrohhmpehvohhiugesfhdqmhdrfhhmpdhnsggprhgtphhtthhopedupdhmohguvg epshhmthhpohhuthdprhgtphhtthhopehfrhgvvggsshguqdhfshesfhhrvggvsghsugdr ohhrgh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Tue, 5 Nov 2024 14:09:02 -0500 (EST) Date: Tue, 5 Nov 2024 19:09:00 +0000 From: void To: freebsd-fs@freebsd.org Subject: problem with zfs raidz3 install on an 8-disk system, can't find loader Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline X-Spamd-Result: default: False [-3.68 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.88)[-0.884]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MID_RHS_NOT_FQDN(0.50)[]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; RWL_MAILSPIKE_VERYGOOD(-0.20)[103.168.172.159:from]; R_SPF_ALLOW(-0.20)[+ip4:103.168.172.128/27]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[103.168.172.159:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_COUNT_THREE(0.00)[3]; MIME_TRACE(0.00)[0:+]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ASN(0.00)[asn:209242, ipnet:103.168.172.0/24, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; MISSING_XM_UA(0.00)[]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim] X-Rspamd-Queue-Id: 4XjdDH6Xy7z4MVT X-Spamd-Bar: --- Hi, the context here is * installing from usb2 stick * tried with FreeBSD-14.2-PRERELEASE-amd64-20241024-5ae76ff5138e-269296-memstick.img * also FreeBSD-15.0-CURRENT-amd64-20241031-5212b9500116-273335-memstick.img hardware is ProLiant DL380e Gen8 with 8* 4Tb seagate constellation attached to Smart Array P440 Controller in HBA (JBOD) mode. upon reboot: ### Attempting Boot From Hard Drive (C:) BIOS drive C: is disk0 zio_read error: 5 zio_read error: 5 zio_read error: 5 ZFS: i/o error - all block copies unavailable ZFS: failed to read pool zroot directory object Can't find /boot/zfsloader Can't find /boot/loader Can't find /boot/kernel/kernel FreeBSD/x86 boot Default: /boot/kernel/kernel boot: Can't find /boot/kernel/kernel FreeBSD/x86 boot Default: /boot/kernel/kernel boot: ### This is after the zfs install process runs without error. To be safe, I made sure that before running the install, i went into the shell prompt of the installer and ran gpart destroy -F da0 (repeated for da1-7) to make sure they were just raw disks presented. The installer when started saw all the disks and allows the creation of raidz3 with all of them. but upon removing the usb key and cold-reset, the loader can't be found. If it's booted to the (usb stick) installer again, then going into shell prompt, then running 'zpool import zroot' then 'zfs mount -a', the newly-created filesystem is seen. But it won't boot without the usb key. In an atempt to get round the problem, after zfs load, I made with zfs create: zfs create zroot/boot and copied all the stuff in /boot on the installer into zroot/boot (mounted at that time as /zroot/boot) and tried to boot that to no avail. Is there a way round this? --