From nobody Sat May 21 21:40:59 2022 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1501C1B3E628 for ; Sat, 21 May 2022 21:41:02 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [IPv6:2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.lerctr.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5H8Y0Thdz3McC for ; Sat, 21 May 2022 21:41:01 +0000 (UTC) (envelope-from ler@lerctr.org) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=ler2019; h=Content-Type:Message-ID:References:In-Reply-To:Subject:Cc:To: From:Date:MIME-Version:Sender:Reply-To:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=Ib2qpZ83c7fOizIztNPQTdLsCqGBFGYBAT4Jk2tcjC8=; b=K011AGEBBz0FvRzARUJDbXOP+g vtW6ihzVrkR+JKXCWBsBZ0ff9jsL1uIdRTHSvSKYRb0y6+4zowIMFPyWVWZj75eIVY+6Ow8cMMwjz of85L5g/2fff+9ujmBStDaaaayz9FVIB2g1BV+++nvZafmJNMbbAJqOEyAUjS67SN2MVk+Ut/t2Gj E4z3SUMU3Gnb0mut9wYb+5AFdyN7GqVoH1zIu1WO2PPfwxp7n7htYPgbVxmbCS2gm5T4qQLVd3U9O dd/2r0aBZuF+rWH3ttceo40cLgqNA0LOwpG8S7sJHALOeR9RSqssWTzSJDa0Yf2tcU493bUmApug2 qgXjiTWA==; Received-SPF: pass (thebighonker.lerctr.org: domain of lerctr.org designates 2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4 as permitted sender) client-ip=2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4; envelope-from=ler@lerctr.org; helo=webmail.lerctr.org; Received: from thebighonker.lerctr.org ([2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4]:31391 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.95 (FreeBSD)) (envelope-from ) id 1nsWqJ-0006T1-Ez; Sat, 21 May 2022 16:40:59 -0500 Received: from 2600:1700:210:b18f:2d0f:6fbd:3e75:113d by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Sat, 21 May 2022 16:40:59 -0500 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Date: Sat, 21 May 2022 16:40:59 -0500 From: Larry Rosenman To: Toomas Soome Cc: Johan Hendriks , FreeBSD Current Subject: Re: Zpool with latest feature com.delpfix:head_errlog can not be booted from. In-Reply-To: <3603BC68-C972-4DC6-9D94-6863699D9950@me.com> References: <3f367b95-a418-f298-5fe2-972bf2bc1fd4@gmail.com> <2c388d289aaa4ab83ee36622e852adca@lerctr.org> <3603BC68-C972-4DC6-9D94-6863699D9950@me.com> Message-ID: X-Sender: ler@lerctr.org Content-Type: multipart/alternative; boundary="=_db4b03940083b5e34b3f280dc23c1bec" X-Rspamd-Queue-Id: 4L5H8Y0Thdz3McC X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=lerctr.org header.s=ler2019 header.b=K011AGEB; dmarc=pass (policy=none) header.from=lerctr.org; spf=pass (mx1.freebsd.org: domain of ler@lerctr.org designates 2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4 as permitted sender) smtp.mailfrom=ler@lerctr.org X-Spamd-Result: default: False [-3.99 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[lerctr.org:s=ler2019]; FREEFALL_USER(0.00)[ler]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[lerctr.org:+]; DMARC_POLICY_ALLOW(-0.50)[lerctr.org,none]; NEURAL_HAM_SHORT(-0.99)[-0.990]; MLMMJ_DEST(0.00)[freebsd-current]; FREEMAIL_TO(0.00)[me.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:55103, ipnet:2602:fcdb::/36, country:US]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --=_db4b03940083b5e34b3f280dc23c1bec Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII; format=flowed Thanks, Toomas! I'm back up. On 05/21/2022 1:23 am, Toomas Soome wrote: > Hi! > > You can find binaries from boot.tar [1] > > root@freebsd:~ # zpool get all > NAME PROPERTY VALUE > SOURCE > zroot size 29.6G - > zroot capacity 68% - > zroot altroot - > default > zroot health ONLINE - > zroot guid 7047501746656921268 - > zroot version - > default > zroot bootfs zroot/ROOT/default-15 > local > zroot delegation on > default > zroot autoreplace off > default > zroot cachefile - > default > zroot failmode wait > default > zroot listsnapshots off > default > zroot autoexpand on > local > zroot dedupratio 1.00x - > zroot free 9.36G - > zroot allocated 20.3G - > zroot readonly off - > zroot ashift 0 > default > zroot comment - > default > zroot expandsize - - > zroot freeing 0 - > zroot fragmentation 66% - > zroot leaked 0 - > zroot multihost off > default > zroot checkpoint - - > zroot load_guid 17322783153073627560 - > zroot autotrim off > default > zroot compatibility off > default > zroot feature@async_destroy enabled > local > zroot feature@empty_bpobj active > local > zroot feature@lz4_compress active > local > zroot feature@multi_vdev_crash_dump enabled > local > zroot feature@spacemap_histogram active > local > zroot feature@enabled_txg active > local > zroot feature@hole_birth active > local > zroot feature@extensible_dataset active > local > zroot feature@embedded_data active > local > zroot feature@bookmarks enabled > local > zroot feature@filesystem_limits enabled > local > zroot feature@large_blocks enabled > local > zroot feature@large_dnode enabled > local > zroot feature@sha512 enabled > local > zroot feature@skein enabled > local > zroot feature@edonr enabled > local > zroot feature@userobj_accounting active > local > zroot feature@encryption enabled > local > zroot feature@project_quota active > local > zroot feature@device_removal enabled > local > zroot feature@obsolete_counts enabled > local > zroot feature@zpool_checkpoint enabled > local > zroot feature@spacemap_v2 active > local > zroot feature@allocation_classes enabled > local > zroot feature@resilver_defer enabled > local > zroot feature@bookmark_v2 enabled > local > zroot feature@redaction_bookmarks enabled > local > zroot feature@redacted_datasets enabled > local > zroot feature@bookmark_written enabled > local > zroot feature@log_spacemap active > local > zroot feature@livelist enabled > local > zroot feature@device_rebuild enabled > local > zroot feature@zstd_compress enabled > local > zroot feature@draid enabled > local > zroot feature@zilsaxattr active > local > zroot feature@head_errlog active > local > root@freebsd:~ # > > after re.installing boot programs, it does boot, also does work: > root@freebsd:~ # /usr/obj/usr/src/amd64.amd64/stand/userboot/test/test > -d /dev/da0 > > the fix is already pushed. > > rgds, > toomas > > On 21. May 2022, at 03:56, Larry Rosenman wrote: > > Can you let me know when a replacement binary is available for EFI? I > have my buildbox/dev system in a non-bootable > state. It's RAIDZ-1 pool, and no place to put another disk. > > Thanks for any help. > (If can email the replacement binary that would be > wonderful). > > On 05/20/2022 4:47 am, Toomas Soome wrote: > I'll see into it. It would be nice to have at least heads up message > about such features, or zfs code does have means to block feature > upgrade on boot pool. > Rgds, > Toomas > On 20. May 2022, at 11:39, Johan Hendriks > wrote: > I did upgrade my FreeBSD Current and with that i updated my storage > pool and my zroot pool. > I did add the new gptboot code on the disk. After the reboot i can not > boot anymore. > So i did reinstall the os on one disk of the old zroot mirror pool and > did leave the second untouched. > Then i can import the pools. > If i boot with the latest snapshot ISO > (FreeBSD-14.0-CURRENT-amd64-20220519-716fd348e01-255696-disc1.iso) i > see the following when i boot. > BIOS drive A: is fd0 > BIOS drive B: is fd1 > > BIOS drive K: is disk9 > ZFS: unsupported feature: com.delpfix:head_errlog > ZFS: pool zroot is not supported > ZFS: unsupported feature: com.delpfix:head_errlog > ZFS: pool storage is not supported > BIOS 624kB/2000420kB available memory > Then the OS is loaded, if i then go to the shell of the installer and > do a zpool import, ik can import the pool zroot and storage. So this > snapshot has the latest ZFS version with the com.delpfix:head_errlog > feature. So it looks like the bootloader is not able to use the new > feature and thus renders your system unbootable. > regards > Johan -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 Links: ------ [1] http://148-52-235-80.sta.estpak.ee/boot.tar --=_db4b03940083b5e34b3f280dc23c1bec Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Thanks, Toomas!  I'm back up. 


On 05/21/2022 1:23 am, Toomas Soome wrote:

Hi!
 
You can find binaries from boot.tar
 
root@freebsd:~ # zpool get all
NAME   PROPERTY        = ;               VALUE     = ;                     SOU= RCE
zroot  size         &n= bsp;                 29.6G  &n= bsp;                     =   -
zroot  capacity        = ;               68%      =                      = ; -
zroot  altroot        =                 -    &nbs= p;                     &n= bsp;   default
zroot  health         =                 ONLINE    = ;                     -
zroot  guid         &n= bsp;                 70475017466569= 21268            -
zroot  version        =                 -    &nbs= p;                     &n= bsp;   default
zroot  bootfs         =                 zroot/ROOT/default-= 15          local
zroot  delegation       &nb= sp;             on        = ;                     def= ault
zroot  autoreplace      &nb= sp;             off       = ;                     def= ault
zroot  cachefile       = ;               -      &n= bsp;                     =   default
zroot  failmode        = ;               wait      = ;                     def= ault
zroot  listsnapshots      &= nbsp;           off        &nb= sp;                   default<= /span>
zroot  autoexpand       &nb= sp;             on        = ;                     loc= al
zroot  dedupratio       &nb= sp;             1.00x      &nb= sp;                   -=
zroot  free         &n= bsp;                 9.36G  &n= bsp;                     =   -
zroot  allocated       = ;               20.3G     = ;                     -
zroot  readonly        = ;               off      =                      = ; -
zroot  ashift         =                 0    &nbs= p;                     &n= bsp;   default
zroot  comment        =                 -    &nbs= p;                     &n= bsp;   default
zroot  expandsize       &nb= sp;             -        =                      = ; -
zroot  freeing        =                 0    &nbs= p;                     &n= bsp;   -
zroot  fragmentation      &= nbsp;           66%        &nb= sp;                   -=
zroot  leaked         =                 0    &nbs= p;                     &n= bsp;   -
zroot  multihost       = ;               off      =                      = ; default
zroot  checkpoint       &nb= sp;             -        =                      = ; -
zroot  load_guid       = ;               17322783153073627560 &nb= sp;         -
zroot  autotrim        = ;               off      =                      = ; default
zroot  compatibility      &= nbsp;           off        &nb= sp;                   default<= /span>
zroot  feature@async_destroy    =       enabled             = ;           local
zroot  feature@empty_bpobj    &n= bsp;       active             =             local
zroot  feature@lz4_compress     =       active              = ;           local
zroot  feature@multi_vdev_crash_dump = enabled                  &nbs= p;     local
zroot  feature@spacemap_histogram   &= nbsp; active                  =       local
zroot  feature@enabled_txg    &n= bsp;       active             =             local
zroot  feature@hole_birth     &n= bsp;       active             =             local
zroot  feature@extensible_dataset   &= nbsp; active                  =       local
zroot  feature@embedded_data    =       active              = ;           local
zroot  feature@bookmarks    &nbs= p;         enabled          &n= bsp;             local
zroot  feature@filesystem_limits  &nb= sp;   enabled                &= nbsp;       local
zroot  feature@large_blocks     =       enabled             = ;           local
zroot  feature@large_dnode    &n= bsp;       enabled            =             local
zroot  feature@sha512      =           enabled        &nbs= p;               local
zroot  feature@skein      &= nbsp;           enabled       =                 local
zroot  feature@edonr      &= nbsp;           enabled       =                 local
zroot  feature@userobj_accounting   &= nbsp; active                  =       local
zroot  feature@encryption     &n= bsp;       enabled            =             local
zroot  feature@project_quota    =       active              = ;           local
zroot  feature@device_removal    = ;     enabled              &nb= sp;         local
zroot  feature@obsolete_counts   = ;     enabled              &nb= sp;         local
zroot  feature@zpool_checkpoint   &nb= sp;   enabled                &= nbsp;       local
zroot  feature@spacemap_v2    &n= bsp;       active             =             local
zroot  feature@allocation_classes   &= nbsp; enabled                 =       local
zroot  feature@resilver_defer    = ;     enabled              &nb= sp;         local
zroot  feature@bookmark_v2    &n= bsp;       enabled            =             local
zroot  feature@redaction_bookmarks  &= nbsp; enabled                 =       local
zroot  feature@redacted_datasets  &nb= sp;   enabled                &= nbsp;       local
zroot  feature@bookmark_written   &nb= sp;   enabled                &= nbsp;       local
zroot  feature@log_spacemap     =       active              = ;           local
zroot  feature@livelist     &nbs= p;         enabled          &n= bsp;             local
zroot  feature@device_rebuild    = ;     enabled              &nb= sp;         local
zroot  feature@zstd_compress    =       enabled             = ;           local
zroot  feature@draid      &= nbsp;           enabled       =                 local
zroot  feature@zilsaxattr     &n= bsp;       active             =             local
zroot  feature@head_errlog    &n= bsp;       active             =             local
root@freebsd:~ # 
 
after re.installing boot programs, it does boot= , also does work:
root@freebsd:~ # /usr/obj/usr/src/amd64.amd64/s= tand/userboot/test/test -d /dev/da0
 
the fix is already pushed.
 
rgds,
toomas


Can you let me know when a replacement binary is available for EFI? &n= bsp;I have my buildbox/dev system in a non-bootable
state.  It's = RAIDZ-1 pool, and no place to put another disk.

Thanks for any h= elp.
(If <someone> can email the replacement binary that would b= e wonderful).


On 05/20/2022 4:47 am, Toomas Soome wrote:
I'll see into it. It would be nice to have at least he= ads up message
about such features, or zfs code does have means to blo= ck feature
upgrade on boot pool.
Rgds,
Toomas
On 20. May 2022, at 11:39, Johan Hendriks <joh.hendriks@gmail.co= m> wrote:
I did upgrade my FreeBSD Current and with that i upda= ted my storage pool and my zroot pool.
I did add the new gptboot code = on the disk. After the reboot i can not boot anymore.
So i did reinsta= ll the os on one disk of the old zroot mirror pool and did leave the second= untouched.
Then i can import the pools.
If i boot with the lates= t snapshot ISO (FreeBSD-14.0-CURRENT-amd64-20220519-716fd348e01-255696-disc= 1.iso) i see the following when i boot.
BIOS drive A: is fd0
BIOS= drive B: is fd1
<SNAP>
BIOS drive K: is disk9
ZFS: un= supported feature: com.delpfix:head_errlog
ZFS: pool zroot is not supp= orted
ZFS: unsupported feature: com.delpfix:head_errlog
ZFS: pool= storage is not supported
BIOS 624kB/2000420kB available memory
T= hen the OS is loaded, if i then go to the shell of the installer and do a z= pool import, ik can import the pool zroot and storage. So this snapshot has= the latest ZFS version with the com.delpfix:head_errlog feature. So it loo= ks like the bootloader is not able to use the new feature and thus renders = your system unbootable.
regards
Johan

--
Larry Rosenman        &nb= sp;            = http://www.lerctr.org/~ler
Phone: +1 214-642-9640  =             &nb= sp;  E-Mail:= ler@lerctr.org
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106=


= -- 
Larry Rosenman     &n= bsp;            = ;   http://www.lerctr.org/~ler
Phone: +1 = 214-642-9640           &n= bsp;     E-Mail: ler@lerctr.org
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106=
--=_db4b03940083b5e34b3f280dc23c1bec--