Re: Zpool with latest feature com.delpfix:head_errlog can not be booted from.

From: Toomas Soome <tsoome_at_me.com>
Date: Sat, 21 May 2022 06:23:30 UTC
Hi!

You can find binaries from boot.tar <http://148-52-235-80.sta.estpak.ee/boot.tar>

root@freebsd:~ # zpool get all
NAME   PROPERTY                       VALUE                          SOURCE
zroot  size                           29.6G                          -
zroot  capacity                       68%                            -
zroot  altroot                        -                              default
zroot  health                         ONLINE                         -
zroot  guid                           7047501746656921268            -
zroot  version                        -                              default
zroot  bootfs                         zroot/ROOT/default-15          local
zroot  delegation                     on                             default
zroot  autoreplace                    off                            default
zroot  cachefile                      -                              default
zroot  failmode                       wait                           default
zroot  listsnapshots                  off                            default
zroot  autoexpand                     on                             local
zroot  dedupratio                     1.00x                          -
zroot  free                           9.36G                          -
zroot  allocated                      20.3G                          -
zroot  readonly                       off                            -
zroot  ashift                         0                              default
zroot  comment                        -                              default
zroot  expandsize                     -                              -
zroot  freeing                        0                              -
zroot  fragmentation                  66%                            -
zroot  leaked                         0                              -
zroot  multihost                      off                            default
zroot  checkpoint                     -                              -
zroot  load_guid                      17322783153073627560           -
zroot  autotrim                       off                            default
zroot  compatibility                  off                            default
zroot  feature@async_destroy          enabled                        local
zroot  feature@empty_bpobj            active                         local
zroot  feature@lz4_compress           active                         local
zroot  feature@multi_vdev_crash_dump  enabled                        local
zroot  feature@spacemap_histogram     active                         local
zroot  feature@enabled_txg            active                         local
zroot  feature@hole_birth             active                         local
zroot  feature@extensible_dataset     active                         local
zroot  feature@embedded_data          active                         local
zroot  feature@bookmarks              enabled                        local
zroot  feature@filesystem_limits      enabled                        local
zroot  feature@large_blocks           enabled                        local
zroot  feature@large_dnode            enabled                        local
zroot  feature@sha512                 enabled                        local
zroot  feature@skein                  enabled                        local
zroot  feature@edonr                  enabled                        local
zroot  feature@userobj_accounting     active                         local
zroot  feature@encryption             enabled                        local
zroot  feature@project_quota          active                         local
zroot  feature@device_removal         enabled                        local
zroot  feature@obsolete_counts        enabled                        local
zroot  feature@zpool_checkpoint       enabled                        local
zroot  feature@spacemap_v2            active                         local
zroot  feature@allocation_classes     enabled                        local
zroot  feature@resilver_defer         enabled                        local
zroot  feature@bookmark_v2            enabled                        local
zroot  feature@redaction_bookmarks    enabled                        local
zroot  feature@redacted_datasets      enabled                        local
zroot  feature@bookmark_written       enabled                        local
zroot  feature@log_spacemap           active                         local
zroot  feature@livelist               enabled                        local
zroot  feature@device_rebuild         enabled                        local
zroot  feature@zstd_compress          enabled                        local
zroot  feature@draid                  enabled                        local
zroot  feature@zilsaxattr             active                         local
zroot  feature@head_errlog            active                         local
root@freebsd:~ # 

after re.installing boot programs, it does boot, also does work:
root@freebsd:~ # /usr/obj/usr/src/amd64.amd64/stand/userboot/test/test -d /dev/da0

the fix is already pushed.

rgds,
toomas

> On 21. May 2022, at 03:56, Larry Rosenman <ler@lerctr.org> wrote:
> 
> Can you let me know when a replacement binary is available for EFI?  I have my buildbox/dev system in a non-bootable
> state.  It's RAIDZ-1 pool, and no place to put another disk.
> 
> Thanks for any help.
> (If <someone> can email the replacement binary that would be wonderful).
> 
> 
> On 05/20/2022 4:47 am, Toomas Soome wrote:
>> I’ll see into it. It would be nice to have at least heads up message
>> about such features, or zfs code does have means to block feature
>> upgrade on boot pool.
>> Rgds,
>> Toomas
>>> On 20. May 2022, at 11:39, Johan Hendriks <joh.hendriks@gmail.com> wrote:
>>> I did upgrade my FreeBSD Current and with that i updated my storage pool and my zroot pool.
>>> I did add the new gptboot code on the disk. After the reboot i can not boot anymore.
>>> So i did reinstall the os on one disk of the old zroot mirror pool and did leave the second untouched.
>>> Then i can import the pools.
>>> If i boot with the latest snapshot ISO (FreeBSD-14.0-CURRENT-amd64-20220519-716fd348e01-255696-disc1.iso) i see the following when i boot.
>>> BIOS drive A: is fd0
>>> BIOS drive B: is fd1
>>> <SNAP>
>>> BIOS drive K: is disk9
>>> ZFS: unsupported feature: com.delpfix:head_errlog
>>> ZFS: pool zroot is not supported
>>> ZFS: unsupported feature: com.delpfix:head_errlog
>>> ZFS: pool storage is not supported
>>> BIOS 624kB/2000420kB available memory
>>> Then the OS is loaded, if i then go to the shell of the installer and do a zpool import, ik can import the pool zroot and storage. So this snapshot has the latest ZFS version with the com.delpfix:head_errlog feature. So it looks like the bootloader is not able to use the new feature and thus renders your system unbootable.
>>> regards
>>> Johan
> 
> -- 
> Larry Rosenman                     http://www.lerctr.org/~ler
> Phone: +1 214-642-9640                 E-Mail: ler@lerctr.org
> US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106