Re: CURRRENT snapshot won't boot due missing ZFS feature

On Thu, 8 Jun 2023 11:32:19 -0600
Warner Losh <imp@bsdimp.com> wrote:

> On Thu, Jun 8, 2023, 11:18 AM Michael Gmelin <grembo@freebsd.org>
> wrote:
> 
> > >
> > > Tried today's snaphot, same problem.
> > >
> > >   # reboot
> > >   Waiting (max 60 seconds) for system process `vnlru' to stop...
> > > done Waiting (max 60 seconds) for system process `syncer' to
> > > stop... Syncing disks, vnodes remaining... 0 0 0 0 done
> > >   All buffers synced.
> > >   Uptime: 4m14s
> > >   Consoles: userboot
> > >
> > >   FreeBSD/amd64 User boot lua, Revision 1.2
> > >   ZFS: unsupported feature: com.klarasystems:vdev_zaps_v2
> > >   ERROR: cannot open /boot/lua/loader.lua: no such file or
> > > directory.
> > >
> > >
> > >   Type '?' for a list of commands, 'help' for more detailed help.
> > >   OK
> > >
> > >
> > > That's after installing CURRENT in a fresh vm managed by vm-bhyve
> > > using bsdinstall's automatic ZFS option.
> > >  
> >
> > Thinking about this, it's possible that vm-bhyve is using the zfs
> > boot loader from the host machine.
> >
> > Please consider this noise, unless you hear from me again.
> >  
> 
> Yes. It does. This can be an unfortunate design choice at times.
> 

For completeness sake, this is how I boot 14.0 on 13.2 using
sysutils/vm-bhyve:

  ISO=FreeBSD-14.0-CURRENT-amd64-20230608-653738e895ba-263444-bootonly.iso
  export ISO

  cd /mountpoint/for/pool/vm

  vm iso https://download.freebsd.org/snapshots/ISO-IMAGES/14.0/$ISO
  mkdir .loaders
  tar --strip-components 1 -C .loaders -xf .iso/$ISO boot/userboot.so
  mv .loaders/userboot.so .loaders/userboot14.so

  vm create test14
  sysrc -f test14/test14.conf memory=1G
  sysrc -f test14/test14.conf \
    bhyveload_loader="$(realpath .loaders/userboot14.so)"

OS installation is done the usual way (using tmux instead of cu in this
example):

  pkg install -y tmux
  sysrc -f .config/system.conf console=tmux
  vm install test14 $ISO
  tmux attach -t test14


Best
Michael

-- 
Michael Gmelin