[Bug 271403] System unusable at first boot after install of 13.2-RELEASE amd64
- Reply: bugzilla-noreply_a_freebsd.org: "[Bug 271403] System unusable at first boot after install of 13.2-RELEASE amd64"
- Reply: bugzilla-noreply_a_freebsd.org: "[Bug 271403] System unusable at first boot after install of 13.2-RELEASE amd64"
- Reply: bugzilla-noreply_a_freebsd.org: "[Bug 271403] System unusable at first boot after install of 13.2-RELEASE amd64"
- Go to: [ bottom of page ] [ top of archives ] [ this month ]
Date: Sun, 14 May 2023 00:40:07 UTC
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=271403 Bug ID: 271403 Summary: System unusable at first boot after install of 13.2-RELEASE amd64 Product: Base System Version: 13.2-RELEASE Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: dclarke@blastwave.org SUMMARY : I have recently seen an install of FreeBSD fail quite badly. I can not see a valid reason nor clue to why. Dear FreeBSD folks : I was very careful to boot an IBM Lenovo M30A7 unit with the FreeBSD dvd1 iso image for 13.2 RELEASE. I instantly stopped the UEFI boot and selected to set : set comconsole_speed="9600" set console="comconsole" Then via the serial port I simple type "boot". Following the basic prompts I decide to manually config the boot device as a UEFI with ZFS storage idea. This means I drop to a shell command prompt to utter the following : # camcontrol devlist <ST8000NM002A-2KE102 NN02> at scbus0 target 0 lun 0 (ada0,pass0) <ST16000NM000J-2TW103 SN02> at scbus1 target 0 lun 0 (ada1,pass1) <ST8000NM002A-2KE102 NN03> at scbus2 target 0 lun 0 (ada2,pass2) <AHCI SGPIO Enclosure 2.00 0001> at scbus3 target 0 lun 0 (ses0,pass3) <Samsung SSD 870 QVO 1TB SVQ01B6Q> at scbus6 target 0 lun 0 (ada3,pass4) <ST8000NM002A-2KE102 NN02> at scbus7 target 0 lun 0 (ada4,pass5) <AHCI SGPIO Enclosure 2.00 0001> at scbus9 target 0 lun 0 (ses1,pass6) <Kingston DataTraveler 3.0 PMAP> at scbus10 target 0 lun 0 (pass7,da0) # There we see some Seagate disks of the 8T flavour as well as some single Seagate 16T unit. There is also a single Samsung QVO SSD unit available. I wish to install to the Samsung unit and then deal with redundency at some later time. Thus I begin the process of cleaning up the partition data therein and lay down a new GPT partition : # gpart destroy -F /dev/ada3 ada3 destroyed # zpool labelclear -f /dev/ada3 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) failed to clear label for /dev/ada3 Well that SSD never had a ZFS filesystem nor pool. This is fine. # gpart create -s GPT /dev/ada3 ada3 created # gpart add -t efi -s 256M /dev/ada3 ada3p1 added # gpart add -t freebsd-boot -s 512K /dev/ada3 ada3p2 added # gpart add -t freebsd-swap -s 4G /dev/ada3 ada3p3 added # gpart add -t freebsd-zfs /dev/ada3 ada3p4 added # gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 2 /dev/ada3 partcode written to ada3p2 bootcode written to ada3 Again just to be sure ... nuke out a ZFS label that never existed : # zpool labelclear -f /dev/ada3p4 failed to clear label for /dev/ada3p4 # Fine. We have a device to install to. Create a ZFS ZPool chunk on that device : # zpool create -o altroot=/mnt -O compress=zstd -O checksum=sha512 -O atime=on -O xattr=on -o autoexpand=on -o autoreplace=on -o failmode=continue -o listsnaps=off -O dedup=off -O copies=1 -m none z0 /dev/ada3p4 # Now we lay down the basic fs goodness for FreeBSD : # zfs create -o mountpoint=none -o checksum=sha512 -o compression=zstd -o atime=on -o exec=on -o setuid=on -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/ROOT # # zfs create -o mountpoint=/ -o checksum=sha512 -o compression=zstd -o atime=on -o exec=on -o setuid=on -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/ROOT/default # # zfs create -o mountpoint=/tmp -o checksum=sha512 -o compression=zstd -o atime=on -o exec=on -o setuid=off -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/tmp # # zfs create -o mountpoint=/usr -o canmount=off -o checksum=sha512 -o compression=zstd -o atime=on -o exec=on -o setuid=on -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/usr # # zfs create -o mountpoint=/usr/home -o canmount=on -o checksum=sha512 -o compression=zstd -o atime=on -o exec=on -o setuid=on -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/usr/home # # zfs create -o mountpoint=/usr/ports -o canmount=on -o checksum=sha512 -o compression=zstd -o atime=on -o exec=on -o setuid=on -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/usr/ports # # zfs create -o mountpoint=/usr/src -o canmount=on -o checksum=sha512 -o compression=zstd -o atime=on -o exec=on -o setuid=on -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/usr/src # # zfs create -o mountpoint=/var -o canmount=off -o checksum=sha512 -o compression=zstd -o atime=on -o exec=on -o setuid=on -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/var # # zfs create -o mountpoint=/var/audit -o canmount=on -o checksum=sha512 -o compression=zstd -o atime=on -o exec=off -o setuid=off -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/var/audit # # zfs create -o mountpoint=/var/crash -o canmount=on -o checksum=sha512 -o compression=zstd -o atime=on -o exec=off -o setuid=off -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/var/crash # # zfs create -o mountpoint=/var/log -o canmount=on -o checksum=sha512 -o compression=zstd -o atime=on -o exec=off -o setuid=off -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/var/log # # # zfs create -o mountpoint=/var/mail -o canmount=on -o checksum=sha512 -o compression=zstd -o atime=on -o exec=on -o setuid=on -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/var/mail # Take a look at the damage : # # zfs list -o name,mounted,mountpoint NAME MOUNTED MOUNTPOINT z0 no none z0/ROOT no none z0/ROOT/default yes /mnt z0/tmp yes /mnt/tmp z0/usr no /mnt/usr z0/usr/home yes /mnt/usr/home z0/usr/ports yes /mnt/usr/ports z0/usr/src yes /mnt/usr/src z0/var no /mnt/var z0/var/audit yes /mnt/var/audit z0/var/crash yes /mnt/var/crash z0/var/log yes /mnt/var/log z0/var/mail yes /mnt/var/mail # Looks fine yes? YES. This is goodness. # zfs create -o mountpoint=/var/tmp -o canmount=on -o checksum=sha512 -o compression=zstd -o atime=on -o exec=on -o setuid=off -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/var/tmp # So here comes the thing that may be the wreckage : # zfs create -o mountpoint=/var/db -o canmount=on -o checksum=sha512 \ > -o compression=zstd -o atime=on -o exec=on -o setuid=off \ > -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/var/db # Note that as /var/db which perhaps is a tmpfs? Or some other animal. Regardless I continue : # zpool set bootfs=z0/ROOT/default z0 # # zfs set canmount=noauto z0/ROOT/default # # zfs set mountpoint=/z0 z0 # I like to have a /opt area also and these are harmless. # zfs create -o mountpoint=/opt -o canmount=on -o checksum=sha512 -o compression=zstd -o atime=on -o exec=on -o setuid=on -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/opt # # zfs create -o mountpoint=/var/opt -o canmount=on -o checksum=sha512 -o compression=zstd -o atime=on -o exec=on -o setuid=on -o xattr=on -o copies=1 -o dedup=off -o sync=standard z0/var/opt # # zfs list -o name,devices,exec,setuid,canmount,mounted,mountpoint -t all NAME DEVICES EXEC SETUID CANMOUNT MOUNTED MOUNTPOINT z0 on on on on yes /mnt/z0 z0/ROOT on on on on no none z0/ROOT/default on on on noauto yes /mnt z0/opt on on on on yes /mnt/opt z0/tmp on on off on yes /mnt/tmp z0/usr on on on off no /mnt/usr z0/usr/home on on on on yes /mnt/usr/home z0/usr/ports on on on on yes /mnt/usr/ports z0/usr/src on on on on yes /mnt/usr/src z0/var on on on off no /mnt/var z0/var/audit on off off on yes /mnt/var/audit z0/var/crash on off off on yes /mnt/var/crash z0/var/db on on off on yes /mnt/var/db z0/var/log on off off on yes /mnt/var/log z0/var/mail on on on on yes /mnt/var/mail z0/var/opt on on on on yes /mnt/var/opt z0/var/tmp on on off on yes /mnt/var/tmp # # Looks fine. Now the Microsoft UEFI disaster travesty : # newfs_msdos /dev/ada3p1 /dev/ada3p1: 523984 sectors in 32749 FAT16 clusters (8192 bytes/cluster) BytesPerSec=512 SecPerClust=16 ResSectors=1 FATs=2 RootDirEnts=512 Media=0xf0 FATsecs=128 SecPerTrack=63 Heads=16 HiddenSecs=0 HugeSectors=524288 # # mkdir /tmp/target_efi # # mount_msdosfs /dev/ada3p1 /tmp/target_efi # mkdir /tmp/target_efi/EFI # mkdir /tmp/target_efi/EFI/BOOT # # ls -l /boot/loader.efi -r-xr-xr-x 2 root wheel 909824 Apr 7 05:08 /boot/loader.efi # # file /boot/loader.efi /boot/loader.efi: PE32+ executable (EFI application) x86-64, for MS Windows # # cp /boot/loader.efi /tmp/target_efi/EFI/BOOT/BOOTX64.EFI # # umount /dev/ada3p1 # Disgusting but that should "just work". Exit here to the installer on serial console and follow a few prompts. At first boot it all looks fine : OK set verbose_loading="YES" OK boot Loading kernel... /boot/kernel/kernel text=0x18aa98 text=0xdfd150 text=0x675154 data=0x140 data=0x1c38e8+0x43b718 0x8+0x18fe70+0x8+0x1ae449- Loading configured modules... /boot/entropy size=0x1000 /boot/kernel/cryptodev.ko size 0xa4a0 at 0x2140000 can't find '/etc/hostid' /boot/kernel/zfs.ko size 0x59dfa8 at 0x214b000 staging 0x6c200000 (not copying) tramp 0x6c089000 PT4 0x6c080000 Start @ 0xffffffff8038b000 ... EFI framebuffer information: addr, size 0xf9000000, 0x1d4c00 dimensions 800 x 600 stride 800 masks 0x00ff0000, 0x0000ff00, 0x000000ff, 0xff000000 ---<<BOOT>>--- Copyright (c) 1992-2021 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.2-RELEASE releng/13.2-n254617-525ecfdad597 GENERIC amd64 FreeBSD clang version 14.0.5 (https://github.com/llvm/llvm-project.git llvmorg-14.0.5-0-gc12386ae247c) VT(efifb): resolution 800x600 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3492.13-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> Features2=0x7ffefbff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND> AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM> AMD Features2=0x21<LAHF,ABM> Structured Extended Features=0x37ab<FSGSBASE,TSCADJ,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,NFPUSG> Structured Extended Features3=0x9c000400<MD_CLEAR,IBPB,STIBP,L1DFL,SSBD> XSAVE Features=0x1<XSAVEOPT> VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 51539607552 (49152 MB) avail memory = 49962668032 (47648 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: <LENOVO TC-A4 > FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 <Version 2.0> irqs 0-23 ioapic1 <Version 2.0> irqs 24-47 Launching APs: 1 6 2 5 4 8 9 7 3 10 11 random: entropy device external interface kbd1 at kbdmux0 efirtc0: <EFI Realtime Clock> efirtc0: registered as a time-of-day clock, resolution 1.000000s smbios0: <System Management BIOS> at iomem 0x7c4a7a98-0x7c4a7ab6 smbios0: Version: 2.8, BCD Revision: 2.7 aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS> acpi0: <LENOVO TC-A4> acpi0: Power Button (fixed) cpu0: <ACPI CPU> on acpi0 atrtc0: <AT realtime clock> port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: <ACPI Host-PCI bridge> on acpi0 pci0: <ACPI PCI bus> on pcib0 pci0: <dasp, performance counters> at device 11.1 (no driver attached) pci0: <dasp, performance counters> at device 11.2 (no driver attached) pci0: <dasp, performance counters> at device 16.1 (no driver attached) pci0: <dasp, performance counters> at device 16.6 (no driver attached) pci0: <dasp, performance counters> at device 18.1 (no driver attached) acpi_syscontainer0: <System Container> on acpi0 acpi_syscontainer1: <System Container> on acpi0 acpi_syscontainer2: <System Container> on acpi0 acpi_syscontainer3: <System Container> on acpi0 apei0: <ACPI Platform Error Interface> on acpi0 pcib1: <ACPI Host-PCI bridge> port 0xcf8-0xcff numa-domain 0 on acpi0 pci1: <ACPI PCI bus> numa-domain 0 on pcib1 pcib2: <ACPI PCI-PCI bridge> irq 26 at device 1.0 numa-domain 0 on pci1 pci2: <ACPI PCI bus> numa-domain 0 on pcib2 pcib3: <ACPI PCI-PCI bridge> irq 26 at device 1.1 numa-domain 0 on pci1 pci3: <ACPI PCI bus> numa-domain 0 on pcib3 pcib4: <ACPI PCI-PCI bridge> irq 32 at device 2.0 numa-domain 0 on pci1 pci4: <ACPI PCI bus> numa-domain 0 on pcib4 vgapci0: <VGA-compatible display> port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xf0000000-0xf7ffffff,0xf8000000-0xf9ffffff irq 32 at device 0.0 numa-domain 0 on pci4 vgapci0: Boot video device hdac0: <NVIDIA (0x0e0f) HDA Controller> mem 0xfb080000-0xfb083fff irq 36 at device 0.1 numa-domain 0 on pci4 pcib5: <ACPI PCI-PCI bridge> irq 40 at device 3.0 numa-domain 0 on pci1 pci5: <ACPI PCI bus> numa-domain 0 on pcib5 ix0: <Intel(R) X520 82599ES (SFI/SFP+)> port 0xd020-0xd03f mem 0xfb200000-0xfb2fffff,0xfb404000-0xfb407fff irq 44 at device 0.0 numa-domain 0 on pci5 ix0: Using 2048 TX descriptors and 2048 RX descriptors ix0: Using 6 RX queues 6 TX queues ix0: Using MSI-X interrupts with 7 vectors ix0: allocated for 6 queues ix0: allocated for 6 rx queues ix0: Ethernet address: 8c:dc:d4:ae:1d:3c ix0: PCI Express Bus: Speed 5.0GT/s Width x8 ix0: Option ROM V1-b1099-p0 eTrack 0x80000811 PHY FW V65535 ix0: netmap queues/slots: TX 6/2048, RX 6/2048 ix1: <Intel(R) X520 82599ES (SFI/SFP+)> port 0xd000-0xd01f mem 0xfb100000-0xfb1fffff,0xfb400000-0xfb403fff irq 40 at device 0.1 numa-domain 0 on pci5 ix1: Using 2048 TX descriptors and 2048 RX descriptors ix1: Using 6 RX queues 6 TX queues ix1: Using MSI-X interrupts with 7 vectors ix1: allocated for 6 queues ix1: allocated for 6 rx queues ix1: Ethernet address: 8c:dc:d4:ae:1d:3d ix1: PCI Express Bus: Speed 5.0GT/s Width x8 ix1: Option ROM V1-b1099-p0 eTrack 0x80000811 PHY FW V65535 ix1: netmap queues/slots: TX 6/2048, RX 6/2048 pci1: <unknown> at device 17.0 (no driver attached) ahci0: <Intel Wellsburg AHCI SATA controller> port 0xf130-0xf137,0xf120-0xf123,0xf110-0xf117,0xf100-0xf103,0xf040-0xf05f mem 0xfb538000-0xfb5387ff irq 16 at device 17.4 numa-domain 0 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: <AHCI channel> at channel 0 on ahci0 ahcich1: <AHCI channel> at channel 1 on ahci0 ahcich3: <AHCI channel> at channel 3 on ahci0 ahciem0: <AHCI enclosure management bridge> on ahci0 xhci0: <Intel Wellsburg USB 3.0 controller> mem 0xfb520000-0xfb52ffff irq 19 at device 20.0 numa-domain 0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 numa-domain 0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: <simple comms> at device 22.0 (no driver attached) atapci0: <Intel ATA controller> port 0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf0d0-0xf0d7,0xf0c0-0xf0c3,0xf0b0-0xf0bf irq 16 at device 22.2 numa-domain 0 on pci1 ata2: <ATA channel> at channel 0 on atapci0 ata3: <ATA channel> at channel 1 on atapci0 uart2: <Intel Corporation C610/X99 series chipset KT Controller> port 0xf0a0-0xf0a7 mem 0xfb536000-0xfb536fff irq 17 at device 22.3 numa-domain 0 on pci1 uart2: Using 1 MSI message em0: <Intel(R) I218-LM (2)> port 0xf020-0xf03f mem 0xfb500000-0xfb51ffff,0xfb535000-0xfb535fff irq 20 at device 25.0 numa-domain 0 on pci1 em0: EEPROM V0.1-4 em0: Using 1024 TX descriptors and 1024 RX descriptors em0: Using an MSI interrupt em0: Ethernet address: 6c:0b:84:a9:0f:9c em0: netmap queues/slots: TX 1/1024, RX 1/1024 ehci0: <Intel Wellsburg USB 2.0 controller> mem 0xfb534000-0xfb5343ff irq 18 at device 26.0 numa-domain 0 on pci1 usbus1: EHCI version 1.0 usbus1 numa-domain 0 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib6: <ACPI PCI-PCI bridge> irq 16 at device 28.0 numa-domain 0 on pci1 pci6: <ACPI PCI bus> numa-domain 0 on pcib6 pcib7: <ACPI PCI-PCI bridge> irq 17 at device 28.1 numa-domain 0 on pci1 pci7: <ACPI PCI bus> numa-domain 0 on pcib7 pcib8: <ACPI PCI-PCI bridge> irq 17 at device 0.0 numa-domain 0 on pci7 pci8: <ACPI PCI bus> numa-domain 0 on pcib8 ehci1: <Intel Wellsburg USB 2.0 controller> mem 0xfb533000-0xfb5333ff irq 18 at device 29.0 numa-domain 0 on pci1 usbus2: EHCI version 1.0 usbus2 numa-domain 0 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: <PCI-ISA bridge> at device 31.0 numa-domain 0 on pci1 isa0: <ISA bus> numa-domain 0 on isab0 ahci1: <Intel Wellsburg AHCI SATA controller> port 0xf090-0xf097,0xf080-0xf083,0xf070-0xf077,0xf060-0xf063,0xf000-0xf01f mem 0xfb532000-0xfb5327ff irq 16 at device 31.2 numa-domain 0 on pci1 ahci1: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich4: <AHCI channel> at channel 0 on ahci1 ahcich5: <AHCI channel> at channel 1 on ahci1 ahcich6: <AHCI channel> at channel 2 on ahci1 ahciem1: <AHCI enclosure management bridge> on ahci1 acpi_button0: <Power Button> on acpi0 uart0: console (9600,n,8,1)> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] est0: <Enhanced SpeedStep Frequency Control> on cpu0 Timecounter "TSC-low" frequency 1745956841 Hz quality 1000 Timecounters tick every 1.000 msec ZFS filesystem version: 5 ZFS storage pool version: features support (5000) hdacc0: <NVIDIA (0x0051) HDA CODEC> at cad 0 on hdac0 hdaa0: <NVIDIA (0x0051) Audio Function Group> at nid 1 on hdacc0 pcm0: <NVIDIA (0x0051) (HDMI/DP 8ch)> at nid 4 on hdaa0 pcm1: <NVIDIA (0x0051) (HDMI/DP 8ch)> at nid 5 on hdaa0 Trying to mount root from zfs:z0/ROOT/default []... ugen1.1: <Intel EHCI root HUB> at usbus1 ugen2.1: <Intel EHCI root HUB> at usbus2 ugen0.1: <Intel XHCI root HUB> at usbus0 uhub0 numa-domain 0 on usbus1 uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1 uhub1 numa-domain 0 on usbus2 uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2 uhub2 numa-domain 0 on usbus0 uhub2: <Intel XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 Root mount waiting for: CAM usbus0 usbus1 usbus2 uhub0: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered uhub2: 21 ports with 21 removable, self powered ugen1.2: <vendor 0x8087 product 0x800a> at usbus1 uhub3 numa-domain 0 on uhub0 uhub3: <vendor 0x8087 product 0x800a, class 9/0, rev 2.00/0.05, addr 2> on usbus1 Root mount waiting for: CAM usbus0 usbus1 usbus2 ses0 at ahciem0 bus 0 scbus3 target 0 lun 0 ses0: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus9 target 0 lun 0 ses1: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: (none) in 'Slot 00', SATA Slot: scbus0 target 0 ses1: (none) in 'Slot 00', SATA Slot: scbus6 target 0 ugen2.2: <vendor 0x8087 product 0x8002> at usbus2 ses0: (none) in 'Slot 01', SATA Slot: scbus1 target 0 ses1: (none) in 'Slot 01', SATA Slot: scbus7 target 0 uhub4ses0: (none) in 'Slot 03', SATA Slot: scbus2 target 0 numa-domain 0ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: <ST8000NM002A-2KE102 NN02> ACS-4 ATA SATA 3.x device ada0: Serial Number WSD0N69R ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 7630885MB (1953506646 4096 byte sectors) on uhub1 ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: <ST16000NM000J-2TW103 SN02> ACS-4 ATA SATA 3.x device ada1: Serial Number ZR56SFN7 ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 15259648MB (31251759104 512 byte sectors) uhub4: <vendor 0x8087 product 0x8002, class 9/0, rev 2.00/0.05, addr 2> on usbus2 ada2 at ahcich3 bus 0 scbus2 target 0 lun 0 ada2: <ST8000NM002A-2KE102 NN03> ACS-4 ATA SATA 3.x device ada2: Serial Number WSD3442G ada2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada2: Command Queueing enabled ada2: 7630885MB (1953506646 4096 byte sectors) Root mount waiting for: CAM usbus0 usbus1 usbus2ugen0.2: <VIA Labs, Inc. USB Hub> at usbus0 ada uhub5 numa-domain 0 on uhub2 uhub5: <VIA Labs, Inc. USB Hub, class 9/0, rev 2.10/53.80, addr 1> on usbus0 ada3 at ahcich4 bus 0 scbus6 target 0 lun 0 ada3: <Samsung SSD 870 QVO 1TB SVQ01B6Q> ACS-4 ATA SATA 3.x device ada3: Serial Number S5VSNG0NA27505M ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada3: Command Queueing enabled ada3: 953869MB (1953525168 512 byte sectors) uhub3: 6 ports with 6 removable, self powered ada4 at ahcich5 bus 0 scbus7 target 0 lun 0 ada4: <ST8000NM002A-2KE102 NN02> ACS-4 ATA SATA 3.x device ada4: Serial Number WSD0NAK6 ada4: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada4: Command Queueing enabled ada4: 7630885MB (1953506646 4096 byte sectors) uhub4: 8 ports with 8 removable, self powered uhub5: 4 ports with 4 removable, self powered Root mount waiting for: usbus0 ugen0.3: <Generic USB2.0-CRW> at usbus0 ugen0.4: <VIA Labs, Inc. USB Hub> at usbus0 uhub6 numa-domain 0 on uhub2 uhub6: <VIA Labs, Inc. USB Hub, class 9/0, rev 3.00/53.85, addr 3> on usbus0 Root mount waiting for: usbus0 Root mount waiting for: usbus0 uhub6: 4 ports with 4 removable, self powered No suitable dump device was found. Setting hostuuid: 2cf31f49-9068-e611-a367-6c0b84a90f9c. Setting hostid: 0xdb4c6c9e. Starting file system checks: Mounting local filesystems:. ELF ldconfacpi_wmi0: <ACPI-WMI mapping> on acpi0 acpi_wmi0: cannot find EC device acpi_wmi0: Embedded MOF found ACPI: \WMI1.WQCA: 1 arguments were passed to a non-method ACPI object (Buffer) (20201113/nsarguments-361) acpi_wmi1: <ACPI-WMI mapping> on acpi0 acpi_wmi1: cannot find EC device acpi_wmi2: <ACPI-WMI mapping> on acpi0 acpi_wmi2: cannot find EC device acpi_wmi3: <ACPI-WMI mapping> port 0xa10-0xa1f on acpi0 acpi_wmi3: cannot find EC device ichsmb0: <Intel Wellsburg SMBus controller> port 0x580-0x59f mem 0xfb531000-0xfb5310ff irq 18 at device 31.3 numa-domain 0 on pci1 smbus0: <System Management Bus> numa-domain 0 on ichsmb0 ig path: /lib /usr/lib /usr/lib/lo0: link state changed to UP compat 32-bit compatibility ldconfig path: /usr/lib32 Setting hostname: pluto. Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Autoloading module: acpi_wmi Autoloading module: ichsmb Starting Network: lo0 ix0 ix1 em0. lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384 options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6> inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> ix0: flags=8822<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=4e53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP> ether 8c:dc:d4:ae:1d:3c media: Ethernet autoseem0: link state changed to UP lect status: no carrier nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> ix1: flags=8822<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=4e53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP> ether 8c:dc:d4:ae:1d:3d media: Ethernet autoselect status: no carrier nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> em0: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=481049b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LRO,VLAN_HWFILTER,NOMAP> ether 6c:0b:84:a9:0f:9c inet 172.16.35.42 netmask 0xffffffc0 broadcast 172.16.35.63 media: Ethernet autoselect status: no carrier nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> Starting devd. Starting Network: ix0. ix0: flags=8822<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=4e53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP> ether 8c:dc:d4:ae:1d:3c media: Ethernet autoselect status: no carrier nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> Starting Network: ix1. ix1: flags=8822<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=4e53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP> ether 8c:dc:d4:ae:1d:3d media: Ethernet autoselect status: no carrier nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 172.16.35.1 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Updating /var/run/os-release done. Updating motd:. Clearing /tmp. Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 13 May 22:54:56 ntpdate[2172]: sSecurity policy loaded: MAC/ntpd (mac_ntpd) tep time server 206.108.0.132 offset -0.943560 sec stat: /var/db/ntp: No such file or directory Starting ntpd. May 13 22:54:56 pluto ntpd[2212]: pid file /var/db/ntp/ntpd.pid: No such file or directory Mounting late filesystems:. Configuring vt: blanktime. Generating RSA host key. 3072 SHA256:OesZVyPR19Il4LUKVRDF3mTLeHamqDPCVopCLuDxOqI root@pluto (RSA) Generating ECDSA host key. 256 SHA256:lfz1ign7O8DmnaTVhpl15ZHNklao51tBoklwowtCVUM root@pluto (ECDSA) Generating ED25519 host key. 256 SHA256:QBasgUF0f+R0pTMOrm+nYzVarQDfabhbYrhV7R+KbnM root@pluto (ED25519) Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. FreeBSD/amd64 (pluto) (ttyu0) login: root Password: May 13 22:55:18 pluto login[2336]: ROOT LOGIN (root) ON ttyu0 FreeBSD 13.2-RELEASE releng/13.2-n254617-525ecfdad597 GENERIC Welcome to FreeBSD! Release Notes, Errata: https://www.FreeBSD.org/releases/ Security Advisories: https://www.FreeBSD.org/security/ FreeBSD Handbook: https://www.FreeBSD.org/handbook/ FreeBSD FAQ: https://www.FreeBSD.org/faq/ Questions List: https://www.FreeBSD.org/lists/questions/ FreeBSD Forums: https://forums.FreeBSD.org/ Documents installed with the system are in the /usr/local/share/doc/freebsd/ directory, or can be installed later with: pkg install en-freebsd-doc For other languages, replace "en" with a language code like de or fr. Show the version of FreeBSD installed: freebsd-version ; uname -a Please include that output and any error messages when posting questions. Introduction to manual pages: man man FreeBSD directory layout: man hier To change this login announcement, see motd(5). You have mail. root@pluto:~ # root@pluto:~ # uname -apKU FreeBSD pluto 13.2-RELEASE FreeBSD 13.2-RELEASE releng/13.2-n254617-525ecfdad597 GENERIC amd64 amd64 1302001 1302001 root@pluto:~ # ifconfig -a ix0: flags=8822<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=4e53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP> ether 8c:dc:d4:ae:1d:3c media: Ethernet autoselect status: no carrier nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> ix1: flags=8822<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=4e53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP> ether 8c:dc:d4:ae:1d:3d media: Ethernet autoselect status: no carrier nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> em0: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=481049b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LRO,VLAN_HWFILTER,NOMAP> ether 6c:0b:84:a9:0f:9c inet 172.16.35.42 netmask 0xffffffc0 broadcast 172.16.35.63 media: Ethernet autoselect (1000baseT <full-duplex>) status: active nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384 options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6> inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> root@pluto:~ # root@pluto:~ # zfs list NAME USED AVAIL REFER MOUNTPOINT z0 648M 891G 24K /z0 z0/ROOT 647M 891G 24K none z0/ROOT/default 647M 891G 647M / z0/opt 24K 891G 24K /opt z0/tmp 24K 891G 24K /tmp z0/usr 104K 891G 24K /usr z0/usr/home 31.5K 891G 31.5K /usr/home z0/usr/ports 24K 891G 24K /usr/ports z0/usr/src 24K 891G 24K /usr/src z0/var 1.02M 891G 24K /var z0/var/audit 24K 891G 24K /var/audit z0/var/crash 24K 891G 24K /var/crash z0/var/db 870K 891G 870K /var/db z0/var/log 30.5K 891G 30.5K /var/log z0/var/mail 24K 891G 24K /var/mail z0/var/opt 24K 891G 24K /var/opt z0/var/tmp 24K 891G 24K /var/tmp root@pluto:~ # This looks fine to me. However : root@pluto:~ # You have new mail. root@pluto:~ # mail Mail version 8.1 6/6/93. Type ? for help. "/var/mail/root": 2 messages 2 new >N 1 operator@pluto Sat May 13 22:55 24/1035 "Cron <operator@pluto>" N 2 operator@pluto Sat May 13 23:00 24/1035 "Cron <operator@pluto>" & 1 Message 1: From operator@pluto Sat May 13 22:55:00 2023 Date: Sat, 13 May 2023 22:55:00 GMT From: Cron Daemon <operator@pluto> To: operator@pluto Subject: Cron <operator@pluto> /usr/libexec/save-entropy X-Cron-Env: <SHELL=/bin/sh> X-Cron-Env: <PATH=/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/sbin:/usr/local/bin> X-Cron-Env: <LOGNAME=operator> X-Cron-Env: <USER=operator> install: mkdir /var/db/entropy: Permission denied /usr/libexec/save-entropy 2347 - - The entropy directory /var/db/entropy does not exist, and cannot be created. Therefore no entropy can be saved. & q Saved 1 message in mbox Held 1 message in /var/mail/root root@pluto:~ # ls -lad /var/db/entropy ls: /var/db/entropy: No such file or directory root@pluto:~ # ls -la /var/db total 7 drwxr-xr-x 2 root wheel 3 May 13 22:54 . drwxr-xr-x 25 root wheel 25 May 13 22:54 .. -rw-r--r-- 1 root wheel 10666 Apr 7 04:27 ntpd.leap-seconds.list root@pluto:~ # There is no /var/db fs ! WORSE ... none of the ZFS filesytems mounted ! root@pluto:~ # zfs list -o name,checksum,compression,compressratio,exec,setuid,mounted,mountpoint NAME CHECKSUM COMPRESS RATIO EXEC SETUID MOUNTED MOUNTPOINT z0 sha512 zstd 3.18x on on no /z0 z0/ROOT sha512 zstd 3.18x on on no none z0/ROOT/default sha512 zstd 3.18x on on yes / z0/opt sha512 zstd 1.00x on on no /opt z0/tmp sha512 zstd 1.00x on off no /tmp z0/usr sha512 zstd 1.00x on on no /usr z0/usr/home sha512 zstd 1.02x on on no /usr/home z0/usr/ports sha512 zstd 1.00x on on no /usr/ports z0/usr/src sha512 zstd 1.00x on on no /usr/src z0/var sha512 zstd 5.12x on on no /var z0/var/audit sha512 zstd 1.00x off off no /var/audit z0/var/crash sha512 zstd 1.04x off off no /var/crash z0/var/db sha512 zstd 5.51x on off no /var/db z0/var/log sha512 zstd 4.30x off off no /var/log z0/var/mail sha512 zstd 1.00x on on no /var/mail z0/var/opt sha512 zstd 1.00x on on no /var/opt z0/var/tmp sha512 zstd 1.00x on off no /var/tmp root@pluto:~ # root@pluto:~ # exit logout Perhaps /var/db should never be created as a separate fs? To be fair I have no idea what this machine looks to be a mess after an initial install. Others have been looking at this also and we are as a collective ... perplexed. End result is that I can not trust this machine to work. It issues a pile of emails about broken filesystems right now. Mostly just the stuff in /var/db which seems to be magical. I may be wrong. -- Dennis Clarke RISC-V/SPARC/PPC/ARM/CISC suspenders and a beard installed -- You are receiving this mail because: You are the assignee for the bug.