Re: FreeBSD OS installation stuck after selecting Boot installer

From: Anantharam, Arjun <arjun.anantharam_at_intel.com>
Date: Mon, 01 Jul 2024 23:10:56 UTC
Hi Andrew,

Thank you for your inputs 🙂

The installer is on an NVMe partition..

Attached is the ACPI dump(Is that what you are looking for ?) of a similar setup running linux with following devices attached..

[root@ipu-mfg-acc ~]# lspci
00:01.0 Ethernet controller: Intel Corporation Device 1452 (rev 11)
00:01.1 Non-Volatile memory controller: Intel Corporation Device 1457 (rev 11)
00:01.2 Processing accelerators: Intel Corporation Device 145e (rev 11)
00:01.3 Network and computing encryption device: Intel Corporation Device 1456 (rev 11)
00:01.4 Processing accelerators: Intel Corporation Device 145d (rev 11)
00:01.6 Ethernet controller: Intel Corporation Device 1453 (rev 11)
00:01.7 Non-Volatile memory controller: Intel Corporation Device 1458 (rev 11)
00:02.0 Generic system peripheral [0807]: Intel Corporation Device 14c3 (rev 11)

[root@ipu-mfg-acc ~]# cat /etc/os-release
NAME="Rocky Linux"
VERSION="9.2 (Blue Onyx)"
ID="rocky"
ID_LIKE="rhel centos fedora"
VERSION_ID="9.2"
PLATFORM_ID="platform:el9"
PRETTY_NAME="Rocky Linux 9.2 (Blue Onyx)"
ANSI_COLOR="0;32"
LOGO="fedora-logo-icon"
CPE_NAME="cpe:/o:rocky:rocky:9::baseos"
HOME_URL="https://rockylinux.org/"
BUG_REPORT_URL="https://bugs.rockylinux.org/"
SUPPORT_END="2032-05-31"
ROCKY_SUPPORT_PRODUCT="Rocky-Linux-9"
ROCKY_SUPPORT_PRODUCT_VERSION="9.2"
REDHAT_SUPPORT_PRODUCT="Rocky Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="9.2"

Please let me know if you need further details and I would appreciate your help!!

Arjun
________________________________
From: Andrew Turner <andrew@fubar.geek.nz>
Sent: Friday, June 28, 2024 3:09 AM
To: Anantharam, Arjun <arjun.anantharam@intel.com>
Cc: Warner Losh <imp@bsdimp.com>; Mark Millard <marklmi@yahoo.com>; freebsd-arm@freebsd.org <freebsd-arm@freebsd.org>
Subject: Re: FreeBSD OS installation stuck after selecting Boot installer



> On 27 Jun 2024, at 01:33, Anantharam, Arjun <arjun.anantharam@intel.com> wrote:
>
>
> Hi,
>
> Here is the log with "set efi.rt.disabled=1" and FreeBSD-14.1-RELEASE-arm64-aarch64-memstick.img.
> Any reason why the mount "Mounting from ufs:/dev/ufs/FreeBSD_Install failed with error 19" error occurs even with disk0p2: FreeBSD UFS showing up with lsdev and the eventaul kernel panic?
> Do you think this is an issue specific to ARM or FreeBSD ?

The lsdev is a list of devices UEFI provides to loader.efi. It is different to the list the kernel finds and has drivers for.

>
> Please feel free to let me know if thee are other options to try..

What device type is the installer on? e.g. NVMe, USB. I see what look like two NVMe devices on the pci bus, however the nvme driver only attaches to one.

The "ACPI: IORT: Unused ITS block, ID 1” line also indicates that FreeBSD doesn’t like some of the ACPI tables. It looks like the ACPI IORT is missing an ITS entry that’s needed to map these interrupts. Can you provide a copy of the ACPI tables from Linux? It would also help understand why the uart isn’t attaching.

Andrew

>
>
>   ______               ____   _____ _____
>   |  ____|             |  _ \ / ____|  __ \
>   | |___ _ __ ___  ___ | |_) | (___ | |  | |
>   |  ___| '__/ _ \/ _ \|  _ < \___ \| |  | |
>   | |   | | |  __/  __/| |_) |____) | |__| |
>   | |   | | |    |    ||     |      |      |
>   |_|   |_|  \___|\___||____/|_____/|_____/      ```                        `
>                                                 s` `.....---.......--.```   -/
>  /---------- Welcome to FreeBSD -----------\    +o   .--`         /y:`      +.
>  |                                         |     yo`:.            :o      `+-
>  |  1. Boot Installer [Enter]              |      y/               -/`   -o/
>  |  2. Boot Single user                    |     .-                  ::/sy+:.
>  |  3. Escape to loader prompt             |     /                     `--  /
>  |  4. Reboot                              |    `:                          :`
>  |  5. Cons: Serial                        |    `:                          :`
>  |                                         |     /                          /
>  |  Options:                               |     .-                        -.
>  |  6. Kernel: default/kernel (1 of 1)     |      --                      -.
>  |  7. Boot Options                        |       `:`                  `:`
>  |                                         |         .--             `--.
>  |                                         |            .---.....----.
>  \-----------------------------------------/
>
>
> Exiting menu!
>
>
> Type '?' for a list of commands, 'help' for more detailed help.
>
> OK set hw.uart.console="mm:0x2058400000,rs:2"
> OK set efi.rt.disabled=1
>
> OK lsdev
> disk devices:
>     disk0:    4194304 X 512 blocks
>       disk0p1: EFI
>       disk0p2: FreeBSD UFS
> http: (unknown)
> net devices:
>     net0:
>     net1:
>     net2:
>     net3:
>
> OK show
> COLUMNS=80
> LINES=50
> acpi.oem=INTEL
> acpi.revision=2
> acpi.rsdp=0x00000047716f0018
> acpi.rsdt=0x0000000000000000
> acpi.xsdt=0x00000047716ffe98
> acpi.xsdt_length=36
> acpi_dsdt_load=NO
> acpi_dsdt_name=/boot/acpi_dsdt.aml
> acpi_dsdt_type=acpi_dsdt
> acpi_video_load=NO
> audit_event_load=NO
> audit_event_name=/etc/security/audit_event
> audit_event_type=etc_security_audit_event
> autoboot_delay=NO
> bitmap_load=NO
> bitmap_name=splash.bmp
> bitmap_type=splash_image_data
> boot_serial=YES
> bootenv_autolist=YES
> bootfile=kernel
> console=efi
> cpu_microcode_load=NO
> cpu_microcode_name=/boot/firmware/ucode.bin
> cpu_microcode_type=cpu_microcode
> currdev=disk0p2:
> efi-version=2.70
> efi.rt.disabled=1
> efi_com_port=0
> efi_com_speed=115200
> efi_max_resolution=1x1
> entropy_cache_load=YES
> entropy_cache_name=/boot/entropy
> entropy_cache_type=boot_entropy_cache
> entropy_efi_seed=YES
> hint.acpi.0.disabled=0
> hint.smbios.0.mem=0x4776890000
> hostuuid_load=YES
> hostuuid_name=/etc/hostid
> hostuuid_type=hostuuid
> hw.uart.console=mm:0x2058400000,rs:2
> interpret=OK
> kernel=kernel
> kernel_options=
> kernels_autodetect=NO
> loaddev=disk0p2:
> loader.efi=1
> loader_conf_dirs=/boot/loader.conf.d
> loader_menu_multi_user_prompt=Installer
> local_loader_conf_files=/boot/loader.conf.local
> module_blacklist=drm drm2 radeonkms i915kms amdgpu
> module_path=/boot/modules;/boot/dtb;/boot/dtb/overlays
> module_verbose=2
> nextboot_conf=/boot/nextboot.conf
> prompt=${interpret}
> ram_blacklist_load=NO
> ram_blacklist_name=/boot/blacklist.txt
> ram_blacklist_type=ram_blacklist
> screensave_load=NO
> screensave_name=green_saver
> script.lang=lua
> smbios.bios.reldate=Apr  4 2024
> smbios.bios.revision=1.2
> smbios.bios.vendor=Intel
> smbios.bios.version=Intel(R) IPU Embedded UEFI FW 1.2.0 for AArch64
> smbios.chassis.maker=Intel
> smbios.chassis.serial=N/A
> smbios.chassis.tag=N/A
> smbios.chassis.type=Other
> smbios.chassis.version=N/A
> smbios.memory.enabled=14680064
> smbios.socket.enabled=16
> smbios.socket.populated=16
> smbios.system.family=Intel(R) IPU E2100
> smbios.system.maker=Intel
> smbios.system.product=Intel(R) IPU Adapter E2100-CCQDA2
> smbios.system.serial=000000
> smbios.system.sku=000000000000
> smbios.system.uuid=30313245-3030-3030-6e0c-56812e49f70f
> smbios.system.version=N/A
> smbios.version=3.3
> splash_bmp_load=NO
> splash_pcx_load=NO
> splash_txt_load=NO
> twiddle_divisor=16
> verbose_loading=NO
> vesa_load=NO
> vfs.mountroot.timeout=10
> OK boot
> Loading kernel...
> /boot/kernel/kernel text=0x2a8 text=0x9db150 text=0x260994 data=0x150cb8 data=0x
> 0+0x2bc000 0x8+0x1516b0+0x8+0x17a5c2/
> Loading configured modules...
> can't find '/etc/hostid'
> can't find '/boot/entropy'
> No valid device tree blob found!
> WARNING! Trying to fire up the kernel, but no device tree blob found!
> ---<<BOOT>>---
> Copyright (c) 1992-2023 The FreeBSD Project.
> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
>         The Regents of the University of California. All rights reserved.
> FreeBSD is a registered trademark of The FreeBSD Foundation.
> FreeBSD 14.1-RELEASE releng/14.1-n267679-10e31f0946d8 GENERIC arm64
> FreeBSD clang version 18.1.5 (https://github.com/llvm/llvm-project.git llvmorg-18.1.5-0-g617a15a9eac9)
> VT: init without driver.
> module scmi already present!
> real memory  = 15586795520 (14864 MB)
> avail memory = 15167205376 (14464 MB)
> Starting CPU 1 (10000)
> Starting CPU 2 (20000)
> Starting CPU 3 (30000)
> Starting CPU 4 (40000)
> Starting CPU 5 (50000)
> Starting CPU 6 (60000)
> Starting CPU 7 (70000)
> Starting CPU 8 (80000)
> Starting CPU 9 (90000)
> Starting CPU 10 (a0000)
> Starting CPU 11 (b0000)
> Starting CPU 12 (c0000)
> Starting CPU 13 (d0000)
> Starting CPU 14 (e0000)
> Starting CPU 15 (f0000)
> FreeBSD/SMP: Multiprocessor System Detected: 16 CPUs
> arc4random: WARNING: initial seeding bypassed the cryptographic random device because it was not yet seeded and the knob 'bypass_before_seeding' was enabled.
> random: entropy device external interface
> ACPI: IORT: Unused ITS block, ID 1
> kbd0 at kbdmux0
> acpi0: <INTEL MEVB100>
> acpi0: Power Button (fixed)
> acpi0: Sleep Button (fixed)
> acpi0: Could not update all GPEs: AE_NOT_CONFIGURED
> psci0: <ARM Power State Co-ordination Interface Driver> on acpi0
> gic0: <ARM Generic Interrupt Controller v3.0> iomem 0x205a000000-0x205a00ffff,0x205a080000-0x205a27ffff on acpi0
> its0: <ARM GIC Interrupt Translation Service> mem 0x205a040000-0x205a05ffff on gic0
> generic_timer0: <ARM Generic Timer> irq 23,24,25 on acpi0
> Timecounter "ARM MPCore Timecounter" frequency 112500000 Hz quality 1000
> Event timer "ARM MPCore Eventtimer" frequency 112500000 Hz quality 1000
> pmu0: <Performance Monitoring Unit> on acpi0
> acpi_ged0: <Generic Event Device> irq 16 on acpi0
> acpi_ged0: Raw IRQ 257
> acpi_button0: <Power Button> on acpi0
> pcib0: <Generic PCI host controller> on acpi0
> pci0: <PCI bus> on pcib0
> pci0: <network, ethernet> at device 1.0 (no driver attached)
> nvme0: <Generic NVMe Device> mem 0x2220000000-0x2221ffffff,0x2226c80000-0x2226c9ffff at device 1.1 on pci0
> nvme0: unable to allocate MSI-X
> pci0: <unknown> at device 1.2 (no driver attached)
> pci0: <encrypt/decrypt, network/computer crypto> at device 1.3 (no driver attached)
> pci0: <unknown> at device 1.4 (no driver attached)
> pci0: <network, ethernet> at device 1.6 (no driver attached)
> pci0: <mass storage, NVM> at device 1.7 (no driver attached)
> cpu0: <ACPI CPU> on acpi0
> armv8crypto0: <AES-CBC,AES-XTS,AES-GCM>
> Timecounters tick every 1.000 msec
> usb_needs_explore_all: no devclass
> CPU  0: ARM Neoverse-N1 r4p0 affinity:  0  0  0
>                    Cache Type = <64 byte D-cacheline,64 byte I-cacheline,PIPT ICache,64 byte ERG,64 byte CWG,IDC,DIC>
>  Instruction Set Attributes 0 = <DP,RDM,Atomic,CRC32,SHA2,SHA1,AES+PMULL>
>  Instruction Set Attributes 1 = <RCPC-8.3,DCPoP>
>  Instruction Set Attributes 2 = <>
>          Processor Features 0 = <CSV3,CSV2,RAS,GIC,AdvSIMD+HP,FP+HP,EL3,EL2,EL1,EL0 32>
>          Processor Features 1 = <PSTATE.SSBS MSR>
>       Memory Model Features 0 = <TGran4,TGran64,TGran16,SNSMem,BigEnd,16bit ASID,256TB PA>
>       Memory Model Features 1 = <XNX,PAN+ATS1E1,LO,HPD+TTPBHA,VH,16bit VMID,HAF+DS>
>       Memory Model Features 2 = <EVT-8.2,32bit CCIDX,48bit VA,IESB,UAO,CnP>
>              Debug Features 0 = <DoubleLock,SPE,2 CTX BKPTs,4 Watchpoints,6 Breakpoints,PMUv3p1,Debugv8p2>
>              Debug Features 1 = <>
>          Auxiliary Features 0 = <>
>          Auxiliary Features 1 = <>
> AArch32 Instruction Set Attributes 5 = <RDM,CRC32,SHA2,SHA1,AES+VMULL,SEVL>
> AArch32 Media and VFP Features 0 = <FPRound,FPSqrt,FPDivide,DP VFPv3+v4,SP VFPv3+v4,AdvSIMD>
> AArch32 Media and VFP Features 1 = <SIMDFMAC,FPHP Arith,SIMDHP Arith,SIMDSP,SIMDInt,SIMDLS,FPDNaN,FPFtZ>
> CPU  1: ARM Neoverse-N1 r4p0 affinity:  1  0  0
> CPU  2: ARM Neoverse-N1 r4p0 affinity:  2  0  0
> CPU  3: ARM Neoverse-N1 r4p0 affinity:  3  0  0
> CPU  4: ARM Neoverse-N1 r4p0 affinity:  4  0  0
> CPU  5: ARM Neoverse-N1 r4p0 affinity:  5  0  0
> CPU  6: ARM Neoverse-N1 r4p0 affinity:  6  0  0
> CPU  7: ARM Neoverse-N1 r4p0 affinity:  7  0  0
> CPU  8: ARM Neoverse-N1 r4p0 affinity:  8  0  0
> CPU  9: ARM Neoverse-N1 r4p0 affinity:  9  0  0
> CPU 10: ARM Neoverse-N1 r4p0 affinity: 10  0  0
> CPU 11: ARM Neoverse-N1 r4p0 affinity: 11  0  0
> CPU 12: ARM Neoverse-N1 r4p0 affinity: 12  0  0
> CPU 13: ARM Neoverse-N1 r4p0 affinity: 13  0  0
> CPU 14: ARM Neoverse-N1 r4p0 affinity: 14  0  0
> CPU 15: ARM Neoverse-N1 r4p0 affinity: 15  0  0
> Release APs...done
> Trying to mount root from ufs:/dev/ufs/FreeBSD_Install [ro,noatime]...
> mountroot: waiting for device /dev/ufs/FreeBSD_Install...
> TCP_ratelimit: Is now initialized
> Mounting from ufs:/dev/ufs/FreeBSD_Install failed with error 19.
>
> Loader variables:
>   vfs.root.mountfrom=ufs:/dev/ufs/FreeBSD_Install
>   vfs.root.mountfrom.options=ro,noatime
>
> Manual root filesystem specification:
>   <fstype>:<device> [options]
>       Mount <device> using filesystem <fstype>
>       and with the specified (optional) option list.
>
>     eg. ufs:/dev/da0s1a
>         zfs:zroot/ROOT/default
>         cd9660:/dev/cd0 ro
>           (which is equivalent to: mount -t cd9660 -o ro /dev/cd0 /)
>
>   ?               List valid disk boot devices
>   .               Yield 1 second (for background tasks)
>   <empty line>    Abort manual input
>
> mountroot>
> mountroot> random: unblocking device.
>
> panic: mountroot: unable to (re-)mount root.
> cpuid = 14
> time = 99
> KDB: stack backtrace:
> #0 0xffff000000525d3c at kdb_backtrace+0x58
> #1 0xffff0000004d0d40 at vpanic+0x198
> #2 0xffff0000004d0ba4 at panic+0x44
> #3 0xffff0000005cf82c at vfs_mountroot+0x1df4
> #4 0xffff000000442814 at start_init+0x28
> #5 0xffff00000047cdf0 at fork_exit+0x88
> #6 0xffff0000008b61f4 at fork_trampoline+0x14
> Uptime: 1m39s
> Automatic reboot in 15 seconds - press a key on the console to abort