Re: pci passthrough Mediatek MT7922 doesn't work

From: Bakul Shah <bakul_at_iitbombay.org>
Date: Sat, 20 Apr 2024 20:16:33 UTC
Invoke the vmrun.sh script as "sh -x /usr/misc/examples/bhyve/vmrun.sh" to show use the bhyve command line executed. As well as any error messages.

> On Apr 20, 2024, at 12:32 PM, Peter Miller <feurry@gmail.com> wrote:
> 
> Hello,
> 
> I'm trying to use wifibox and the wifi device is not being passed through.
> There is a bug report, which I added to, but they told me it was
> probably a bhyve problem.
> https://github.com/pgj/freebsd-wifibox/issues/73
> 
> I followed these instructions to test, and added -p 1/0/0 to pass the
> wifi device.
> https://wiki.freebsd.org/bhyve#Q:_What_is_the_easiest_way_to_try_bhyve.3F
> 
> fetch https://download.freebsd.org/snapshots/VM-IMAGES/14.0-STABLE/amd64/Latest/FreeBSD-14.0-STABLE-amd64.raw.xz
> unxz FreeBSD-14.0-STABLE-amd64.raw.xz
> doas sh /usr/share/examples/bhyve/vmrun.sh -p 1/0/0 -d
> FreeBSD-14.0-STABLE-amd64.raw vm0
> 
> within the bhyve vm, I do not see the wifi device
> root@freebsd:~ # pciconf -lv
> hostb0@pci0:0:0:0:      class=0x060000 rev=0x00 hdr=0x00 vendor=0x1275
> device=0x1275 subvendor=0x0000 subdevice=0x0000
>    vendor     = 'Network Appliance Corporation'
>    class      = bridge
>    subclass   = HOST-PCI
> isab0@pci0:0:1:0:       class=0x060100 rev=0x00 hdr=0x00 vendor=0x8086
> device=0x7000 subvendor=0x0000 subdevice=0x0000
>    vendor     = 'Intel Corporation'
>    device     = '82371SB PIIX3 ISA [Natoma/Triton II]'
>    class      = bridge
>    subclass   = PCI-ISA
> virtio_pci0@pci0:0:2:0: class=0x020000 rev=0x00 hdr=0x00 vendor=0x1af4
> device=0x1000 subvendor=0x1af4 subdevice=0x0001
>    vendor     = 'Red Hat, Inc.'
>    device     = 'Virtio network device'
>    class      = network
>    subclass   = ethernet
> virtio_pci1@pci0:0:3:0: class=0x010000 rev=0x00 hdr=0x00 vendor=0x1af4
> device=0x1001 subvendor=0x1af4 subdevice=0x0002
>    vendor     = 'Red Hat, Inc.'
>    device     = 'Virtio block device'
>    class      = mass storage
>    subclass   = SCSI
> 
> 
> 
> bhyve dmesg
> root@freebsd:~ # cat /var/run/dmesg.boot
> ---<<BOOT>>---
> Copyright (c) 1992-2023 The FreeBSD Project.
> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
>        The Regents of the University of California. All rights reserved.
> FreeBSD is a registered trademark of The FreeBSD Foundation.
> FreeBSD 14.0-STABLE #0 stable/14-n267376-ca8e2e4c91cc: Thu Apr 18
> 05:55:35 UTC 2024
>    root@releng1.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64
> FreeBSD clang version 17.0.6 (https://github.com/llvm/llvm-project.git
> llvmorg-17.0.6-0-g6009708b4367)
> VT: init without driver.
> CPU: AMD Ryzen 5 7540U w/ Radeon(TM) 740M Graphics   (3194.13-MHz K8-class CPU)
>  Origin="AuthenticAMD"  Id=0xa70f41  Family=0x19  Model=0x74  Stepping=1
>  Features=0x1783fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2,HTT>
>  Features2=0xfed83203<SSE3,PCLMULQDQ,SSSE3,FMA,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND,HV>
>  AMD Features=0x26500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,LM>
>  AMD Features2=0x444231fb<LAHF,CMP,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,SKINIT,WDT,TCE,Topology,DBE,ADMSKX>
>  Structured Extended
> Features=0xf01703a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,AVX512F,AVX512DQ,RDSEED,SMAP,AVX512CD,SHA,AVX512BW,AVX512VL>
>  Structured Extended Features2=0x600<VAES,VPCLMULQDQ>
>  XSAVE Features=0x1<XSAVEOPT>
>  AMD Extended Feature Extensions ID EBX=0x7<CLZERO,IRPerf,XSaveErPtr>
>  TSC: P-state invariant
> Hypervisor: Origin = "bhyve bhyve "
> real memory  = 536870912 (512 MB)
> avail memory = 482742272 (460 MB)
> Event timer "LAPIC" quality 600
> ACPI APIC Table: <BHYVE  BVAPIC >
> FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
> FreeBSD/SMP: 2 package(s) x 1 core(s)
> random: registering fast source Intel Secure Key RNG
> random: fast provider: "Intel Secure Key RNG"
> random: unblocking device.
> ioapic0 <Version 1.1> irqs 0-31
> Launching APs: 1
> random: entropy device external interface
> kbd1 at kbdmux0
> smbios0: <System Management BIOS> at iomem 0xf1000-0xf101e
> smbios0: Version: 2.6, BCD Revision: 2.6
> aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256>
> acpi0: <BHYVE BVXSDT >
> acpi0: Power Button (fixed)
> atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
> atrtc0: registered as a time-of-day clock, resolution 1.000000s
> Event timer "RTC" frequency 32768 Hz quality 0
> attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
> Timecounter "i8254" frequency 1193182 Hz quality 0
> Event timer "i8254" frequency 1193182 Hz quality 100
> hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
> Timecounter "HPET" frequency 16777216 Hz quality 950
> Event timer "HPET" frequency 16777216 Hz quality 550
> Event timer "HPET1" frequency 16777216 Hz quality 450
> Event timer "HPET2" frequency 16777216 Hz quality 450
> Event timer "HPET3" frequency 16777216 Hz quality 450
> Event timer "HPET4" frequency 16777216 Hz quality 450
> Event timer "HPET5" frequency 16777216 Hz quality 450
> Event timer "HPET6" frequency 16777216 Hz quality 450
> Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
> acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
> pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
> pci0: <ACPI PCI bus> on pcib0
> isab0: <PCI-ISA bridge> at device 1.0 on pci0
> isa0: <ISA bus> on isab0
> virtio_pci0: <VirtIO PCI (legacy) Network adapter> port 0x2080-0x20bf
> mem 0xc0108000-0xc0109fff irq 16 at device 2.0 on pci0
> vtnet0: <VirtIO Networking Adapter> on virtio_pci0
> vtnet0: Ethernet address: 00:a0:98:f0:55:05
> vtnet0: netmap queues/slots: TX 1/1024, RX 1/512
> 000.000148 [ 452] vtnet_netmap_attach       vtnet attached txq=1,
> txd=1024 rxq=1, rxd=512
> virtio_pci1: <VirtIO PCI (legacy) Block adapter> port 0x2000-0x207f
> mem 0xc010a000-0xc010bfff irq 17 at device 3.0 on pci0
> vtblk0: <VirtIO Block Adapter> on virtio_pci1
> vtblk0: 6176MB (12649685 512 byte sectors)
> vmgenc0: <VM Generation Counter> on acpi0
> atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
> atkbd0: <AT Keyboard> irq 1 on atkbdc0
> kbd0 at atkbd0
> atkbd0: [GIANT-LOCKED]
> driver bug: Unable to set devclass (class: atkbdc devname: (unknown))
> psm0: <PS/2 Mouse> irq 12 on atkbdc0
> psm0: [GIANT-LOCKED]
> WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 15.0.
> psm0: model Generic PS/2 mouse, device ID 0
> uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
> uart0: console (115200,n,8,1)
> uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
> uart2: <16550 or compatible> port 0x3e8-0x3ef irq 4 on acpi0
> uart3: <16550 or compatible> port 0x2e8-0x2ef irq 3 on acpi0
> vga0: <Generic ISA VGA> at port 0x3b0-0x3bb iomem 0xb0000-0xb7fff
> pnpid PNP0900 on isa0
> Timecounter "TSC-low" frequency 1597006350 Hz quality 1000
> Timecounters tick every 10.000 msec
> usb_needs_explore_all: no devclass
> Trying to mount root from ufs:/dev/gpt/rootfs [rw]...
> lo0: link state changed to UP
> vtnet0: link state changed to UP
> 
> 
> 
> Host machine, running Current.
> 
> dmesg
> ---<<BOOT>>---
> Copyright (c) 1992-2024 The FreeBSD Project.
> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
>    The Regents of the University of California. All rights reserved.
> FreeBSD is a registered trademark of The FreeBSD Foundation.
> FreeBSD 15.0-CURRENT #1 068c675ca: Sat Apr 13 20:34:19 CDT 2024
>    root@queenannesrevenge:/usr/obj/usr/src/amd64.amd64/sys/GENERIC-NODEBUG
> amd64
> FreeBSD clang version 18.1.3 (https://github.com/llvm/llvm-project.git
> llvmorg-18.1.3-0-gc13b7485b879)
> VT(efifb): resolution 2560x1600
> CPU: AMD Ryzen 5 7540U w/ Radeon(TM) 740M Graphics   (3194.18-MHz K8-class CPU)
>  Origin="AuthenticAMD"  Id=0xa70f41  Family=0x19  Model=0x74  Stepping=1
>  Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
>  Features2=0x7ef8320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
>  AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
>  AMD Features2=0x75c237ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX,ADMSKX>
>  Structured Extended
> Features=0xf1bf97a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,PQE,AVX512F,AVX512DQ,RDSEED,ADX,SMAP,AVX512IFMA,CLFLUSHOPT,CLWB,AVX512CD,SHA,AVX512BW,AVX512VL>
>  Structured Extended
> Features2=0x405fde<AVX512VBMI,UMIP,PKU,OSPKE,AVX512VBMI2,GFNI,VAES,VPCLMULQDQ,AVX512VNNI,AVX512BITALG,AVX512VPOPCNTDQ,RDPID>
>  Structured Extended Features3=0x10000000<L1DFL>
>  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
>  AMD Extended Feature Extensions ID
> EBX=0x791ef257<CLZERO,IRPerf,XSaveErPtr,RDPRU,WBNOINVD,IBPB,IBRS,STIBP,STIBP_ALWAYSON,PREFER_IBRS,SSBD>
>  SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768
>  TSC: P-state invariant, performance statistics
> real memory  = 17179869184 (16384 MB)
> avail memory = 15861637120 (15126 MB)
> Event timer "LAPIC" quality 600
> ACPI APIC Table: <HPQOEM SLIC-MPC>
> FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs
> FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads
> random: registering fast source Intel Secure Key RNG
> random: fast provider: "Intel Secure Key RNG"
> random: unblocking device.
> ioapic0 <Version 2.1> irqs 0-23
> ioapic1 <Version 2.1> irqs 24-55
> Launching APs: 1 9 4 5 8 6 7 2 3 10 11
> random: entropy device external interface
> kbd1 at kbdmux0
> efirtc0: <EFI Realtime Clock>
> efirtc0: registered as a time-of-day clock, resolution 1.000000s
> smbios0: <System Management BIOS> at iomem 0x58e1f000-0x58e1f017
> smbios0: Version: 3.4
> aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256>
> acpi0: <HPQOEM SLIC-MPC>
> Firmware Error (ACPI): Could not resolve symbol [\134_SB.PCI0.GPP0],
> AE_NOT_FOUND (20230628/dswload2-315)
> ACPI Error: AE_NOT_FOUND, During name lookup/catalog (20230628/psobject-372)
> Firmware Error (ACPI): Could not resolve symbol [\134_SB.PCI0.GPP2],
> AE_NOT_FOUND (20230628/dswload2-315)
> ACPI Error: AE_NOT_FOUND, During name lookup/catalog (20230628/psobject-372)
> Firmware Error (ACPI): Could not resolve symbol
> [\134_SB.PCI0.GPP2.WWAN], AE_NOT_FOUND (20230628/dswload2-315)
> ACPI Error: AE_NOT_FOUND, During name lookup/catalog (20230628/psobject-372)
> Firmware Error (ACPI): Could not resolve symbol [\134_SB.PCI0.GP11],
> AE_NOT_FOUND (20230628/dswload2-315)
> ACPI Error: AE_NOT_FOUND, During name lookup/catalog (20230628/psobject-372)
> Firmware Error (ACPI): Could not resolve symbol [\134_SB.PCI0.GP12],
> AE_NOT_FOUND (20230628/dswload2-315)
> ACPI Error: AE_NOT_FOUND, During name lookup/catalog (20230628/psobject-372)
> AMD-Vi: IVRS Info VAsize = 64 PAsize = 48 GVAsize = 2 flags:0
> hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff irq 0,8 on acpi0
> Timecounter "HPET" frequency 14318180 Hz quality 950
> Event timer "HPET" frequency 14318180 Hz quality 350
> Event timer "HPET1" frequency 14318180 Hz quality 350
> Event timer "HPET2" frequency 14318180 Hz quality 350
> atrtc1: <AT realtime clock> on acpi0
> atrtc1: registered as a time-of-day clock, resolution 1.000000s
> Event timer "RTC" frequency 32768 Hz quality 0
> attimer0: <AT timer> port 0x40-0x43 on acpi0
> Timecounter "i8254" frequency 1193182 Hz quality 0
> Event timer "i8254" frequency 1193182 Hz quality 100
> Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
> acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
> acpi_ec0: <Embedded Controller: GPE 0xb> port 0x62,0x66,0x68,0x6c on acpi0
> isab0: <ACPI Generic ISA bridge> on acpi0
> isa0: <ISA bus> on isab0
> acpi_button0: <Power Button> on acpi0
> pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
> pci0: <ACPI PCI bus> on pcib0
> amdiommu0 at device 0.2 on pci0
> pcib1: <ACPI PCI-PCI bridge> at device 2.2 on pci0
> pci1: <ACPI PCI bus> on pcib1
> ppt0 mem 0x7f30800000-0x7f308fffff,0x60900000-0x60907fff at device 0.0 on pci1
> pcib2: <PCI-PCI bridge> at device 2.3 on pci0
> pcib3: <ACPI PCI-PCI bridge> at device 2.4 on pci0
> pci2: <ACPI PCI bus> on pcib3
> nvme0: <Generic NVMe Device> mem 0x60800000-0x60803fff at device 0.0 on pci2
> pci0: <old, non-VGA display device> at device 3.2 (no driver attached)
> pci0: <old, non-VGA display device> at device 3.3 (no driver attached)
> pci0: <old, non-VGA display device> at device 3.4 (no driver attached)
> pcib4: <ACPI PCI-PCI bridge> at device 8.1 on pci0
> pci3: <ACPI PCI bus> on pcib4
> vgapci0: <VGA-compatible display> port 0x1000-0x10ff mem
> 0x7f20000000-0x7f2fffffff,0x60000000-0x601fffff,0x60500000-0x6057ffff
> at device 0.0 on pci3
> hdac0: <ATI (0x1640) HDA Controller> mem 0x605c8000-0x605cbfff at
> device 0.1 on pci3
> pci3: <encrypt/decrypt> at device 0.2 (no driver attached)
> xhci0: <XHCI (generic) USB 3.0 controller> mem 0x60200000-0x602fffff
> at device 0.3 on pci3
> xhci0: 64 bytes context size, 64-bit DMA
> usbus0 on xhci0
> usbus0: 5.0Gbps Super Speed USB v3.0
> xhci1: <XHCI (generic) USB 3.0 controller> mem 0x60300000-0x603fffff
> at device 0.4 on pci3
> xhci1: 64 bytes context size, 64-bit DMA
> usbus1 on xhci1
> usbus1: 5.0Gbps Super Speed USB v3.0
> pci3: <multimedia> at device 0.5 (no driver attached)
> hdac1: <AMD Raven HDA Controller> mem 0x605c0000-0x605c7fff at device
> 0.6 on pci3
> pcib5: <PCI-PCI bridge> at device 8.2 on pci0
> pci4: <PCI bus> on pcib5
> pcib6: <ACPI PCI-PCI bridge> at device 8.3 on pci0
> pci5: <ACPI PCI bus> on pcib6
> xhci2: <XHCI (generic) USB 3.0 controller> mem 0x60600000-0x606fffff
> at device 0.3 on pci5
> xhci2: 64 bytes context size, 64-bit DMA
> usbus2 on xhci2
> usbus2: 5.0Gbps Super Speed USB v3.0
> xhci3: <XHCI (generic) USB 3.0 controller> mem 0x60700000-0x607fffff
> at device 0.4 on pci5
> xhci3: 64 bytes context size, 64-bit DMA
> usbus3 on xhci3
> usbus3: 5.0Gbps Super Speed USB v3.0
> isab1: <PCI-ISA bridge> at device 20.3 on pci0
> device_attach: isab1 attach returned 6
> acpi_lid0: <Control Method Lid Switch> on acpi0
> acpi_tz0: <Thermal Zone> on acpi0
> acpi_tz1: <Thermal Zone> on acpi0
> acpi_tz2: <Thermal Zone> on acpi0
> cpu0: <ACPI CPU> on acpi0
> atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
> atkbd0: <AT Keyboard> irq 1 on atkbdc0
> kbd0 at atkbd0
> atkbd0: [GIANT-LOCKED]
> acpi_acad0: <AC Adapter> on acpi0
> battery0: <ACPI Control Method Battery> on acpi0
> ivhd0: <AMD-Vi/IOMMU ivhd in mixed format> on acpi0
> ivhd0: Unknown dev entry:0xf0
> Variable size IVHD type 0xf0 not supported
> ivhd0: Flag:b0<IotlbSup,Coherent>
> ivhd0: Features(type:0x40) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0
> ivhd0: Extended
> features[31:0]:a2254afa<PPRSup,NXSup,GTSup,<b5>,IASup,GASup,PCSup>
> HATS = 0x2 GATS = 0x0 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x1 GAMSup =
> 0x1 DualPortLogSup = 0x2 DualEventLogSup = 0x2
> ivhd0: Extended
> features[62:32]:246577ef<USSup,PprOvrflwEarlySup,PPRAutoRspSup,BlKStopMrkSup,PerfOptSup,MsiCapMmioSup,GIOSup,EPHSup,InvIotlbSup>
> Max PASID: 0x2f DevTblSegSup = 0x3 MarcSup = 0x1
> ivhd0: supported paging level:7, will use only: 4
> ivhd0: device [0x3 - 0xfffe] config:0
> ivhd0: device [0xff00 - 0xffff] config:0
> ivhd0: PCI cap 0x190b640f@0x40 feature:19<IOTLB,EFR,CapExt>
> atrtc0: <AT realtime clock> at port 0x70 irq 8 on isa0
> atrtc0: Warning: Couldn't map I/O.
> atrtc0: registered as a time-of-day clock, resolution 1.000000s
> atrtc0: Can't map interrupt.
> hwpstate0: <Cool`n'Quiet 2.0> on cpu0
> Timecounter "TSC-low" frequency 1597000079 Hz quality 1000
> Timecounters tick every 1.000 msec
> ugen0.1: <AMD XHCI root HUB> at usbus0
> ugen3.1: <AMD XHCI root HUB> at usbus3
> uhub0 on usbus0
> uhub0: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
> uhub1 on usbus3
> uhub1: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus3
> ugen1.1: <AMD XHCI root HUB> at usbus1
> uhub2 on usbus1
> uhub2: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1
> ugen2.1: <AMD XHCI root HUB> at usbus2
> uhub3 on usbus2
> uhub3: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus2
> ZFS filesystem version: 5
> ZFS storage pool version: features support (5000)
> nvme0: Allocated 64MB host memory buffer
> hdacc0: <ATI R6xx HDA CODEC> at cad 0 on hdac0
> hdaa0: <ATI R6xx Audio Function Group> at nid 1 on hdacc0
> pcm0: <ATI R6xx (HDMI)> at nid 3 on hdaa0
> pcm1: <ATI R6xx (HDMI)> at nid 5 on hdaa0
> pcm2: <ATI R6xx (HDMI)> at nid 7 on hdaa0
> hdacc1: <Realtek ALC245 HDA CODEC> at cad 0 on hdac1
> hdaa1: <Realtek ALC245 Audio Function Group> at nid 1 on hdacc1
> pcm3: <Realtek ALC245 (Analog)> at nid 20 and 25 on hdaa1
> pcm4: <Realtek ALC245 (Left Analog Headphones)> at nid 33 on hdaa1
> nda0 at nvme0 bus 0 scbus0 target 0 lun 1
> nda0: <SAMSUNG MZVL4512HBLU-00BH1 HPS3NHAV S6B5NF0W347011>
> nda0: Serial Number S6B5NF0W347011
> nda0: nvme version 1.4
> nda0: 488386MB (1000215216 512 byte sectors)
> isab1: <PCI-ISA bridge> at device 20.3 on pci0
> device_attach: isab1 attach returned 6
> Trying to mount root from zfs:zroot/ROOT/default []...
> uhub2: 2 ports with 2 removable, self powered
> uhub3: 2 ports with 2 removable, self powered
> uhub1: 2 ports with 2 removable, self powered
> uhub0: 7 ports with 7 removable, self powered
> ugen1.2: <Quanta HP Wide Vision 5MP Camera> at usbus1
> ugen3.2: <VIA Labs, Inc. USB2.0 Hub> at usbus3
> uhub4 on uhub1
> uhub4: <VIA Labs, Inc. USB2.0 Hub, class 9/0, rev 2.10/90.11, addr 1> on usbus3
> ugen0.2: <MediaTek Inc. WirelessDevice> at usbus0
> uhub4: 4 ports with 4 removable, self powered
> ugen3.3: <VIA Labs, Inc. USB Keyboard> at usbus3
> ukbd0 on uhub4
> ukbd0: <VIA Labs, Inc. USB Keyboard, class 0/0, rev 2.00/3.01, addr 2> on usbus3
> kbd2 at ukbd0
> Root mount waiting for: usbus3
> ugen3.4: <Generic 4-Port USB 2.0 Hub> at usbus3
> uhub5 on uhub4
> uhub5: <Generic 4-Port USB 2.0 Hub, class 9/0, rev 2.10/1.21, addr 3> on usbus3
> uhub5: MTT enabled
> uhub5: 4 ports with 4 removable, self powered
> Root mount waiting for: usbus3
> ugen3.5: <Cypress USB Keyboard> at usbus3
> ukbd1 on uhub5
> ukbd1: <Cypress USB Keyboard, class 0/0, rev 2.00/0.01, addr 4> on usbus3
> kbd3 at ukbd1
> ukbd2 on uhub5
> ukbd2: <Cypress USB Keyboard, class 0/0, rev 2.00/0.01, addr 4> on usbus3
> kbd4 at ukbd2
> ugen3.6: <MOSART Semi. 2.4G INPUT DEVICE> at usbus3
> ukbd3 on uhub5
> ukbd3: <MOSART Semi. 2.4G INPUT DEVICE, class 0/0, rev 1.10/1.07, addr
> 5> on usbus3
> kbd5 at ukbd3
> Root mount waiting for: usbus3
> ugen3.7: <VIA Labs, Inc. USB3.0 Hub> at usbus3
> uhub6 on uhub1
> uhub6: <VIA Labs, Inc. USB3.0 Hub, class 9/0, rev 3.00/90.11, addr 6> on usbus3
> Root mount waiting for: usbus3
> uhub6: 4 ports with 4 removable, self powered
> ugen3.8: <Generic 4-Port USB 3.0 Hub> at usbus3
> uhub7 on uhub6
> uhub7: <Generic 4-Port USB 3.0 Hub, class 9/0, rev 3.00/1.21, addr 7> on usbus3
> uhub7: 4 ports with 4 removable, self powered
> Root mount waiting for: usbus3
> ugen3.9: <Realtek USB 10/100/1000 LAN> at usbus3
> ugen3.10: <Generic Mass Storage Device> at usbus3
> umass0 on uhub6
> umass0: <Generic Mass Storage Device, class 0/0, rev 3.00/1.00, addr
> 9> on usbus3
> (probe0:umass-sim0:0:0:0): REPORT LUNS. CDB: a0 00 00 00 00 00 00 00 00 10 00 00
> (probe0:umass-sim0:0:0:0): CAM status: SCSI Status Error
> (probe0:umass-sim0:0:0:0): SCSI status: Check Condition
> (probe0:umass-sim0:0:0:0): SCSI sense: ILLEGAL REQUEST asc:20,0
> (Invalid command operation code)
> (probe0:umass-sim0:0:0:0): Info: 0
> (probe0:umass-sim0:0:0:0): Command Specific Info: 0xaa5500
> (probe0:umass-sim0:0:0:0): Error 22, Unretryable error
> da0 at umass-sim0 bus 0 scbus1 target 0 lun 0
> da0: <Generic- SD/MMC 1.00> Removable Direct Access SPC-4 SCSI device
> da0: Serial Number 058F84688461
> da0: 400.000MB/s transfers
> da0: Attempt to query device size failed: NOT READY, Medium not present
> da0: quirks=0x2<NO_6_BYTE>
> da1 at umass-sim0 bus 0 scbus1 target 0 lun 1
> da1: <Generic- Micro SD/M2 1.08> Removable Direct Access SPC-4 SCSI device
> da1: Serial Number 058F84688461
> da1: 400.000MB/s transfers
> da1: Attempt to query device size failed: NOT READY, Medium not present
> da1: quirks=0x2<NO_6_BYTE>
> [drm] amdgpu kernel modesetting enabled.
> drmn0: <drmn> on vgapci0
> vgapci0: child drmn0 requested pci_enable_io
> vgapci0: child drmn0 requested pci_enable_io
> [drm] initializing kernel modesetting (IP DISCOVERY 0x1002:0x15BF
> 0x103C:0x8C21 0xCA).
> [drm] register mmio base: 0x60500000
> [drm] register mmio size: 524288
> [drm] add ip block number 0 <soc21_common>
> [drm] add ip block number 1 <gmc_v11_0>
> [drm] add ip block number 2 <ih_v6_0>
> [drm] add ip block number 3 <psp>
> [drm] add ip block number 4 <smu>
> [drm] add ip block number 5 <dm>
> [drm] add ip block number 6 <gfx_v11_0>
> [drm] add ip block number 7 <sdma_v6_0>
> [drm] add ip block number 8 <vcn_v4_0>
> [drm] add ip block number 9 <jpeg_v4_0>
> [drm] add ip block number 10 <mes_v11_0>
> drmn0: Fetched VBIOS from VFCT
> amdgpu: ATOM BIOS: 113-PHXGENERIC-001
> [drm] VCN(0) encode/decode are enabled in VM mode
> drmn0: [drm] jpeg_v4_0_set_dec_ring_funcsgc_11_0_1_mes_2.bin: could
> not load binary firmware /boot/firmware/gc_11_0_1_mes_2.bin either
> amdgpu/gc_11_0_1_mes_2.bin: could not load binary firmware
> /boot/firmware/amdgpu/gc_11_0_1_mes_2.bin either
> amdgpu_gc_11_0_1_mes_2.bin: could not load binary firmware
> /boot/firmware/amdgpu_gc_11_0_1_mes_2.bin either
> drmn0: successfully loaded firmware image 'amdgpu/gc_11_0_1_mes_2.bin'
> gc_11_0_1_mes1.bin: could not load binary firmware
> /boot/firmware/gc_11_0_1_mes1.bin either
> amdgpu/gc_11_0_1_mes1.bin: could not load binary firmware
> /boot/firmware/amdgpu/gc_11_0_1_mes1.bin either
> amdgpu_gc_11_0_1_mes1.bin: could not load binary firmware
> /boot/firmware/amdgpu_gc_11_0_1_mes1.bin either
> drmn0: successfully loaded firmware image 'amdgpu/gc_11_0_1_mes1.bin'
> drmn0: Trusted Memory Zone (TMZ) feature enabled
> drmn0: PCIE atomic ops is not supported
> [drm] vm size is 262144 GB, 4 levels, block size is 9-bit, fragment
> size is 9-bit
> drmn0: VRAM: 512M 0x0000008000000000 - 0x000000801FFFFFFF (512M used)
> drmn0: GART: 512M 0x0000000000000000 - 0x000000001FFFFFFF
> [drm ERROR :amdgpu_bo_init] Unable to set WC memtype for the aperture base
> [drm] Detected VRAM RAM=512M, BAR=512M
> [drm] RAM width 256bits LPDDR5
> [drm] amdgpu: 512M of VRAM memory ready
> [drm] amdgpu: 7823M of GTT memory ready.
> [drm] GART: num cpu pages 131072, num gpu pages 131072
> [drm] PCIE GART of 512M enabled (table at 0x000000801FD00000).
> psp_13_0_4_toc.bin: could not load binary firmware
> /boot/firmware/psp_13_0_4_toc.bin either
> amdgpu/psp_13_0_4_toc.bin: could not load binary firmware
> /boot/firmware/amdgpu/psp_13_0_4_toc.bin either
> amdgpu_psp_13_0_4_toc.bin: could not load binary firmware
> /boot/firmware/amdgpu_psp_13_0_4_toc.bin either
> drmn0: successfully loaded firmware image 'amdgpu/psp_13_0_4_toc.bin'
> psp_13_0_4_ta.bin: could not load binary firmware
> /boot/firmware/psp_13_0_4_ta.bin either
> amdgpu/psp_13_0_4_ta.bin: could not load binary firmware
> /boot/firmware/amdgpu/psp_13_0_4_ta.bin either
> amdgpu_psp_13_0_4_ta.bin: could not load binary firmware
> /boot/firmware/amdgpu_psp_13_0_4_ta.bin either
> drmn0: successfully loaded firmware image 'amdgpu/psp_13_0_4_ta.bin'
> drmn0: PSP runtime database doesn't exist
> drmn0: PSP runtime database doesn't exist
> dcn_3_1_4_dmcub.bin: could not load binary firmware
> /boot/firmware/dcn_3_1_4_dmcub.bin either
> amdgpu/dcn_3_1_4_dmcub.bin: could not load binary firmware
> /boot/firmware/amdgpu/dcn_3_1_4_dmcub.bin either
> amdgpu_dcn_3_1_4_dmcub.bin: could not load binary firmware
> /boot/firmware/amdgpu_dcn_3_1_4_dmcub.bin either
> drmn0: successfully loaded firmware image 'amdgpu/dcn_3_1_4_dmcub.bin'
> [drm] Loading DMUB firmware via PSP: version=0x08001B00
> gc_11_0_1_imu.bin: could not load binary firmware
> /boot/firmware/gc_11_0_1_imu.bin either
> amdgpu/gc_11_0_1_imu.bin: could not load binary firmware
> /boot/firmware/amdgpu/gc_11_0_1_imu.bin either
> amdgpu_gc_11_0_1_imu.bin: could not load binary firmware
> /boot/firmware/amdgpu_gc_11_0_1_imu.bin either
> drmn0: successfully loaded firmware image 'amdgpu/gc_11_0_1_imu.bin'
> gc_11_0_1_pfp.bin: could not load binary firmware
> /boot/firmware/gc_11_0_1_pfp.bin either
> amdgpu/gc_11_0_1_pfp.bin: could not load binary firmware
> /boot/firmware/amdgpu/gc_11_0_1_pfp.bin either
> amdgpu_gc_11_0_1_pfp.bin: could not load binary firmware
> /boot/firmware/amdgpu_gc_11_0_1_pfp.bin either
> drmn0: successfully loaded firmware image 'amdgpu/gc_11_0_1_pfp.bin'
> gc_11_0_1_me.bin: could not load binary firmware
> /boot/firmware/gc_11_0_1_me.bin either
> amdgpu/gc_11_0_1_me.bin: could not load binary firmware
> /boot/firmware/amdgpu/gc_11_0_1_me.bin either
> amdgpu_gc_11_0_1_me.bin: could not load binary firmware
> /boot/firmware/amdgpu_gc_11_0_1_me.bin either
> drmn0: successfully loaded firmware image 'amdgpu/gc_11_0_1_me.bin'
> gc_11_0_1_rlc.bin: could not load binary firmware
> /boot/firmware/gc_11_0_1_rlc.bin either
> amdgpu/gc_11_0_1_rlc.bin: could not load binary firmware
> /boot/firmware/amdgpu/gc_11_0_1_rlc.bin either
> amdgpu_gc_11_0_1_rlc.bin: could not load binary firmware
> /boot/firmware/amdgpu_gc_11_0_1_rlc.bin either
> drmn0: successfully loaded firmware image 'amdgpu/gc_11_0_1_rlc.bin'
> gc_11_0_1_mec.bin: could not load binary firmware
> /boot/firmware/gc_11_0_1_mec.bin either
> amdgpu/gc_11_0_1_mec.bin: could not load binary firmware
> /boot/firmware/amdgpu/gc_11_0_1_mec.bin either
> amdgpu_gc_11_0_1_mec.bin: could not load binary firmware
> /boot/firmware/amdgpu_gc_11_0_1_mec.bin either
> drmn0: successfully loaded firmware image 'amdgpu/gc_11_0_1_mec.bin'
> sdma_6_0_1.bin: could not load binary firmware
> /boot/firmware/sdma_6_0_1.bin either
> amdgpu/sdma_6_0_1.bin: could not load binary firmware
> /boot/firmware/amdgpu/sdma_6_0_1.bin either
> amdgpu_sdma_6_0_1.bin: could not load binary firmware
> /boot/firmware/amdgpu_sdma_6_0_1.bin either
> drmn0: successfully loaded firmware image 'amdgpu/sdma_6_0_1.bin'
> vcn_4_0_2.bin: could not load binary firmware
> /boot/firmware/vcn_4_0_2.bin either
> amdgpu/vcn_4_0_2.bin: could not load binary firmware
> /boot/firmware/amdgpu/vcn_4_0_2.bin either
> amdgpu_vcn_4_0_2.bin: could not load binary firmware
> /boot/firmware/amdgpu_vcn_4_0_2.bin either
> drmn0: successfully loaded firmware image 'amdgpu/vcn_4_0_2.bin'
> [drm] Found VCN firmware Version ENC: 1.10 DEC: 5 VEP: 0 Revision: 0
> drmn0: Will use PSP to load VCN firmware
> [drm] max_doorbell_slices=255
> [drm] reserve 0x4a00000 from 0x8010000000 for PSP TMR
> drmn0: RAS: optional ras ta ucode is not available
> drmn0: RAP: optional rap ta ucode is not available
> drmn0: SECUREDISPLAY: securedisplay ta ucode is not available
> drmn0: SMU is initialized successfully!
> [drm] Display Core initialized with v3.2.207!
> [drm] DMUB hardware initialized: version=0x08001B00
> lkpi_iic0: <LinuxKPI I2C> on drmn0
> iicbus0: <Philips I2C bus> on lkpi_iic0
> iic0: <I2C generic I/O> on iicbus0
> [drm] PSR support 1, DC PSR ver 1, sink PSR ver 4 DPCD caps 0x3a
> su_y_granularity 4
> lkpi_iic1: <LinuxKPI I2C> on drmn0
> iicbus1: <Philips I2C bus> on lkpi_iic1
> iic1: <I2C generic I/O> on iicbus1
> lkpi_iic2: <LinuxKPI I2C> on drmn0
> iicbus2: <Philips I2C bus> on lkpi_iic2
> iic2: <I2C generic I/O> on iicbus2
> lkpi_iic3: <LinuxKPI I2C> on drmn0
> iicbus3: <Philips I2C bus> on lkpi_iic3
> iic3: <I2C generic I/O> on iicbus3
> lkpi_iic4: <LinuxKPI I2C> on drmn0
> iicbus4: <Philips I2C bus> on lkpi_iic4
> iic4: <I2C generic I/O> on iicbus4
> lkpi_iic5: <LinuxKPI I2C> on drmn0
> iicbus5: <Philips I2C bus> on lkpi_iic5
> iic5: <I2C generic I/O> on iicbus5
> lkpi_iic6: <LinuxKPI I2C> on drmn0
> iicbus6: <Philips I2C bus> on lkpi_iic6
> iic6: <I2C generic I/O> on iicbus6
> lkpi_iic7: <LinuxKPI I2C> on drmn0
> iicbus7: <Philips I2C bus> on lkpi_iic7
> iic7: <I2C generic I/O> on iicbus7
> [drm] kiq ring mec 3 pipe 1 q 0
> [drm] VCN decode and encode initialized successfully(under DPG Mode).
> drmn0: [drm] jpeg_v4_0_hw_initdrmn0: SE 1, SH per SE 2, CU per SH 6,
> active_cu_number 4
> drmn0: ring gfx_0.0.0 uses VM inv eng 0 on hub 0
> drmn0: ring comp_1.0.0 uses VM inv eng 1 on hub 0
> drmn0: ring comp_1.1.0 uses VM inv eng 4 on hub 0
> drmn0: ring comp_1.2.0 uses VM inv eng 6 on hub 0
> drmn0: ring comp_1.3.0 uses VM inv eng 7 on hub 0
> drmn0: ring comp_1.0.1 uses VM inv eng 8 on hub 0
> drmn0: ring comp_1.1.1 uses VM inv eng 9 on hub 0
> drmn0: ring comp_1.2.1 uses VM inv eng 10 on hub 0
> drmn0: ring comp_1.3.1 uses VM inv eng 11 on hub 0
> drmn0: ring sdma0 uses VM inv eng 12 on hub 0
> drmn0: ring vcn_unified_0 uses VM inv eng 0 on hub 1
> drmn0: ring jpeg_dec uses VM inv eng 1 on hub 1
> drmn0: ring mes_kiq_3.1.0 uses VM inv eng 13 on hub 0
> [drm] ring gfx_32768.1.1 was added
> [drm] ring compute_32768.2.2 was added
> [drm] ring sdma_32768.3.3 was added
> [drm] ring gfx_32768.1.1 test pass
> [drm] ring gfx_32768.1.1 ib test pass
> [drm] ring compute_32768.2.2 test pass
> [drm] ring compute_32768.2.2 ib test pass
> [drm] ring sdma_32768.3.3 test pass
> [drm] ring sdma_32768.3.3 ib test pass
> vgapci0: child drmn0 requested pci_get_powerstate
> sysctl_warn_reuse: can't re-use a leaf (hw.dri.debug)!
> lkpi_iic8: <LinuxKPI I2C> on drm1
> iicbus8: <Philips I2C bus> on lkpi_iic8
> iic8: <I2C generic I/O> on iicbus8
> lkpi_iic9: <LinuxKPI I2C> on drm3
> iicbus9: <Philips I2C bus> on lkpi_iic9
> iic9: <I2C generic I/O> on iicbus9
> lkpi_iic10: <LinuxKPI I2C> on drm4
> iicbus10: <Philips I2C bus> on lkpi_iic10
> iic10: <I2C generic I/O> on iicbus10
> lkpi_iic11: <LinuxKPI I2C> on drm5
> iicbus11: <Philips I2C bus> on lkpi_iic11
> iic11: <I2C generic I/O> on iicbus11
> lkpi_iic12: <LinuxKPI I2C> on drm6
> iicbus12: <Philips I2C bus> on lkpi_iic12
> iic12: <I2C generic I/O> on iicbus12
> lkpi_iic13: <LinuxKPI I2C> on drm7
> iicbus13: <Philips I2C bus> on lkpi_iic13
> iic13: <I2C generic I/O> on iicbus13
> lkpi_iic14: <LinuxKPI I2C> on drm8
> iicbus14: <Philips I2C bus> on lkpi_iic14
> iic14: <I2C generic I/O> on iicbus14
> [drm] Initialized amdgpu 3.49.0 20150101 for drmn0 on minor 0
> VT: Replacing driver "efifb" with new "drmfb".
> [drm] DSC precompute is not needed.
> start FB_INFO:
> height=1600 width=2560 depth=32
> pbase=0x0 vbase=0xfffffe014d00c000
> name=drmn0 id=amdgpudrmfb flags=0x0 stride=10240
> end FB_INFO
> intsmb0: <AMD FCH SMBus Controller> at device 20.0 on pci0
> smbus0: <System Management Bus> on intsmb0
> isab1: <PCI-ISA bridge> at device 20.3 on pci0
> device_attach: isab1 attach returned 6
> isab1: <PCI-ISA bridge> at device 20.3 on pci0
> device_attach: isab1 attach returned 6
> driver bug: Unable to set devclass (class: ppc devname: (unknown))
> ig4iic0: <Designware I2C Controller> iomem 0xfedc5000-0xfedc5fff irq 6 on acpi0
> iicbus15: <Philips I2C bus (ACPI-hinted)> on ig4iic0
> iicbus15: <unknown card> at addr 0x15
> iic15: <I2C generic I/O> on iicbus15
> acpi_wmi0: <ACPI-WMI mapping> on acpi0
> acpi_wmi0: Embedded MOF found
> ACPI: \134_SB.AMW0.WQDD: 1 arguments were passed to a non-method ACPI
> object (Buffer) (20230628/nsarguments-361)
> acpi_wmi1: <ACPI-WMI mapping> on acpi0
> acpi_wmi1: Embedded MOF found
> ACPI: \134_SB.WFDE.WQCC: 1 arguments were passed to a non-method ACPI
> object (Buffer) (20230628/nsarguments-361)
> acpi_wmi2: <ACPI-WMI mapping> on acpi0
> acpi_wmi2: Embedded MOF found
> ACPI: \134_SB.WFTE.WQCC: 1 arguments were passed to a non-method ACPI
> object (Buffer) (20230628/nsarguments-361)
> acpi_wmi3: <ACPI-WMI mapping> on acpi0
> acpi_wmi3: Embedded MOF found
> ACPI: \134_SB.CPWM.WQBB: 1 arguments were passed to a non-method ACPI
> object (Buffer) (20230628/nsarguments-361)
> acpi_wmi4: <ACPI-WMI mapping> on acpi0
> acpi_wmi4: Embedded MOF found
> ACPI: \134_SB.WMID.WQAB: 1 arguments were passed to a non-method ACPI
> object (Buffer) (20230628/nsarguments-361)
> driver bug: Unable to set devclass (class: ppc devname: (unknown))
> lo0: link state changed to UP
> ubt0 on uhub0
> ubt0: <MediaTek Inc. WirelessDevice, class 239/2, rev 2.10/1.00, addr
> 1> on usbus0
> ubt1 on uhub0
> ubt1: <MediaTek Inc. WirelessDevice, class 239/2, rev 2.10/1.00, addr
> 1> on usbus0
> ubt1: ubt_attach:670: could not get two interfaces
> device_attach: ubt1 attach returned 6
> ubt1 on uhub0
> ubt1: <MediaTek Inc. WirelessDevice, class 239/2, rev 2.10/1.00, addr
> 1> on usbus0
> ubt1: ubt_attach:670: could not get two interfaces
> device_attach: ubt1 attach returned 6
> ums0 on uhub5
> ums0: <MOSART Semi. 2.4G INPUT DEVICE, class 0/0, rev 1.10/1.07, addr
> 5> on usbus3
> ums0: 5 buttons and [XYZT] coordinates ID=1
> ubt1 on uhub0
> ubt1: <MediaTek Inc. WirelessDevice, class 239/2, rev 2.10/1.00, addr
> 1> on usbus0
> ubt1: ubt_attach:670: could not get two interfaces
> device_attach: ubt1 attach returned 6
> ure0 on uhub7
> ure0: <Realtek USB 10/100/1000 LAN, class 0/0, rev 3.20/30.00, addr 8> on usbus3
> iichid0: <ELAN07D0:05 04F3:321A I2C HID device> at addr 0x15 on iicbus15
> iichid0: Interrupt setup failed. Fallback to sampling
> hidbus0: <HID bus> on iichid0
> miibus0: <MII bus> on ure0
> rgephy0: <RTL8251/8153 1000BASE-T media interface> PHY 0 on miibus0
> rgephy0:  none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX,
> 1000baseT-FDX, 1000baseT-FDX-master, auto
> ue0: <USB Ethernet> on ure0
> ue0: Ethernet address: 48:65:ee:10:9d:fa
> ue0: link state changed to DOWN
> ng_hci_process_command_timeout: ubt0hci - unable to complete HCI
> command OGF=0x3, OCF=0x3. Timeout
> hms0: <ELAN07D0:05 04F3:321A Mouse> on hidbus0
> hms0: 2 buttons and [XY] coordinates ID=1
> hmt0: <ELAN07D0:05 04F3:321A TouchPad> on hidbus0
> hconf0: <ELAN07D0:05 04F3:321A Configuration> on hidbus0
> hmt0: Multitouch touchpad with 0 external buttons, click-pad
> hmt0: 5 contacts with [C] properties. Report range [0:0] - [3831:2424]
> ue0: link state changed to UP
> ue0: link state changed to DOWN
> ue0: link state changed to UP
> 
> 
> 
> pciconf -lv
> ppt0@pci0:1:0:0:    class=0x028000 rev=0x02 hdr=0x00 vendor=0x14c3
> device=0x0616 subvendor=0x14c3 subdevice=0x223c
>    vendor     = 'MEDIATEK Corp.'
>    device     = 'MT7922 802.11ax PCI Express Wireless Network Adapter'
>    class      = network
> 
> 
> 
> /boot/loader.conf
> hw.vmm.amdvi.enable="1"
> vmm_load="YES"
> pptdevs="1/0/0"
> 
> Please let me know if there's additional information I can provide.
> -- 
> Thanks
> Peter
>