[Bug 273890] Fatal trap 12: page fault while in kernel mode

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=273890

            Bug ID: 273890
           Summary: Fatal trap 12: page fault while in kernel mode
           Product: Base System
           Version: 14.0-STABLE
          Hardware: amd64
                OS: Any
            Status: New
          Severity: Affects Only Me
          Priority: ---
         Component: kern
          Assignee: bugs@FreeBSD.org
          Reporter: weldon@excelsus.com

I know I am pushing things, I am running FreeBSD 14-BETA2 as a VM on TrueNAS
Scale (I also had this happen on BETA1).   But I thought you may want to look
at it.

I have three VMs running on the TrueNAS Scale hypervisor (same machine).   All
are not doing much yet at all (one just fresh install, another doing light DNS,
third running DNS and running a very lightly used apache web server).  So far
only the web server is panicing, the other two hasnt panic yet.  

I can provide a core dump if needed, it is too large to upload to this ticket.

____

% uname -a
FreeBSD venom-f5 14.0-BETA2 FreeBSD 14.0-BETA2 #1
releng/14.0-n265099-8d60ede293e: Sat Sep 16 11:18:03 CDT 2023    
root@venom-f5:/usr/obj/usr/src/amd64.amd64/sys/VENOM-F5 amd64
_______

Sep 16 20:26:24 venom-f5 named[684]: clients-per-query decreased to 18
Sep 16 20:30:38 venom-f5 sshd[1647]: error: Fssh_kex_exchange_identification:
Connection closed by remote host
Sep 16 20:46:24 venom-f5 named[684]: clients-per-query decreased to 17
Sep 16 20:53:07 venom-f5 syslogd: last message repeated 1 times
Sep 16 20:59:05 venom-f5 kernel:
Sep 16 20:56:00 venom-f5 syslogd: kernel boot file is /boot/kernel/kernel
Sep 16 20:56:00 venom-f5 kernel:
Sep 16 20:56:00 venom-f5 kernel: Fatal trap 12: page fault while in kernel mode
Sep 16 20:56:00 venom-f5 kernel: cpuid = 5; apic id = 05
Sep 16 20:56:00 venom-f5 kernel: fault virtual address  = 0xb8
Sep 16 20:56:00 venom-f5 kernel: fault code             = supervisor read data,
page not present
Sep 16 20:56:00 venom-f5 kernel: instruction pointer    =
0x20:0xffffffff80d4e090
Sep 16 20:56:00 venom-f5 kernel: stack pointer          =
0x28:0xfffffe01017a7c70
Sep 16 20:56:00 venom-f5 kernel: frame pointer          =
0x28:0xfffffe01017a7cf0
Sep 16 20:56:00 venom-f5 kernel: code segment           = base 0x0, limit
0xfffff, type 0x1b
Sep 16 20:56:00 venom-f5 kernel:                        = DPL 0, pres 1, long
1, def32 0, gran 1
Sep 16 20:56:00 venom-f5 kernel: processor eflags       = interrupt enabled,
resume, IOPL = 0
Sep 16 20:56:00 venom-f5 kernel: current process                = 684
(isc-net-0001)
Sep 16 20:56:00 venom-f5 kernel: rdi: ffffffff816c79c0 rsi: ffffffff816c79c0
rdx: 0000000000010200
Sep 16 20:56:00 venom-f5 kernel: rcx: 0000000000000000  r8: fffff800073aa800 
r9: 0000000000000000
Sep 16 20:56:00 venom-f5 kernel: rax: fffff801dc915e00 rbx: fffff801dc8f8c40
rbp: fffffe01017a7cf0
Sep 16 20:56:00 venom-f5 kernel: r10: 0000000000000000 r11: fffffe0102c14c60
r12: fffff801a252f220
Sep 16 20:56:00 venom-f5 kernel: r13: 00000000000013fe r14: 00000000000013fe
r15: fffff800073aa800
Sep 16 20:56:00 venom-f5 kernel: trap number            = 12
Sep 16 20:56:00 venom-f5 kernel: panic: page fault
Sep 16 20:56:00 venom-f5 kernel: cpuid = 5
Sep 16 20:56:00 venom-f5 kernel: time = 1694915945
Sep 16 20:56:00 venom-f5 kernel: KDB: stack backtrace:
Sep 16 20:56:00 venom-f5 kernel: #0 0xffffffff80b92cad at kdb_backtrace+0x5d
Sep 16 20:56:00 venom-f5 kernel: #1 0xffffffff80b45db2 at vpanic+0x132
Sep 16 20:56:00 venom-f5 kernel: #2 0xffffffff80b45c73 at panic+0x43
Sep 16 20:56:00 venom-f5 kernel: #3 0xffffffff8103181c at trap_fatal+0x40c
Sep 16 20:56:00 venom-f5 kernel: #4 0xffffffff8103186f at trap_pfault+0x4f
Sep 16 20:56:00 venom-f5 kernel: #5 0xffffffff81008298 at calltrap+0x8
Sep 16 20:56:00 venom-f5 kernel: #6 0xffffffff80d700ac at udp6_bind+0x13c
Sep 16 20:56:00 venom-f5 kernel: #7 0xffffffff80be8b12 at sobind+0x32
Sep 16 20:56:00 venom-f5 kernel: #8 0xffffffff80bf0015 at kern_bindat+0xc5
Sep 16 20:56:00 venom-f5 kernel: #9 0xffffffff80befeab at sys_bind+0x9b
Sep 16 20:56:00 venom-f5 kernel: #10 0xffffffff810320d9 at amd64_syscall+0x109
Sep 16 20:56:00 venom-f5 kernel: #11 0xffffffff81008bab at
fast_syscall_common+0xf8
Sep 16 20:56:00 venom-f5 kernel: Uptime: 9h25m35s
Sep 16 20:56:00 venom-f5 kernel: Dumping 722 out of 16338
MB:..3%..12%..23%..32%..43%..51%..63%..71%..82%..91%
Sep 16 20:56:00 venom-f5 kernel: Dump complete
Sep 16 20:56:00 venom-f5 kernel: Automatic reboot in 15 seconds - press a key
on the console to abort
Sep 16 20:56:00 venom-f5 kernel: Rebooting...
Sep 16 20:56:00 venom-f5 kernel: cpu_reset: Restarting BSP
Sep 16 20:56:00 venom-f5 kernel: cpu_reset_proxy: Stopped CPU 5
Sep 16 20:56:00 venom-f5 kernel: ---<<BOOT>>---
Sep 16 20:56:00 venom-f5 kernel: Copyright (c) 1992-2023 The FreeBSD Project.
Sep 16 20:56:00 venom-f5 kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988,
1989, 1991, 1992, 1993, 1994
Sep 16 20:56:00 venom-f5 kernel:        The Regents of the University of
California. All rights reserved.
Sep 16 20:56:00 venom-f5 kernel: FreeBSD is a registered trademark of The
FreeBSD Foundation.
Sep 16 20:56:00 venom-f5 kernel: FreeBSD 14.0-BETA2 #1
releng/14.0-n265099-8d60ede293e: Sat Sep 16 11:18:03 CDT 2023
Sep 16 20:56:00 venom-f5 kernel:    
root@venom-f5:/usr/obj/usr/src/amd64.amd64/sys/VENOM-F5 amd64
Sep 16 20:56:00 venom-f5 kernel: FreeBSD clang version 16.0.6
(https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a25
9152)
Sep 16 20:56:00 venom-f5 kernel: VT(efifb): resolution 800x600
Sep 16 20:56:00 venom-f5 kernel: CPU: 12th Gen Intel(R) Core(TM) i7-12700KF
(3609.75-MHz K8-class CPU)
Sep 16 20:56:00 venom-f5 kernel:   Origin="GenuineIntel"  Id=0x90672 
Family=0x6  Model=0x97  Stepping=2
Sep 16 20:56:00 venom-f5 kernel:  
Features=0x1f83fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX
,FXSR,SSE,SSE2,SS,HTT>
Sep 16 20:56:00 venom-f5 kernel:  
Features2=0xfffab223<SSE3,PCLMULQDQ,VMX,SSSE3,FMA,CX16,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POP
CNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND,HV>
Sep 16 20:56:00 venom-f5 kernel:   AMD
Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
Sep 16 20:56:00 venom-f5 kernel:   AMD Features2=0x121<LAHF,ABM,Prefetch>
Sep 16 20:56:00 venom-f5 kernel:   Structured Extended
Features=0x219c07ab<FSGSBASE,TSCADJ,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,RDSEED
,ADX,SMAP,CLFLUSHOPT,CLWB,SHA>
Sep 16 20:56:00 venom-f5 kernel:   Structured Extended
Features2=0x1840073c<UMIP,PKU,OSPKE,WAITPKG,GFNI,VAES,VPCLMULQDQ,RDPID,MOVD
IRI,MOVDIR64B>
Sep 16 20:56:00 venom-f5 kernel:   Structured Extended
Features3=0xac004410<FSRM,MD_CLEAR,IBPB,STIBP,ARCH_CAP,SSBD>
Sep 16 20:56:00 venom-f5 kernel:   XSAVE
Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
Sep 16 20:56:00 venom-f5 kernel:  
IA32_ARCH_CAPS=0x6b<RDCL_NO,IBRS_ALL,SKIP_L1DFL_VME,MDS_NO>
Sep 16 20:56:00 venom-f5 kernel:   AMD Extended Feature Extensions ID
EBX=0x1009000<IBPB,STIBP,SSBD>
Sep 16 20:56:00 venom-f5 kernel:   VT-x:
PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
Sep 16 20:56:00 venom-f5 kernel: Hypervisor: Origin = "KVMKVMKVM"
Sep 16 20:56:00 venom-f5 kernel: real memory  = 17179869184 (16384 MB)
Sep 16 20:56:00 venom-f5 kernel: avail memory = 16611700736 (15842 MB)
Sep 16 20:56:00 venom-f5 kernel: Event timer "LAPIC" quality 600
Sep 16 20:56:00 venom-f5 kernel: ACPI APIC Table: <BOCHS  BXPCAPIC>
Sep 16 20:56:00 venom-f5 kernel: WARNING: L3 data cache covers more APIC IDs
than a package (7 > 3)
Sep 16 20:56:00 venom-f5 kernel: FreeBSD/SMP: Multiprocessor System Detected: 6
CPUs
Sep 16 20:56:00 venom-f5 kernel: FreeBSD/SMP: 1 package(s) x 6 core(s)
Sep 16 20:56:00 venom-f5 kernel: random: registering fast source Intel Secure
Key RNG
Sep 16 20:56:00 venom-f5 kernel: random: fast provider: "Intel Secure Key RNG"
Sep 16 20:56:00 venom-f5 kernel: random: unblocking device.
Sep 16 20:56:00 venom-f5 kernel: ioapic0 <Version 1.1> irqs 0-23
Sep 16 20:56:00 venom-f5 kernel: Launching APs: 3 2 4 5 1
Sep 16 20:56:00 venom-f5 kernel: random: entropy device external interface
Sep 16 20:56:00 venom-f5 kernel: kbd1 at kbdmux0
Sep 16 20:56:00 venom-f5 kernel: efirtc0: <EFI Realtime Clock>
Sep 16 20:56:00 venom-f5 kernel: efirtc0: registered as a time-of-day clock,
resolution 1.000000s
Sep 16 20:56:00 venom-f5 kernel: kvmclock0: <KVM paravirtual clock>
Sep 16 20:56:00 venom-f5 kernel: Timecounter "kvmclock" frequency 1000000000 Hz
quality 975
Sep 16 20:56:00 venom-f5 kernel: kvmclock0: registered as a time-of-day clock,
resolution 0.000001s
Sep 16 20:56:00 venom-f5 kernel: smbios0: <System Management BIOS> at iomem
0xbf91b000-0xbf91b01e
Sep 16 20:56:00 venom-f5 kernel: smbios0: Version: 2.8, BCD Revision: 2.8
Sep 16 20:56:00 venom-f5 kernel: aesni0:
<AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256>
Sep 16 20:56:00 venom-f5 kernel: acpi0: <BOCHS BXPCFACP>
Sep 16 20:56:00 venom-f5 kernel: acpi0: Power Button (fixed)
Sep 16 20:56:00 venom-f5 kernel: cpu0: <ACPI CPU> on acpi0
Sep 16 20:56:00 venom-f5 kernel: atrtc0: <AT realtime clock> port 0x70-0x77 irq
8 on acpi0
Sep 16 20:56:00 venom-f5 kernel: atrtc0: registered as a time-of-day clock,
resolution 1.000000s
Sep 16 20:56:00 venom-f5 kernel: Event timer "RTC" frequency 32768 Hz quality 0
Sep 16 20:56:00 venom-f5 kernel: hpet0: <High Precision Event Timer> iomem
0xfed00000-0xfed003ff on acpi0
Sep 16 20:56:00 venom-f5 kernel: Timecounter "HPET" frequency 100000000 Hz
quality 950
Sep 16 20:56:00 venom-f5 kernel: Timecounter "ACPI-fast" frequency 3579545 Hz
quality 900
Sep 16 20:56:00 venom-f5 kernel: acpi_timer0: <24-bit timer at 3.579545MHz>
port 0xb008-0xb00b on acpi0
Sep 16 20:56:00 venom-f5 kernel: pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff
on acpi0
Sep 16 20:56:00 venom-f5 kernel: pci_link4: BIOS IRQ 10 for 0.1.INTA is invalid
Sep 16 20:56:00 venom-f5 kernel: pci_link1: BIOS IRQ 10 does not match initial
IRQ 11
Sep 16 20:56:00 venom-f5 kernel: pci_link2: BIOS IRQ 11 does not match initial
IRQ 10
Sep 16 20:56:00 venom-f5 kernel: pci_link3: BIOS IRQ 11 does not match initial
IRQ 10
Sep 16 20:56:00 venom-f5 kernel: pci_link0: BIOS IRQ 10 does not match initial
IRQ 11
Sep 16 20:56:00 venom-f5 kernel: pci0: <ACPI PCI bus> on pcib0
Sep 16 20:56:00 venom-f5 kernel: isab0: <PCI-ISA bridge> at device 1.0 on pci0
Sep 16 20:56:00 venom-f5 kernel: isa0: <ISA bus> on isab0
Sep 16 20:56:00 venom-f5 kernel: atapci0: <Intel PIIX3 WDMA2 controller> port
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xc100-0xc10f at
 device 1.1 on pci0
Sep 16 20:56:00 venom-f5 kernel: ata0: <ATA channel> at channel 0 on atapci0
Sep 16 20:56:00 venom-f5 kernel: ata1: <ATA channel> at channel 1 on atapci0
Sep 16 20:56:00 venom-f5 kernel: pci0: <bridge> at device 1.3 (no driver
attached)
Sep 16 20:56:00 venom-f5 kernel: vgapci0: <VGA-compatible display> port
0xc0e0-0xc0ff mem 0xc4000000-0xc7ffffff,0xc0000000-0xc3fff
fff,0xc8060000-0xc8061fff irq 10 at device 2.0 on pci0
Sep 16 20:56:00 venom-f5 kernel: vgapci0: Boot video device
Sep 16 20:56:00 venom-f5 kernel: em0: <Intel(R) Legacy PRO/1000 MT 82540EM>
port 0xc080-0xc0bf mem 0xc8040000-0xc805ffff irq 11 at
 device 3.0 on pci0
Sep 16 20:56:00 venom-f5 kernel: em0: Using 1024 TX descriptors and 1024 RX
descriptors
Sep 16 20:56:00 venom-f5 kernel: em0: Ethernet address: 00:a0:98:63:39:f0
Sep 16 20:56:00 venom-f5 kernel: em0: netmap queues/slots: TX 1/1024, RX 1/1024
Sep 16 20:56:00 venom-f5 kernel: xhci0: <NEC uPD720200 USB 3.0 controller> mem
0x800008000-0x80000bfff irq 11 at device 4.0 on pci
0
Sep 16 20:56:00 venom-f5 kernel: xhci0: 32 bytes context size, 32-bit DMA
Sep 16 20:56:00 venom-f5 kernel: xhci_interrupt: host controller halted
Sep 16 20:56:00 venom-f5 syslogd: last message repeated 51 times
Sep 16 20:56:00 venom-f5 kernel: usbus0 on xhci0
Sep 16 20:56:00 venom-f5 kernel: usbus0: 5.0Gbps Super Speed USB v3.0
Sep 16 20:56:00 venom-f5 kernel: ahci0: <Intel ICH9 AHCI SATA controller> port
0xc0c0-0xc0df mem 0xc8063000-0xc8063fff irq 10 at d
evice 5.0 on pci0
Sep 16 20:56:00 venom-f5 kernel: ahci0: AHCI v1.00 with 6 1.5Gbps ports, Port
Multiplier not supported
Sep 16 20:56:00 venom-f5 kernel: ahcich0: <AHCI channel> at channel 0 on ahci0
Sep 16 20:56:00 venom-f5 kernel: ahcich1: <AHCI channel> at channel 1 on ahci0
Sep 16 20:56:00 venom-f5 kernel: ahcich2: <AHCI channel> at channel 2 on ahci0
Sep 16 20:56:00 venom-f5 kernel: ahcich3: <AHCI channel> at channel 3 on ahci0
Sep 16 20:56:00 venom-f5 kernel: ahcich4: <AHCI channel> at channel 4 on ahci0
Sep 16 20:56:00 venom-f5 kernel: ahcich5: <AHCI channel> at channel 5 on ahci0
Sep 16 20:56:00 venom-f5 kernel: virtio_pci0: <VirtIO PCI (legacy) Console
adapter> port 0xc040-0xc07f mem 0xc8062000-0xc8062fff,0
x800000000-0x800003fff irq 10 at device 6.0 on pci0
Sep 16 20:56:00 venom-f5 kernel: virtio_pci1: <VirtIO PCI (legacy) Balloon
adapter> port 0xc000-0xc03f mem 0x800004000-0x800007fff
 irq 11 at device 7.0 on pci0
Sep 16 20:56:00 venom-f5 kernel: vtballoon0: <VirtIO Balloon Adapter> on
virtio_pci1
Sep 16 20:56:00 venom-f5 kernel: acpi_syscontainer0: <System Container> on
acpi0
Sep 16 20:56:00 venom-f5 kernel: acpi_syscontainer1: <System Container> port
0xaf00-0xaf0b on acpi0
Sep 16 20:56:00 venom-f5 kernel: acpi_syscontainer2: <System Container> port
0xafe0-0xafe3 on acpi0
Sep 16 20:56:00 venom-f5 kernel: acpi_syscontainer3: <System Container> port
0xae00-0xae13 on acpi0
Sep 16 20:56:00 venom-f5 kernel: uart0: <16550 or compatible> port 0x3f8-0x3ff
irq 4 flags 0x10 on acpi0
Sep 16 20:56:00 venom-f5 kernel: uart0: console (115200,n,8,1)
Sep 16 20:56:00 venom-f5 kernel: atkbdc0: <Keyboard controller (i8042)> port
0x60,0x64 irq 1 on acpi0
Sep 16 20:56:00 venom-f5 kernel: atkbd0: <AT Keyboard> irq 1 on atkbdc0
Sep 16 20:56:00 venom-f5 kernel: kbd0 at atkbd0
Sep 16 20:56:00 venom-f5 kernel: atkbd0: [GIANT-LOCKED]
Sep 16 20:56:00 venom-f5 kernel: psm0: <PS/2 Mouse> irq 12 on atkbdc0
Sep 16 20:56:00 venom-f5 kernel: psm0: [GIANT-LOCKED]
Sep 16 20:56:00 venom-f5 kernel: WARNING: Device "psm" is Giant locked and may
be deleted before FreeBSD 14.0.
Sep 16 20:56:00 venom-f5 kernel: psm0: model IntelliMouse Explorer, device ID 4
Sep 16 20:56:00 venom-f5 kernel: fdc0: <floppy drive controller (FDE)> port
0x3f2-0x3f5,0x3f7 irq 6 drq 2 on acpi0
Sep 16 20:56:00 venom-f5 kernel: fdc0: does not respond
Sep 16 20:56:00 venom-f5 kernel: device_attach: fdc0 attach returned 6
Sep 16 20:56:00 venom-f5 kernel: attimer0: <AT timer> at port 0x40 on isa0
Sep 16 20:56:00 venom-f5 kernel: Timecounter "i8254" frequency 1193182 Hz
quality 0
Sep 16 20:56:00 venom-f5 kernel: Event timer "i8254" frequency 1193182 Hz
quality 100
Sep 16 20:56:00 venom-f5 kernel: attimer0: non-PNP ISA device will be removed
from GENERIC in FreeBSD 14.
Sep 16 20:56:00 venom-f5 kernel: fdc0: No FDOUT register!
Sep 16 20:56:00 venom-f5 kernel: Timecounters tick every 10.000 msec
Sep 16 20:56:00 venom-f5 kernel: ZFS filesystem version: 5
Sep 16 20:56:00 venom-f5 kernel: ZFS storage pool version: features support
(5000)
Sep 16 20:56:00 venom-f5 kernel: ipfw2 (+ipv6) initialized, divert enabled, nat
loadable, default to accept, logging disabled
Sep 16 20:56:00 venom-f5 kernel: Trying to mount root from
zfs:zroot/ROOT/default []...
Sep 16 20:56:00 venom-f5 kernel: ugen0.1: <(0x1033) XHCI root HUB> at usbus0
Sep 16 20:56:00 venom-f5 kernel: uhub0 on usbus0
Sep 16 20:56:00 venom-f5 kernel: uhub0: <(0x1033) XHCI root HUB, class 9/0, rev
3.00/1.00, addr 1> on usbus0
Sep 16 20:56:00 venom-f5 kernel: ada0 at ahcich0 bus 0 scbus2 target 0 lun 0
Sep 16 20:56:00 venom-f5 kernel: ada0: <QEMU HARDDISK 2.5+> ATA-7 SATA device
Sep 16 20:56:00 venom-f5 kernel: ada0: Serial Number QM00005
Sep 16 20:56:00 venom-f5 kernel: ada0: 150.000MB/s transfers (SATA 1.x, UDMA5,
PIO 8192bytes)
Sep 16 20:56:00 venom-f5 kernel: ada0: Command Queueing enabled
Sep 16 20:56:00 venom-f5 kernel: ada0: 2621440MB (5368709120 512 byte sectors)
Sep 16 20:56:00 venom-f5 kernel: uhub0: 8 ports with 8 removable, self powered
Sep 16 20:56:00 venom-f5 kernel: ugen0.2: <QEMU QEMU USB Tablet> at usbus0
Sep 16 20:56:00 venom-f5 kernel: Dual Console: Serial Primary, Video Secondary
Sep 16 20:56:00 venom-f5 kernel: intsmb0: <Intel PIIX4 SMBUS Interface> irq 9
at device 1.3 on pci0
Sep 16 20:56:00 venom-f5 kernel: intsmb0: Could not allocate I/O space
Sep 16 20:56:00 venom-f5 kernel: device_attach: intsmb0 attach returned 6
Sep 16 20:56:00 venom-f5 kernel: vtcon0: <VirtIO Console Adapter> on
virtio_pci0
Sep 16 20:56:00 venom-f5 kernel: em0: link state changed to UP

-- 
You are receiving this mail because:
You are the assignee for the bug.