FreeBSD-main-amd64-test - Build #19977 - Failure

FreeBSD-main-amd64-test - Build #19977 (12ae3476f35c1f7c0e8cb55444728ed04c7130f9) - Failure

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19977/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19977/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19977/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

4b4cce02ac01a943aa1816e7ea9ae6017539e7bb by glebius:
xhci: add PCI IDs for USB controllers found on Supermicro M12SWA-TF

bd1d0850452ecd0bfa6a2ae4cd9938d302a59758 by glebius:
udp_multi_input(): the UDP header is only needed for probes

651a545143d2839f84a016f4e755a0b082ecfd50 by glebius:
udp_detach(): fix set but not used warning

12ae3476f35c1f7c0e8cb55444728ed04c7130f9 by glebius:
tcp_drain(): initialize the inpcb iterator when curvnet is set



The end of the build log:

[...truncated 3.95 MB...]
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0063b81e00
_sleep() at _sleep+0x2ce/frame 0xfffffe0063b81ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe0063b81ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063b81f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063b81f30
--- trap 0xc, rip = 0x3de4478b409a, rsp = 0x7fffffe7e1f8, rbp = 0x7fffffe7e210 ---

Tracing command aiod32 pid 14915 tid 100121 td 0xfffffe009dbd0720
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5de4d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5de4d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5de4dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a5de4e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00a5de4ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00a5de4ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5de4f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5de4f30
--- trap 0xc, rip = 0x314c419ee09a, rsp = 0x7fffff7b2398, rbp = 0x7fffff7b2490 ---

Tracing command soaiod1 pid 14922 tid 100738 td 0xfffffe00a70bd1e0
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9dfd70
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9dfd90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9dfdd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe009d9dfe10
_sleep() at _sleep+0x2ce/frame 0xfffffe009d9dfeb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe009d9dfef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9dff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9dff30
--- trap 0xc, rip = 0x1b069da6009a, rsp = 0x7fffff176d28, rbp = 0x7fffff176d40 ---

Tracing command soaiod2 pid 14923 tid 100737 td 0xfffffe00a70be740
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9dad70
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9dad90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9dadd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe009d9dae10
_sleep() at _sleep+0x2ce/frame 0xfffffe009d9daeb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe009d9daef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9daf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9daf30
--- trap 0xc, rip = 0x1db888e3909a, rsp = 0x7fffff0d1118, rbp = 0x7fffff0d1130 ---

Tracing command soaiod3 pid 14924 tid 100736 td 0xfffffe00a70a4740
sched_switch() at sched_switch+0x559/frame 0xfffffe0063bddd70
mi_switch() at mi_switch+0x157/frame 0xfffffe0063bddd90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063bdddd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0063bdde10
_sleep() at _sleep+0x2ce/frame 0xfffffe0063bddeb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe0063bddef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063bddf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063bddf30
--- trap 0xc, rip = 0x49f603b009a, rsp = 0x7fffffa718d8, rbp = 0x7fffffa718f0 ---

Tracing command soaiod4 pid 14925 tid 100735 td 0xfffffe00767c5ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7886d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7886d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7886dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a7886e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a7886eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a7886ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7886f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7886f30
--- trap 0xc, rip = 0x33e278dfe09a, rsp = 0x7fffff1a7768, rbp = 0x7fffff1a7780 ---

Tracing command auditd pid 679 tid 100101 td 0xfffffe000998a1e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00085ffb50
mi_switch() at mi_switch+0x157/frame 0xfffffe00085ffb70
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00085ffbb0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00085ffc00
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00085ffc10
_sleep() at _sleep+0x2dd/frame 0xfffffe00085ffcb0
audit_read() at audit_read+0x9c/frame 0xfffffe00085ffce0
devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe00085ffd40
dofileread() at dofileread+0x81/frame 0xfffffe00085ffd90
sys_read() at sys_read+0xc0/frame 0xfffffe00085ffe00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00085fff30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00085fff30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x27923137845a, rsp = 0x7fffff8f6f48, rbp = 0x7fffff8f6f90 ---

Tracing command sh pid 731 tid 100089 td 0xfffffe00767ba3a0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b8ba10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b8ba30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b8ba70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b8bac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b8bad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b8bb70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b8bc00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b8be00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b8bf30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b8bf30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2948861d463a, rsp = 0x7fffff334de8, rbp = 0x7fffff334ea0 ---

Tracing command sh pid 744 tid 100088 td 0xfffffe00767baac0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b90a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b90a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b90a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b90ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b90ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b90b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b90c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b90e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b90f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b90f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x89b824d663a, rsp = 0x7fffff7ed138, rbp = 0x7fffff7ed1f0 ---

Tracing command sh pid 751 tid 100100 td 0xfffffe000998a900
sched_switch() at sched_switch+0x559/frame 0xfffffe0063a74a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063a74a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063a74a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063a74ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063a74ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063a74b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063a74c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063a74e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063a74f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063a74f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x32091b38463a, rsp = 0x7fffffe59768, rbp = 0x7fffffe59820 ---

Tracing command kyua pid 752 tid 100106 td 0xfffffe00767bb900
sched_switch() at sched_switch+0x559/frame 0xfffffe00765eba10
mi_switch() at mi_switch+0x157/frame 0xfffffe00765eba30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00765eba70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00765ebac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00765ebad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00765ebb70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00765ebc00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00765ebe00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00765ebf30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00765ebf30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0xa000c74c63a, rsp = 0x7fffff331cc8, rbp = 0x7fffff331d00 ---

Tracing command md0 pid 13339 tid 100105 td 0xfffffe00767bc020
sched_switch() at sched_switch+0x559/frame 0xfffffe00765f0da0
mi_switch() at mi_switch+0x157/frame 0xfffffe00765f0dc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00765f0e00
_sleep() at _sleep+0x2e7/frame 0xfffffe00765f0ea0
md_kthread() at md_kthread+0xd5/frame 0xfffffe00765f0ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00765f0f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00765f0f30
--- trap 0xc, rip = 0xb35ea6e309a, rsp = 0x7fffff1dd8a8, rbp = 0x7fffff1dd9a0 ---

Tracing command KTLS pid 60589 tid 100114 td 0xfffffe009db84560
sched_switch() at sched_switch+0x559/frame 0xfffffe00765c8d00
mi_switch() at mi_switch+0x157/frame 0xfffffe00765c8d20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00765c8d60
_sleep() at _sleep+0x2e7/frame 0xfffffe00765c8e00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00765c8ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00765c8f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00765c8f30
--- trap 0xc, rip = 0x2815d3b0c09a, rsp = 0x7fffff621428, rbp = 0x7fffff621440 ---

Tracing command KTLS pid 60589 tid 101452 td 0xfffffe00a70bae40
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7831d00
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7831d20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7831d60
_sleep() at _sleep+0x2e7/frame 0xfffffe00a7831e00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00a7831ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7831f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7831f30
--- trap 0x16, rip = 0x3aea797f009a, rsp = 0x7fffdf14ea88, rbp = 0x7fffdf14eaa0 ---

Tracing command KTLS pid 60589 tid 101453 td 0xfffffe00a7c513a0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a78a9d40
mi_switch() at mi_switch+0x157/frame 0xfffffe00a78a9d60
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a78a9da0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a78a9e40
ktls_alloc_thread() at ktls_alloc_thread+0x204/frame 0xfffffe00a78a9ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a78a9f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a78a9f30
--- trap 0x16, rip = 0x3aea797f009a, rsp = 0x604a88, rbp = 0x604aa0 ---

Tracing command kyua pid 14062 tid 101719 td 0xfffffe00ac37a000 (CPU 1)
cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00097cde00
ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00097cde10
trap() at trap+0x56/frame 0xfffffe00097cdf20
nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00097cdf20
--- trap 0x13, rip = 0xffffffff810aa93d, rsp = 0xfffffe00ac701750, rbp = 0xfffffe00ac701890 ---
pmap_remove_pages() at pmap_remove_pages+0x51d/frame 0xfffffe00ac701890
exec_new_vmspace() at exec_new_vmspace+0x209/frame 0xfffffe00ac701900
exec_elf64_imgact() at exec_elf64_imgact+0x877/frame 0xfffffe00ac7019f0
kern_execve() at kern_execve+0x70d/frame 0xfffffe00ac701d80
sys_execve() at sys_execve+0x5a/frame 0xfffffe00ac701e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00ac701f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ac701f30
--- syscall (59, FreeBSD ELF64, sys_execve), rip = 0xa000c74971a, rsp = 0x7fffff331838, rbp = 0x7fffff331840 ---

Tracing command ng_queue pid 65519 tid 100558 td 0xfffffe00a7c4f000
sched_switch() at sched_switch+0x559/frame 0xfffffe00a784ad80
mi_switch() at mi_switch+0x157/frame 0xfffffe00a784ada0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a784ade0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a784ae80
ngthread() at ngthread+0x88/frame 0xfffffe00a784aef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a784af30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a784af30
--- trap 0xc, rip = 0x103f71c1d09a, rsp = 0x7fffff382d38, rbp = 0x7fffff382e30 ---

Tracing command ng_queue pid 65519 tid 101484 td 0xfffffe00a70c3e40
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9d0d80
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9d0da0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9d0de0
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9d0e80
ngthread() at ngthread+0x88/frame 0xfffffe009d9d0ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9d0f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9d0f30
--- trap 0x16, rip = 0x239ec50b909a, rsp = 0x805a88, rbp = 0x805aa0 ---
db:0:kdb.enter.panic> dump
Dumping 488 out of 4060 MB:..4%..14%..23%..33%..43%..53%..63%..73%..82%..92%
Dump complete
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-19977' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-notyet-tests.sh
x ./run.sh
x ./disable-zfs-tests.sh
x ./auto-shutdown
x ./disable-dtrace-tests.sh
x ./run-kyua.sh
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins5774561223784062871.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '12ae3476f35c1f7c0e8cb55444728ed04c7130f9', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../12ae3476f35c1f7c0e8cb55444728ed04c7130f9/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address