FreeBSD-main-amd64-test - Build #19897 - Failure

FreeBSD-main-amd64-test - Build #19897 (0229172a65765392f566ae1cdc730615ab504e15) - Failure

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19897/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19897/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19897/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

0229172a65765392f566ae1cdc730615ab504e15 by hselasky:
usb/u3g: Add support for Quectel EM05.



The end of the build log:

[...truncated 3.92 MB...]
--- trap 0xc, rip = 0x1de19e8e4d9a, rsp = 0x7fffff76e768, rbp = 0x7fffff76e860 ---

Tracing command aiod19 pid 2183 tid 100094 td 0xfffffe00773ab000
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b72d60
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b72d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b72dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0063b72e00
_sleep() at _sleep+0x2ce/frame 0xfffffe0063b72ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe0063b72ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063b72f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063b72f30
--- trap 0xc, rip = 0x197c50e2d9a, rsp = 0x7fffff54a218, rbp = 0x7fffff54a230 ---

Tracing command soaiod1 pid 2203 tid 100133 td 0xfffffe009dbb4e40
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5df3d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5df3d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5df3dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a5df3e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a5df3eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a5df3ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5df3f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5df3f30
--- trap 0xc, rip = 0x1993e866ad9a, rsp = 0x7fffff648dd8, rbp = 0x7fffff648df0 ---

Tracing command soaiod2 pid 2204 tid 100120 td 0xfffffe009dbb63a0
sched_switch() at sched_switch+0x559/frame 0xfffffe009d967d70
mi_switch() at mi_switch+0x157/frame 0xfffffe009d967d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d967dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe009d967e10
_sleep() at _sleep+0x2ce/frame 0xfffffe009d967eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe009d967ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d967f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d967f30
--- trap 0xc, rip = 0x2e81eece8d9a, rsp = 0x7fffff3a3378, rbp = 0x7fffff3a3390 ---

Tracing command soaiod3 pid 2205 tid 100102 td 0xfffffe009db45000
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5db2d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5db2d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5db2dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a5db2e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a5db2eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a5db2ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5db2f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5db2f30
--- trap 0xc, rip = 0x1cc206df4d9a, rsp = 0x7fffff2140c8, rbp = 0x7fffff2140e0 ---

Tracing command soaiod4 pid 2206 tid 100119 td 0xfffffe009dbb6ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe009d96cd70
mi_switch() at mi_switch+0x157/frame 0xfffffe009d96cd90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d96cdd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe009d96ce10
_sleep() at _sleep+0x2ce/frame 0xfffffe009d96ceb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe009d96cef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d96cf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d96cf30
--- trap 0xc, rip = 0x52cb8703d9a, rsp = 0x7fffff603848, rbp = 0x7fffff603860 ---

Tracing command atf-sh pid 362 tid 101241 td 0xfffffe00ab735e40 (CPU 1)
cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00097cde00
ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00097cde10
trap() at trap+0x56/frame 0xfffffe00097cdf20
nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00097cdf20
--- trap 0x13, rip = 0x25d767d8583f, rsp = 0x7fffff5c5e30, rbp = 0x7fffff5c5e50 ---

Tracing command devd pid 473 tid 100106 td 0xfffffe00773b7900
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5da3a60
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5da3a80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5da3ac0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00a5da3b10
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00a5da3b50
_cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe00a5da3bd0
kern_select() at kern_select+0xa6f/frame 0xfffffe00a5da3dc0
sys_select() at sys_select+0x56/frame 0xfffffe00a5da3e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00a5da3f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00a5da3f30
--- syscall (93, FreeBSD ELF64, sys_select), rip = 0x28b2ba, rsp = 0x7ffffff379e8, rbp = 0x7ffffff39b80 ---

Tracing command auditd pid 673 tid 100114 td 0xfffffe009db47ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe00771e1b50
mi_switch() at mi_switch+0x157/frame 0xfffffe00771e1b70
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00771e1bb0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00771e1c00
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00771e1c10
_sleep() at _sleep+0x2dd/frame 0xfffffe00771e1cb0
audit_read() at audit_read+0x9c/frame 0xfffffe00771e1ce0
devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe00771e1d40
dofileread() at dofileread+0x81/frame 0xfffffe00771e1d90
sys_read() at sys_read+0xc0/frame 0xfffffe00771e1e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00771e1f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00771e1f30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x27f0ea2b15a, rsp = 0x7ffffff5a028, rbp = 0x7ffffff5a070 ---

Tracing command sh pid 725 tid 100090 td 0xfffffe00773acc80
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b86a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b86a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b86a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b86ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b86ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b86b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b86c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b86e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b86f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b86f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x1060c9ba133a, rsp = 0x7fffff99a338, rbp = 0x7fffff99a3f0 ---

Tracing command sh pid 738 tid 100087 td 0xfffffe00773ae1e0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b95a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b95a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b95a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b95ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b95ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b95b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b95c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b95e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b95f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b95f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x216d6c5d33a, rsp = 0x7fffffeb5b58, rbp = 0x7fffffeb5c10 ---

Tracing command sh pid 745 tid 100091 td 0xfffffe00773ac560
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b81a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b81a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b81a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b81ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b81ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b81b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b81c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b81e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b81f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b81f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x1e3e6afa233a, rsp = 0x7ffffff6ccd8, rbp = 0x7ffffff6cd90 ---

Tracing command kyua pid 746 tid 100099 td 0xfffffe000998a900
sched_switch() at sched_switch+0x559/frame 0xfffffe0063a74a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063a74a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063a74a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063a74ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063a74ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063a74b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063a74c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063a74e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063a74f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063a74f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x212dc38e633a, rsp = 0x7fffff47e748, rbp = 0x7fffff47e780 ---

Tracing command KTLS pid 47869 tid 100158 td 0xfffffe00a6a31e40
sched_switch() at sched_switch+0x559/frame 0xfffffe009d985d00
mi_switch() at mi_switch+0x157/frame 0xfffffe009d985d20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d985d60
_sleep() at _sleep+0x2e7/frame 0xfffffe009d985e00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe009d985ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d985f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d985f30
--- trap 0xc, rip = 0x3b1795b20d9a, rsp = 0x7fffff765918, rbp = 0x7fffff765930 ---

Tracing command KTLS pid 47869 tid 100833 td 0xfffffe00a6a243a0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6c3bd00
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6c3bd20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6c3bd60
_sleep() at _sleep+0x2e7/frame 0xfffffe00a6c3be00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00a6c3bef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6c3bf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6c3bf30
--- trap 0xc401a501, rip = 0x1d212dc401a581, rsp = 0x1d212dc401a601, rbp = 0x1d212dc401a481 ---

Tracing command KTLS pid 47869 tid 100834 td 0xfffffe00a6a423a0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6c36d40
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6c36d60
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6c36da0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a6c36e40
ktls_alloc_thread() at ktls_alloc_thread+0x204/frame 0xfffffe00a6c36ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6c36f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6c36f30
--- trap 0xffab3610, rip = 0x2a9b204a5008, rsp = 0x7fffffab3818, rbp = 0x7fffffab3610 ---

Tracing command ng_queue pid 52799 tid 100157 td 0xfffffe00a6a32560
sched_switch() at sched_switch+0x559/frame 0xfffffe009d98ad80
mi_switch() at mi_switch+0x157/frame 0xfffffe009d98ada0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d98ade0
_sleep() at _sleep+0x2e7/frame 0xfffffe009d98ae80
ngthread() at ngthread+0x88/frame 0xfffffe009d98aef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d98af30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d98af30
--- trap 0xc, rip = 0x2c6aeead4d9a, rsp = 0x7fffffedfcb8, rbp = 0x7fffffedfdb0 ---

Tracing command ng_queue pid 52799 tid 100865 td 0xfffffe00a6a43900
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6c2cd80
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6c2cda0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6c2cde0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a6c2ce80
ngthread() at ngthread+0x88/frame 0xfffffe00a6c2cef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6c2cf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6c2cf30
--- trap 0xc, rip = 0x745f1768d9a, rsp = 0x202f48, rbp = 0x202f60 ---

Tracing command g_mp_kt pid 44885 tid 100096 td 0xfffffe00773b5560
sched_switch() at sched_switch+0x559/frame 0xfffffe0063bd1da0
mi_switch() at mi_switch+0x157/frame 0xfffffe0063bd1dc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063bd1e00
_sleep() at _sleep+0x2e7/frame 0xfffffe0063bd1ea0
g_multipath_kt() at g_multipath_kt+0x275/frame 0xfffffe0063bd1ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063bd1f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063bd1f30
--- trap 0xc, rip = 0x1f5c30595d9a, rsp = 0x7fffffd5ecf8, rbp = 0x7fffffd5ed10 ---
db:0:kdb.enter.panic> dump
Dumping 467 out of 4060 MB:..4%..11%..21%..31%..42%..52%..62%..72%..83%..93%
Dump complete
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-19897' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run.sh
x ./disable-dtrace-tests.sh
x ./auto-shutdown
x ./disable-zfs-tests.sh
x ./run-kyua.sh
x ./disable-notyet-tests.sh
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins8693952127417509397.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '0229172a65765392f566ae1cdc730615ab504e15', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../0229172a65765392f566ae1cdc730615ab504e15/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address