FreeBSD-main-amd64-test - Build #19854 - Still Failing

FreeBSD-main-amd64-test - Build #19854 (8502220db5085410dadd9b674b2f54df4815ac23) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19854/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19854/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19854/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

1f629966d683ca2e79adbc6c39e7ec5f1a87832f by imp:
ANSIify libsa functions

9f6c794ee2ed91f65b570176d3eb729777817bc4 by imp:
NanoBSD/rescue: Update to 20200214 OpenSSH configuration files

137692469769bb10625fb7dd29f867f93f05b641 by imp:
nanobsd: remove psuedo-terminals from ttys

872d50a5d8fca234823385c0a134cd0da0f4477a by imp:
nanobsd/rescue: Catch up to 20210907 OpenSSH import

9097ac9af4144187d080cf6c796c50d777e517b1 by imp:
Fix typo on "Celsius"

04912a8d1c15f9771545059032eedb9b0fea6e70 by imp:
release/packages/Makefile.package: Fix typo

a420a672bc53bd3928626aa5d0ec5b41c0471356 by imp:
Bootstrap: Prune building from pre-FreeBSD 11 support

9cb485d18f01900800efe4ec3cfcfadd335da858 by imp:
geom: Remove g_class.config

f7c32ed617858bcd22f8d1b03199099d50125721 by imp:
Fix 'take effect' spelling in menus and comments.

8587d752558ccdfa3e3a9aa95f3af50304a973dc by imp:
Correct the name of the second parameter of biowait to wmesg

8502220db5085410dadd9b674b2f54df4815ac23 by imp:
Revert "Bootstrap: Prune building from pre-FreeBSD 11 support"



The end of the build log:

[...truncated 3.98 MB...]
kern_execve() at kern_execve+0x45c/frame 0xfffffe009d9c9d80
sys_execve() at sys_execve+0x5a/frame 0xfffffe009d9c9e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe009d9c9f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe009d9c9f30
--- syscall (59, FreeBSD ELF64, sys_execve), rip = 0x12b27e47041a, rsp = 0x7ffffffde388, rbp = 0x7ffffffde390 ---

Tracing command devd pid 477 tid 100099 td 0xfffffe0009989020
sched_switch() at sched_switch+0x559/frame 0xfffffe0063a45a60
mi_switch() at mi_switch+0x157/frame 0xfffffe0063a45a80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063a45ac0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063a45b10
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0063a45b50
_cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe0063a45bd0
kern_select() at kern_select+0xa6f/frame 0xfffffe0063a45dc0
sys_select() at sys_select+0x56/frame 0xfffffe0063a45e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063a45f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063a45f30
--- syscall (93, FreeBSD ELF64, sys_select), rip = 0x28b2ba, rsp = 0x7fffff6f94b8, rbp = 0x7fffff6fb650 ---

Tracing command auditd pid 673 tid 100110 td 0xfffffe00775b71e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00773d9b50
mi_switch() at mi_switch+0x157/frame 0xfffffe00773d9b70
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00773d9bb0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00773d9c00
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00773d9c10
_sleep() at _sleep+0x2dd/frame 0xfffffe00773d9cb0
audit_read() at audit_read+0x9c/frame 0xfffffe00773d9ce0
devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe00773d9d40
dofileread() at dofileread+0x81/frame 0xfffffe00773d9d90
sys_read() at sys_read+0xc0/frame 0xfffffe00773d9e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00773d9f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00773d9f30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x38cf1255c15a, rsp = 0x7fffffca9f98, rbp = 0x7fffffca9fe0 ---

Tracing command sh pid 725 tid 100090 td 0xfffffe00775a1e40
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b48a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b48a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b48a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b48ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b48ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b48b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b48c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b48e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b48f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b48f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x17c6b4cb233a, rsp = 0x7fffff7405b8, rbp = 0x7fffff740670 ---

Tracing command sh pid 738 tid 100087 td 0xfffffe00775a33a0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b57a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b57a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b57a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b57ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b57ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b57b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b57c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b57e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b57f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b57f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x3d02beec033a, rsp = 0x7fffff7b45d8, rbp = 0x7fffff7b4690 ---

Tracing command sh pid 745 tid 100101 td 0xfffffe0009988900
sched_switch() at sched_switch+0x559/frame 0xfffffe0063a40a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063a40a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063a40a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063a40ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063a40ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063a40b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063a40c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063a40e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063a40f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063a40f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x128489c4e33a, rsp = 0x7fffffc06928, rbp = 0x7fffffc069e0 ---

Tracing command kyua pid 746 tid 100102 td 0xfffffe00099881e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00085ffa10
mi_switch() at mi_switch+0x157/frame 0xfffffe00085ffa30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00085ffa70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00085ffac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00085ffad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00085ffb70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00085ffc00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00085ffe00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00085fff30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00085fff30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x12b27e47333a, rsp = 0x7ffffffde818, rbp = 0x7ffffffde850 ---

Tracing command ng_queue pid 80717 tid 100122 td 0xfffffe009dbd83a0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5da7d80
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5da7da0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5da7de0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a5da7e80
ngthread() at ngthread+0x88/frame 0xfffffe00a5da7ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5da7f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5da7f30
--- trap 0xc, rip = 0x3e5dadfd6d9a, rsp = 0x7fffffc38b48, rbp = 0x7fffffc38c40 ---

Tracing command ng_queue pid 80717 tid 100952 td 0xfffffe00a6b6dc80
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6dfdd80
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6dfdda0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6dfdde0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a6dfde80
ngthread() at ngthread+0x88/frame 0xfffffe00a6dfdef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6dfdf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6dfdf30
--- trap 0xc, rip = 0x385ece1b4d9a, rsp = 0x202f48, rbp = 0x202f60 ---

Tracing command g_mp_kt pid 72863 tid 100209 td 0xfffffe00a6a6a560
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6c36da0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6c36dc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6c36e00
_sleep() at _sleep+0x2e7/frame 0xfffffe00a6c36ea0
g_multipath_kt() at g_multipath_kt+0x275/frame 0xfffffe00a6c36ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6c36f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6c36f30
--- trap 0xc, rip = 0x38b4f2622d9a, rsp = 0x7fffff1bb3c8, rbp = 0x7fffff1bb4c0 ---

Tracing command aiod22 pid 30164 tid 100109 td 0xfffffe00775b7900
sched_switch() at sched_switch+0x559/frame 0xfffffe00773ded60
mi_switch() at mi_switch+0x157/frame 0xfffffe00773ded80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00773dedc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00773dee00
_sleep() at _sleep+0x2ce/frame 0xfffffe00773deea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00773deef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00773def30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00773def30
--- trap 0xc, rip = 0x21ba2270ed9a, rsp = 0x7fffff1362f8, rbp = 0x7fffff136310 ---

Tracing command aiod24 pid 30166 tid 100088 td 0xfffffe00775a2c80
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b52d60
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b52d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b52dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0063b52e00
_sleep() at _sleep+0x2ce/frame 0xfffffe0063b52ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe0063b52ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063b52f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063b52f30
--- trap 0xc, rip = 0x1d4bc83b837a, rsp = 0x7fffffb07e08, rbp = 0x7fffffb082b0 ---

Tracing command aiod27 pid 30169 tid 100129 td 0xfffffe009dbfc560
sched_switch() at sched_switch+0x559/frame 0xfffffe0063bd5d60
mi_switch() at mi_switch+0x157/frame 0xfffffe0063bd5d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063bd5dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0063bd5e00
_sleep() at _sleep+0x2ce/frame 0xfffffe0063bd5ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe0063bd5ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063bd5f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063bd5f30
--- trap 0xc, rip = 0x2c0cb8b49d9a, rsp = 0x7fffff8ef0c8, rbp = 0x7fffff8ef1c0 ---

Tracing command aiod30 pid 30172 tid 100095 td 0xfffffe00775b4e40
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b9dd60
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b9dd80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b9ddc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0063b9de00
_sleep() at _sleep+0x2ce/frame 0xfffffe0063b9dea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe0063b9def0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063b9df30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063b9df30
--- trap 0xc, rip = 0x596f5d3bd9a, rsp = 0x7fffff0e9868, rbp = 0x7fffff0e9960 ---

Tracing command soaiod1 pid 30181 tid 100104 td 0xfffffe00775a4900
sched_switch() at sched_switch+0x559/frame 0xfffffe00773f7d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00773f7d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00773f7dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00773f7e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00773f7eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00773f7ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00773f7f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00773f7f30
--- trap 0xc, rip = 0x35833f6aad9a, rsp = 0x7fffff1bf4a8, rbp = 0x7fffff1bf4c0 ---

Tracing command soaiod2 pid 30182 tid 100185 td 0xfffffe00a6a63c80
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6c7cd70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6c7cd90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6c7cdd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a6c7ce10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a6c7ceb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a6c7cef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6c7cf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6c7cf30
--- trap 0xc, rip = 0xeb06e3e5d9a, rsp = 0x7fffffe6ded8, rbp = 0x7fffffe6def0 ---

Tracing command soaiod3 pid 30183 tid 100094 td 0xfffffe00775b5560
sched_switch() at sched_switch+0x559/frame 0xfffffe0063ba2d70
mi_switch() at mi_switch+0x157/frame 0xfffffe0063ba2d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063ba2dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0063ba2e10
_sleep() at _sleep+0x2ce/frame 0xfffffe0063ba2eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe0063ba2ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063ba2f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063ba2f30
--- trap 0xc, rip = 0xa3013820d9a, rsp = 0x7fffff8eb2d8, rbp = 0x7fffff8eb2f0 ---

Tracing command soaiod4 pid 30184 tid 100186 td 0xfffffe00a6a63560
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6c77d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6c77d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6c77dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a6c77e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a6c77eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a6c77ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6c77f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6c77f30
--- trap 0xc, rip = 0xa3235f58d9a, rsp = 0x7fffffb83b68, rbp = 0x7fffffb83b80 ---
db:0:kdb.enter.panic> dump
Dumping 486 out of 4058 MB:..4%..14%..24%..33%..43%..53%..63%..73%..83%..93%
Dump complete
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-19854' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./auto-shutdown
x ./disable-zfs-tests.sh
x ./disable-dtrace-tests.sh
x ./run.sh
x ./disable-notyet-tests.sh
x ./run-kyua.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins2899213655873345256.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '8502220db5085410dadd9b674b2f54df4815ac23', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../8502220db5085410dadd9b674b2f54df4815ac23/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address