FreeBSD-main-amd64-test - Build #19823 - Still Failing

FreeBSD-main-amd64-test - Build #19823 (06a8ffd4cd5453671e4c81e0875e544f1d58822c) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19823/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19823/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19823/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

406feaa862d702d17ac3e8df096cfe22cdb7091a by gnn:
Initial clean up the language in the manual pages.

409d1bf7d6deef77ccf685e1624589997247a267 by gnn:
Address review comments from 0mp, debdrup and oshogbo

06a8ffd4cd5453671e4c81e0875e544f1d58822c by gnn:
Fix two more nits from 0mp



The end of the build log:

[...truncated 4.00 MB...]
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5d94b70
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5d94bb0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00a5d94c00
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00a5d94c10
_sleep() at _sleep+0x2dd/frame 0xfffffe00a5d94cb0
audit_read() at audit_read+0x9c/frame 0xfffffe00a5d94ce0
devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe00a5d94d40
dofileread() at dofileread+0x81/frame 0xfffffe00a5d94d90
sys_read() at sys_read+0xc0/frame 0xfffffe00a5d94e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00a5d94f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00a5d94f30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011d015a, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 ---

Tracing command kyua pid 45759 tid 100111 td 0xfffffe007919e900 (CPU 1)
cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00097cbe00
ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00097cbe10
trap() at trap+0x56/frame 0xfffffe00097cbf20
nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00097cbf20
--- trap 0x13, rip = 0xffffffff80c14c38, rsp = 0xfffffe0063ba7710, rbp = 0xfffffe0063ba7710 ---
__rw_assert() at __rw_assert+0x18/frame 0xfffffe0063ba7710
vm_page_insert_radixdone() at vm_page_insert_radixdone+0x2d/frame 0xfffffe0063ba7740
vm_page_rename() at vm_page_rename+0x9a/frame 0xfffffe0063ba7780
vm_object_collapse() at vm_object_collapse+0x4d3/frame 0xfffffe0063ba7800
vm_object_deallocate() at vm_object_deallocate+0x312/frame 0xfffffe0063ba7830
vm_map_process_deferred() at vm_map_process_deferred+0xa9/frame 0xfffffe0063ba7850
vm_map_remove() at vm_map_remove+0xc9/frame 0xfffffe0063ba7880
exec_new_vmspace() at exec_new_vmspace+0x219/frame 0xfffffe0063ba78f0
exec_elf64_imgact() at exec_elf64_imgact+0x8a7/frame 0xfffffe0063ba79f0
kern_execve() at kern_execve+0x70d/frame 0xfffffe0063ba7d80
sys_execve() at sys_execve+0x5a/frame 0xfffffe0063ba7e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063ba7f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063ba7f30
--- syscall (59, FreeBSD ELF64, sys_execve), rip = 0x80151f41a, rsp = 0x7fffffffd7a8, rbp = 0x7fffffffd7b0 ---

Tracing command sh pid 725 tid 100090 td 0xfffffe007919d3a0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b57a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b57a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b57a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b57ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b57ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b57b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b57c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b57e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b57f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b57f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80120833a, rsp = 0x7fffffffcf58, rbp = 0x7fffffffd010 ---

Tracing command sh pid 738 tid 100094 td 0xfffffe007919b720
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b43a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b43a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b43a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b43ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b43ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b43b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b43c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b43e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b43f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b43f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80120833a, rsp = 0x7fffffffe7e8, rbp = 0x7fffffffe8a0 ---

Tracing command sh pid 745 tid 100104 td 0xfffffe00791c1020
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5d8fa10
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5d8fa30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5d8fa70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00a5d8fac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00a5d8fad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00a5d8fb70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00a5d8fc00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00a5d8fe00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00a5d8ff30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00a5d8ff30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80120833a, rsp = 0x7fffffffe7e8, rbp = 0x7fffffffe8a0 ---

Tracing command kyua pid 746 tid 100087 td 0xfffffe006a440560
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b66a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b66a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b66a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b66ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b66ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b66b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b66c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b66e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b66f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b66f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80152233a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdc70 ---

Tracing command ng_queue pid 97304 tid 100106 td 0xfffffe00791c01e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5d85d80
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5d85da0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5d85de0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a5d85e80
ngthread() at ngthread+0x88/frame 0xfffffe00a5d85ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5d85f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5d85f30
--- trap 0xc, rip = 0x801207d9a, rsp = 0x7fffffffe868, rbp = 0x7fffffffe960 ---

Tracing command ng_queue pid 97304 tid 100943 td 0xfffffe00a6ac5000
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6d80d80
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6d80da0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6d80de0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a6d80e80
ngthread() at ngthread+0x88/frame 0xfffffe00a6d80ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6d80f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6d80f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command g_mp_kt pid 89432 tid 100171 td 0xfffffe00a6a58020
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5dc1da0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5dc1dc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5dc1e00
_sleep() at _sleep+0x2e7/frame 0xfffffe00a5dc1ea0
g_multipath_kt() at g_multipath_kt+0x275/frame 0xfffffe00a5dc1ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5dc1f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5dc1f30
--- trap 0xc, rip = 0x8011a7d9a, rsp = 0x7fffffffeae8, rbp = 0x7fffffffeb00 ---

Tracing command aiod3 pid 46714 tid 100168 td 0xfffffe00a6a58740
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5dc6d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5dc6d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5dc6dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a5dc6e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00a5dc6ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00a5dc6ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5dc6f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5dc6f30
--- trap 0xc, rip = 0x8011a4d9a, rsp = 0x7fffffffe8d8, rbp = 0x7fffffffe8f0 ---

Tracing command aiod8 pid 46719 tid 100145 td 0xfffffe00a6a203a0
sched_switch() at sched_switch+0x559/frame 0xfffffe009d94ed60
mi_switch() at mi_switch+0x157/frame 0xfffffe009d94ed80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d94edc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe009d94ee00
_sleep() at _sleep+0x2ce/frame 0xfffffe009d94eea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe009d94eef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d94ef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d94ef30
--- trap 0xc, rip = 0x8011a5d9a, rsp = 0x7fffffffea28, rbp = 0x7fffffffea40 ---

Tracing command aiod17 pid 46728 tid 100208 td 0xfffffe00a6aa8e40
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6cb3d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6cb3d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6cb3dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a6cb3e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00a6cb3ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00a6cb3ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6cb3f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6cb3f30
--- trap 0xc, rip = 0x801207d9a, rsp = 0x7fffffffe8d8, rbp = 0x7fffffffe9d0 ---

Tracing command aiod18 pid 46729 tid 100110 td 0xfffffe007919f020
sched_switch() at sched_switch+0x559/frame 0xfffffe0063bacd60
mi_switch() at mi_switch+0x157/frame 0xfffffe0063bacd80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063bacdc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0063bace00
_sleep() at _sleep+0x2ce/frame 0xfffffe0063bacea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe0063bacef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063bacf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063bacf30
--- trap 0xc, rip = 0x8011a637a, rsp = 0x7fffffffe548, rbp = 0x7fffffffe9f0 ---

Tracing command soaiod1 pid 46750 tid 100165 td 0xfffffe00a6a45020
sched_switch() at sched_switch+0x559/frame 0xfffffe009d999d70
mi_switch() at mi_switch+0x157/frame 0xfffffe009d999d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d999dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe009d999e10
_sleep() at _sleep+0x2ce/frame 0xfffffe009d999eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe009d999ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d999f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d999f30
--- trap 0xc, rip = 0x8011edd9a, rsp = 0x7fffffffd528, rbp = 0x7fffffffd540 ---

Tracing command soaiod2 pid 46751 tid 100182 td 0xfffffe00a6a69720
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6c09d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6c09d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6c09dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a6c09e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a6c09eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a6c09ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6c09f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6c09f30
--- trap 0xc, rip = 0x8011edd9a, rsp = 0x7fffffffd528, rbp = 0x7fffffffd540 ---

Tracing command soaiod3 pid 46752 tid 100167 td 0xfffffe00a6a441e0
sched_switch() at sched_switch+0x559/frame 0xfffffe009d98fd70
mi_switch() at mi_switch+0x157/frame 0xfffffe009d98fd90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d98fdd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe009d98fe10
_sleep() at _sleep+0x2ce/frame 0xfffffe009d98feb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe009d98fef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d98ff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d98ff30
--- trap 0xc, rip = 0x8011edd9a, rsp = 0x7fffffffd538, rbp = 0x7fffffffd550 ---

Tracing command soaiod4 pid 46753 tid 100213 td 0xfffffe00a6a8c560
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6c31d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6c31d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6c31dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a6c31e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a6c31eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a6c31ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6c31f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6c31f30
--- trap 0xc, rip = 0x8011edd9a, rsp = 0x7fffffffd528, rbp = 0x7fffffffd540 ---
db:0:kdb.enter.panic> dump
Dumping 457 out of 4058 MB:..4%..11%..21%..32%..42%..53%..63%..74%..81%..91%
Dump complete
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-19823' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-notyet-tests.sh
x ./run.sh
x ./auto-shutdown
x ./disable-dtrace-tests.sh
x ./disable-zfs-tests.sh
x ./run-kyua.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins4365400974225842808.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '06a8ffd4cd5453671e4c81e0875e544f1d58822c', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../06a8ffd4cd5453671e4c81e0875e544f1d58822c/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address