FreeBSD-main-amd64-test - Build #20416 - Failure

FreeBSD-main-amd64-test - Build #20416 (6e8a2f04001735353e445570f0d83aa88d4b9b37) - Failure

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20416/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20416/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20416/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

da7fc5c33f9a4c906068a9a43f43f8d295100418 by jhb:
freebsd32: Fix layout of struct shmid_kernel32.

da92ecbc0d8f4652cd5c97aace290103055c7019 by dougm:
vm_phys: fix seg->end test in alloc_seg_contig

5719b5a1bb643d5622557afe78dca63a800d9b7c by ken:
Switch to using drive-supplied timeouts for the sa(4) driver.

bcff64c54a74268742f52d40d1eb2acd8ab6f07d by ken:
Clarify loader tunable usage when tape drives arrive after boot.

6e8a2f04001735353e445570f0d83aa88d4b9b37 by ken:
Update sa(4) comments and man page after review.



The end of the build log:

[...truncated 3.98 MB...]
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00cb1b4f30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x3a570d4306ba, rsp = 0x3a570ba1d218, rbp = 0x3a570ba1d260 ---

Tracing command g_mp_kt pid 45786 tid 100111 td 0xfffffe0097be43a0
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1afda0
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1afdc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1afe00
_sleep() at _sleep+0x2e7/frame 0xfffffe00cb1afea0
g_multipath_kt() at g_multipath_kt+0x275/frame 0xfffffe00cb1afef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cb1aff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cb1aff30
--- trap 0xc, rip = 0x355ba4d72da, rsp = 0x355b7aefe98, rbp = 0x355b7aefeb0 ---

Tracing command sh pid 732 tid 100091 td 0xfffffe0097be3c80
sched_switch() at sched_switch+0x559/frame 0xfffffe0084f4da10
mi_switch() at mi_switch+0x157/frame 0xfffffe0084f4da30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0084f4da70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0084f4dac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0084f4dad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0084f4db70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0084f4dc00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0084f4de00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe0084f4df30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0084f4df30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x3e7658c0c89a, rsp = 0x3e7655e29418, rbp = 0x3e7655e294d0 ---

Tracing command sh pid 745 tid 100093 td 0xfffffe0097be2e40
sched_switch() at sched_switch+0x559/frame 0xfffffe0084f43a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0084f43a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0084f43a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0084f43ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0084f43ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0084f43b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0084f43c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0084f43e00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe0084f43f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0084f43f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x23d9343ee89a, rsp = 0x23d93203a958, rbp = 0x23d93203aa10 ---

Tracing command sh pid 753 tid 100112 td 0xfffffe00cbd44020
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1aaa10
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1aaa30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1aaa70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00cb1aaac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00cb1aaad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00cb1aab70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00cb1aac00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00cb1aae00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe00cb1aaf30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00cb1aaf30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x98503acf89a, rsp = 0x985020e7f48, rbp = 0x985020e8000 ---

Tracing command kyua pid 754 tid 100113 td 0xfffffe00cbd43900
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1a5a10
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1a5a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1a5a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00cb1a5ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00cb1a5ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00cb1a5b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00cb1a5c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00cb1a5e00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe00cb1a5f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00cb1a5f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x11b1ea2589a, rsp = 0x11b19a54c58, rbp = 0x11b19a54c90 ---

Tracing command aiod2 pid 3056 tid 100123 td 0xfffffe00c2ff5560
sched_switch() at sched_switch+0x559/frame 0xfffffe009799fd60
mi_switch() at mi_switch+0x157/frame 0xfffffe009799fd80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009799fdc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe009799fe00
_sleep() at _sleep+0x2ce/frame 0xfffffe009799fea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe009799fef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009799ff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009799ff30
--- trap 0xc, rip = 0x9c1d85432da, rsp = 0x9c1d6eb39e8, rbp = 0x9c1d6eb3a00 ---

Tracing command aiod9 pid 3063 tid 100097 td 0xfffffe0097bdf020
sched_switch() at sched_switch+0x559/frame 0xfffffe0084f2fd60
mi_switch() at mi_switch+0x157/frame 0xfffffe0084f2fd80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0084f2fdc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0084f2fe00
_sleep() at _sleep+0x2ce/frame 0xfffffe0084f2fea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe0084f2fef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0084f2ff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0084f2ff30
--- trap 0xc, rip = 0x35197aa4d2da, rsp = 0x351979b8f318, rbp = 0x351979b8f410 ---

Tracing command aiod27 pid 3081 tid 100128 td 0xfffffe00cbe5c560
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1fcd60
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1fcd80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1fcdc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00cb1fce00
_sleep() at _sleep+0x2ce/frame 0xfffffe00cb1fcea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00cb1fcef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cb1fcf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cb1fcf30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command aiod28 pid 3082 tid 100129 td 0xfffffe00cbe5be40
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1f7d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1f7d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1f7dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00cb1f7e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00cb1f7ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00cb1f7ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cb1f7f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cb1f7f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command soaiod1 pid 3093 tid 100136 td 0xfffffe00c2ff71e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1d9d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1d9d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1d9dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00cb1d9e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00cb1d9eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00cb1d9ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cb1d9f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cb1d9f30
--- trap 0xc, rip = 0x3fd9229d02da, rsp = 0x3fd91ec01508, rbp = 0x3fd91ec01520 ---

Tracing command soaiod2 pid 3094 tid 100135 td 0xfffffe00c2ff7900
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1ded70
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1ded90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1dedd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00cb1dee10
_sleep() at _sleep+0x2ce/frame 0xfffffe00cb1deeb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00cb1deef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cb1def30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cb1def30
--- trap 0xc, rip = 0x35388ffd92da, rsp = 0x35388d524c18, rbp = 0x35388d524c30 ---

Tracing command soaiod3 pid 3095 tid 100134 td 0xfffffe00c2ff8020
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1e3d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1e3d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1e3dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00cb1e3e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00cb1e3eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00cb1e3ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cb1e3f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cb1e3f30
--- trap 0xc, rip = 0x2e8dd04862da, rsp = 0x2e8dcde946e8, rbp = 0x2e8dcde94700 ---

Tracing command soaiod4 pid 3096 tid 100133 td 0xfffffe00c2ff8740
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1e8d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1e8d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1e8dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00cb1e8e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00cb1e8eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00cb1e8ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cb1e8f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cb1e8f30
--- trap 0xc, rip = 0x2441100822da, rsp = 0x24410d73c6b8, rbp = 0x24410d73c6d0 ---

Tracing command posixshm_test pid 44132 tid 100967 td 0xfffffe00d1434c80 (CPU 1)
kdb_enter() at kdb_enter+0x37/frame 0xfffffe00c2dcc910
vpanic() at vpanic+0x1b0/frame 0xfffffe00c2dcc960
panic() at panic+0x43/frame 0xfffffe00c2dcc9c0
trap_fatal() at trap_fatal+0x385/frame 0xfffffe00c2dcca20
calltrap() at calltrap+0x8/frame 0xfffffe00c2dcca20
--- trap 0x9, rip = 0xffffffff80f884b2, rsp = 0xfffffe00c2dccaf0, rbp = 0xfffffe00c2dccb60 ---
vm_phys_alloc_contig() at vm_phys_alloc_contig+0x232/frame 0xfffffe00c2dccb60
vm_page_find_contig_domain() at vm_page_find_contig_domain+0xc4/frame 0xfffffe00c2dccbd0
vm_page_alloc_contig_domain() at vm_page_alloc_contig_domain+0x145/frame 0xfffffe00c2dccc60
vm_page_alloc_contig() at vm_page_alloc_contig+0x73/frame 0xfffffe00c2dcccf0
shm_dotruncate_cookie() at shm_dotruncate_cookie+0x195/frame 0xfffffe00c2dccd80
shm_truncate() at shm_truncate+0x5e/frame 0xfffffe00c2dccdc0
kern_ftruncate() at kern_ftruncate+0xb3/frame 0xfffffe00c2dcce00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe00c2dccf30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00c2dccf30
--- syscall (480, FreeBSD ELF64, sys_ftruncate), rip = 0x1e91654ab85a, rsp = 0x1e9162a70608, rbp = 0x1e9162a70620 ---

Tracing command KTLS pid 48770 tid 100141 td 0xfffffe00cbe5e1e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00979eacf0
mi_switch() at mi_switch+0x157/frame 0xfffffe00979ead10
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00979ead50
_sleep() at _sleep+0x2e7/frame 0xfffffe00979eadf0
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00979eaef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00979eaf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00979eaf30
--- trap 0xc, rip = 0x3409f55562da, rsp = 0x3409f32674f8, rbp = 0x3409f3267510 ---

Tracing command KTLS pid 48770 tid 100886 td 0xfffffe00cbe8a3a0
sched_switch() at sched_switch+0x559/frame 0xfffffe0084ffccf0
mi_switch() at mi_switch+0x157/frame 0xfffffe0084ffcd10
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0084ffcd50
_sleep() at _sleep+0x2e7/frame 0xfffffe0084ffcdf0
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe0084ffcef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0084ffcf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0084ffcf30
--- trap 0x16, rip = 0x3b8d8071f2da, rsp = 0x3b8d8b3e0a88, rbp = 0x3b8d8b3e0aa0 ---

Tracing command KTLS pid 48770 tid 100887 td 0xfffffe00cbe8c020
sched_switch() at sched_switch+0x559/frame 0xfffffe00cc013d40
mi_switch() at mi_switch+0x157/frame 0xfffffe00cc013d60
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cc013da0
_sleep() at _sleep+0x2e7/frame 0xfffffe00cc013e40
ktls_alloc_thread() at ktls_alloc_thread+0x204/frame 0xfffffe00cc013ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cc013f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cc013f30
--- trap 0x16, rip = 0x3b8d8071f2da, rsp = 0x3b8d8a153a88, rbp = 0x3b8d8a153aa0 ---
db:0:kdb.enter.panic> dump

Dump failed. Partition too small (about 1424MB were needed this time).
Cannot dump: unknown error (error=7).
db:0:kdb.enter.panic> reset
cpu_reset: Restarting BSP
cpu_reset_proxy: Stopped CPU 1
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-20416' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run-kyua.sh
x ./run.sh
x ./auto-shutdown
x ./disable-dtrace-tests.sh
x ./disable-zfs-tests.sh
x ./disable-notyet-tests.sh
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins7616599728228045434.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '6e8a2f04001735353e445570f0d83aa88d4b9b37', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../6e8a2f04001735353e445570f0d83aa88d4b9b37/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address