FreeBSD-main-amd64-test - Build #20007 - Still Failing

From: <jenkins-admin_at_FreeBSD.org>
Date: Mon, 06 Dec 2021 08:02:47 UTC
FreeBSD-main-amd64-test - Build #20007 (2283206935b83a2a40d8322d9283af194b4ba5d6) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20007/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20007/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20007/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

2283206935b83a2a40d8322d9283af194b4ba5d6 by imp:
cam-iosched: Publish parameters of the latency buckets



The end of the build log:

[...truncated 4.25 MB...]
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00a6f33b60
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00a6f33b70
_cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe00a6f33bd0
kern_select() at kern_select+0xa95/frame 0xfffffe00a6f33dc0
sys_select() at sys_select+0x56/frame 0xfffffe00a6f33e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00a6f33f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00a6f33f30
--- syscall (93, FreeBSD ELF64, sys_select), rip = 0x46c8c074da, rsp = 0x7fffff5da188, rbp = 0x7fffff5db020 ---

Tracing command auditd pid 679 tid 100105 td 0xfffffe00767b6900
sched_switch() at sched_switch+0x559/frame 0xfffffe00765e9b50
mi_switch() at mi_switch+0x157/frame 0xfffffe00765e9b70
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00765e9bb0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00765e9c00
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00765e9c10
_sleep() at _sleep+0x2dd/frame 0xfffffe00765e9cb0
audit_read() at audit_read+0x9c/frame 0xfffffe00765e9ce0
devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe00765e9d40
dofileread() at dofileread+0x81/frame 0xfffffe00765e9d90
sys_read() at sys_read+0xc0/frame 0xfffffe00765e9e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00765e9f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00765e9f30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x19e7fa8ef45a, rsp = 0x7fffff0e7a48, rbp = 0x7fffff0e7a90 ---

Tracing command ping pid 58024 tid 102447 td 0xfffffe00a7c83e40
sched_switch() at sched_switch+0x559/frame 0xfffffe00af929a20
mi_switch() at mi_switch+0x157/frame 0xfffffe00af929a40
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00af929a80
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00af929ad0
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00af929b10
_cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe00af929b90
kern_select() at kern_select+0xa6f/frame 0xfffffe00af929d80
sys_pselect() at sys_pselect+0x127/frame 0xfffffe00af929e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00af929f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00af929f30
--- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0xa384829241a, rsp = 0x7fffffa98e28, rbp = 0x7fffffaa9270 ---

Tracing command ping pid 58028 tid 102705 td 0xfffffe00af2bf1e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00afdb6ab0
mi_switch() at mi_switch+0x157/frame 0xfffffe00afdb6ad0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00afdb6b10
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00afdb6b60
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00afdb6b70
_cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe00afdb6bd0
kern_select() at kern_select+0xa95/frame 0xfffffe00afdb6dc0
sys_select() at sys_select+0x56/frame 0xfffffe00afdb6e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00afdb6f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00afdb6f30
--- syscall (93, FreeBSD ELF64, sys_select), rip = 0xa38482924da, rsp = 0x7fffffa98b58, rbp = 0x7fffffa98c10 ---

Tracing command sh pid 58036 tid 102201 td 0xfffffe00a6ad2740
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6fcea10
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6fcea30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6fcea70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00a6fceac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00a6fcead0
_sleep() at _sleep+0x2dd/frame 0xfffffe00a6fceb70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00a6fcec00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00a6fcee00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00a6fcef30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00a6fcef30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2560335f263a, rsp = 0x7fffff661b08, rbp = 0x7fffff661bc0 ---

Tracing command timeout pid 58038 tid 102202 td 0xfffffe00a6ad2020
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6fc9ba0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6fc9bc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6fc9c00
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00a6fc9c50
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00a6fc9c60
_sleep() at _sleep+0x2dd/frame 0xfffffe00a6fc9d00
kern_sigsuspend() at kern_sigsuspend+0x1ec/frame 0xfffffe00a6fc9dd0
sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00a6fc9e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00a6fc9f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00a6fc9f30
--- syscall (4, FreeBSD ELF64, sys_write), rip = 0x3a52c1d7859a, rsp = 0x7fffff872cf8, rbp = 0x7fffff872f00 ---

Tracing command wc pid 58039 tid 102474 td 0xfffffe00a7cc8000
sched_switch() at sched_switch+0x559/frame 0xfffffe00af942b80
mi_switch() at mi_switch+0x157/frame 0xfffffe00af942ba0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00af942be0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00af942c30
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00af942c40
_sleep() at _sleep+0x2dd/frame 0xfffffe00af942ce0
pipe_read() at pipe_read+0x4b6/frame 0xfffffe00af942d40
dofileread() at dofileread+0x81/frame 0xfffffe00af942d90
sys_read() at sys_read+0xc0/frame 0xfffffe00af942e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00af942f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00af942f30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x17a46337245a, rsp = 0x7fffff5b7768, rbp = 0x7fffff5c78d0 ---

Tracing command nc pid 58040 tid 102480 td 0xfffffe00a7cdf720
sched_switch() at sched_switch+0x559/frame 0xfffffe00af9c4a90
mi_switch() at mi_switch+0x157/frame 0xfffffe00af9c4ab0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00af9c4af0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00af9c4b40
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00af9c4b80
_cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe00af9c4c00
kern_poll_kfds() at kern_poll_kfds+0x485/frame 0xfffffe00af9c4c90
kern_poll() at kern_poll+0x9f/frame 0xfffffe00af9c4de0
sys_poll() at sys_poll+0x50/frame 0xfffffe00af9c4e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00af9c4f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00af9c4f30
--- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x2aca6ced53da, rsp = 0x7ffffff81078, rbp = 0x7ffffff890e0 ---

Tracing command inetd pid 58041 tid 102172 td 0xfffffe00a6a4be40
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6f2eaa0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6f2eac0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6f2eb00
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00a6f2eb50
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00a6f2eb60
_sleep() at _sleep+0x2dd/frame 0xfffffe00a6f2ec00
sbwait() at sbwait+0x61/frame 0xfffffe00a6f2ec20
sosend_generic() at sosend_generic+0x3be/frame 0xfffffe00a6f2ece0
sosend() at sosend+0x50/frame 0xfffffe00a6f2ed10
soo_write() at soo_write+0x43/frame 0xfffffe00a6f2ed40
dofilewrite() at dofilewrite+0x81/frame 0xfffffe00a6f2ed90
sys_write() at sys_write+0xc0/frame 0xfffffe00a6f2ee00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00a6f2ef30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00a6f2ef30
--- syscall (4, FreeBSD ELF64, sys_write), rip = 0x46c8c0767a, rsp = 0x7fffff5d8168, rbp = 0x7fffff5da180 ---

Tracing command sh pid 731 tid 100089 td 0xfffffe00767b53a0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b8ba10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b8ba30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b8ba70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b8bac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b8bad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b8bb70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b8bc00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b8be00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b8bf30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b8bf30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x32b02473963a, rsp = 0x7fffff5b54d8, rbp = 0x7fffff5b5590 ---

Tracing command sh pid 744 tid 100092 td 0xfffffe00767b3e40
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b7ca10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b7ca30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b7ca70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b7cac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b7cad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b7cb70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b7cc00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b7ce00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b7cf30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b7cf30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x69db723a63a, rsp = 0x7ffffff2b658, rbp = 0x7ffffff2b710 ---

Tracing command sh pid 751 tid 100100 td 0xfffffe000998a900
sched_switch() at sched_switch+0x559/frame 0xfffffe0063a74a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063a74a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063a74a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063a74ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063a74ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063a74b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063a74c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063a74e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063a74f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063a74f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b117f88b63a, rsp = 0x7fffff33c008, rbp = 0x7fffff33c0c0 ---

Tracing command kyua pid 752 tid 100103 td 0xfffffe009db8b720
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5da8a10
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5da8a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5da8a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00a5da8ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00a5da8ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00a5da8b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00a5da8c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00a5da8e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00a5da8f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00a5da8f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x421fa77663a, rsp = 0x7fffffbfbb68, rbp = 0x7fffffbfbba0 ---

Tracing command KTLS pid 21747 tid 100114 td 0xfffffe009dbdaac0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5df8d00
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5df8d20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5df8d60
_sleep() at _sleep+0x2e7/frame 0xfffffe00a5df8e00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00a5df8ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5df8f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5df8f30
--- trap 0xc, rip = 0x1e370c19809a, rsp = 0x7fffff8c8d28, rbp = 0x7fffff8c8d40 ---

Tracing command KTLS pid 21747 tid 102113 td 0xfffffe00a6a4f020
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6c8bd00
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6c8bd20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6c8bd60
_sleep() at _sleep+0x2e7/frame 0xfffffe00a6c8be00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00a6c8bef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6c8bf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6c8bf30
--- trap 0x16, rip = 0x315d94c5709a, rsp = 0xa06a88, rbp = 0xa06aa0 ---

Tracing command KTLS pid 21747 tid 102114 td 0xfffffe00a6a78c80
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5db7d40
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5db7d60
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5db7da0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a5db7e40
ktls_alloc_thread() at ktls_alloc_thread+0x204/frame 0xfffffe00a5db7ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5db7f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5db7f30
--- trap 0xc, rip = 0x27ad0334b09a, rsp = 0x6232f48, rbp = 0x6232f60 ---
db:0:kdb.enter.panic> dump

Dump failed. Partition too small (about 2900MB were needed this time).
Cannot dump: unknown error (error=7).
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-20007' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-notyet-tests.sh
x ./run.sh
x ./auto-shutdown
x ./run-kyua.sh
x ./disable-dtrace-tests.sh
x ./disable-zfs-tests.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins3314300958268566901.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '2283206935b83a2a40d8322d9283af194b4ba5d6', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../2283206935b83a2a40d8322d9283af194b4ba5d6/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address