FreeBSD-main-amd64-test - Build #19873 - Failure

Reply: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #19874 - Still Failing"
In reply to: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #19872 - Still Unstable"
Go to: [ bottom of page ] [ top of archives ] [ this month ]
From: <jenkins-admin_at_FreeBSD.org>
Date: Mon, 22 Nov 2021 19:46:40 UTC
FreeBSD-main-amd64-test - Build #19873 (a11983366ea72165809837a667d58e2ad440c496) - Failure

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19873/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19873/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19873/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

a11983366ea72165809837a667d58e2ad440c496 by markj:
pchtherm: Let the driver be compiled into the kernel



The end of the build log:

[...truncated 4.25 MB...]
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9ddf30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 22685 tid 100155 td 0xfffffe00a77a2720
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9d8cc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9d8ce0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9d8d20
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe009d9d8d70
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe009d9d8d80
_cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe009d9d8de0
zfs_zevent_wait() at zfs_zevent_wait+0x47/frame 0xfffffe009d9d8e00
sysevent_worker() at sysevent_worker+0x49/frame 0xfffffe009d9d8ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9d8f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9d8f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command aiod1 pid 22693 tid 100117 td 0xfffffe009dbb1c80
sched_switch() at sched_switch+0x559/frame 0xfffffe0063bcfd60
mi_switch() at mi_switch+0x157/frame 0xfffffe0063bcfd80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063bcfdc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0063bcfe00
_sleep() at _sleep+0x2ce/frame 0xfffffe0063bcfea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe0063bcfef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063bcff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063bcff30
--- trap 0xc, rip = 0x740b9e57d9a, rsp = 0x7fffff1478e8, rbp = 0x7fffff147900 ---

Tracing command aiod4 pid 22696 tid 100116 td 0xfffffe009dbb23a0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063bd4d60
mi_switch() at mi_switch+0x157/frame 0xfffffe0063bd4d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063bd4dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0063bd4e00
_sleep() at _sleep+0x2ce/frame 0xfffffe0063bd4ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe0063bd4ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063bd4f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063bd4f30
--- trap 0xc, rip = 0x2c14ea965d9a, rsp = 0x7fffffbc8648, rbp = 0x7fffffbc8660 ---

Tracing command g_mp_kt pid 28847 tid 101283 td 0xfffffe00a89fe560
sched_switch() at sched_switch+0x559/frame 0xfffffe00a8cd6da0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a8cd6dc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a8cd6e00
_sleep() at _sleep+0x2e7/frame 0xfffffe00a8cd6ea0
g_multipath_kt() at g_multipath_kt+0x275/frame 0xfffffe00a8cd6ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a8cd6f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a8cd6f30
--- trap 0xc, rip = 0x1429ac8eed9a, rsp = 0x7fffffcbb568, rbp = 0x7fffffcbb660 ---

Tracing command devd pid 473 tid 100105 td 0xfffffe00775ad020
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b93a60
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b93a80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b93ac0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b93b10
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0063b93b50
_cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe0063b93bd0
kern_select() at kern_select+0xa6f/frame 0xfffffe0063b93dc0
sys_select() at sys_select+0x56/frame 0xfffffe0063b93e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b93f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b93f30
--- syscall (93, FreeBSD ELF64, sys_select), rip = 0x28b2ba, rsp = 0x7fffff99e9b8, rbp = 0x7fffff9a0b50 ---

Tracing command auditd pid 673 tid 100097 td 0xfffffe00775b2e40
sched_switch() at sched_switch+0x559/frame 0xfffffe0063ba7b50
mi_switch() at mi_switch+0x157/frame 0xfffffe0063ba7b70
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063ba7bb0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063ba7c00
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063ba7c10
_sleep() at _sleep+0x2dd/frame 0xfffffe0063ba7cb0
audit_read() at audit_read+0x9c/frame 0xfffffe0063ba7ce0
devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0063ba7d40
dofileread() at dofileread+0x81/frame 0xfffffe0063ba7d90
sys_read() at sys_read+0xc0/frame 0xfffffe0063ba7e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063ba7f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063ba7f30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x1a3d0e23a15a, rsp = 0x7fffffb4a728, rbp = 0x7fffffb4a770 ---

Tracing command sh pid 725 tid 100090 td 0xfffffe00775aac80
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b57a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b57a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b57a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b57ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b57ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b57b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b57c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b57e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b57f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b57f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0xa9ee27ea33a, rsp = 0x7fffff601bc8, rbp = 0x7fffff601c80 ---

Tracing command sh pid 738 tid 100104 td 0xfffffe009db75000
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5dcaa10
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5dcaa30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5dcaa70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00a5dcaac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00a5dcaad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00a5dcab70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00a5dcac00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00a5dcae00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00a5dcaf30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00a5dcaf30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0xe183dc9f33a, rsp = 0x7fffff5d75f8, rbp = 0x7fffff5d76b0 ---

Tracing command sh pid 745 tid 100093 td 0xfffffe00775a9720
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b48a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b48a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b48a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b48ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b48ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b48b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b48c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b48e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b48f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b48f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2ce61501133a, rsp = 0x7fffff165a98, rbp = 0x7fffff165b50 ---

Tracing command kyua pid 746 tid 100112 td 0xfffffe009db76c80
sched_switch() at sched_switch+0x559/frame 0xfffffe00773e6a10
mi_switch() at mi_switch+0x157/frame 0xfffffe00773e6a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00773e6a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00773e6ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00773e6ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00773e6b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00773e6c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00773e6e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00773e6f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00773e6f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x1ec332b4e33a, rsp = 0x7fffffaa5d78, rbp = 0x7fffffaa5db0 ---

Tracing command md0 pid 23593 tid 100089 td 0xfffffe00775ab3a0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b5cda0
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b5cdc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b5ce00
_sleep() at _sleep+0x2e7/frame 0xfffffe0063b5cea0
md_kthread() at md_kthread+0xd5/frame 0xfffffe0063b5cef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063b5cf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063b5cf30
--- trap 0xc, rip = 0xa359a5fd9a, rsp = 0x7fffff7571a8, rbp = 0x7fffff7572a0 ---

Tracing command kyua pid 85050 tid 101331 td 0xfffffe00a8a2a020 (CPU 1)
cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00097cbe00
ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00097cbe10
trap() at trap+0x56/frame 0xfffffe00097cbf20
nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00097cbf20
--- trap 0x13, rip = 0xffffffff80c14537, rsp = 0xfffffe00a5df2710, rbp = 0xfffffe00a5df2740 ---
_rw_wlock_cookie() at _rw_wlock_cookie+0x47/frame 0xfffffe00a5df2740
pmap_remove_pages() at pmap_remove_pages+0x620/frame 0xfffffe00a5df2890
exec_new_vmspace() at exec_new_vmspace+0x209/frame 0xfffffe00a5df2900
exec_elf64_imgact() at exec_elf64_imgact+0x877/frame 0xfffffe00a5df29f0
kern_execve() at kern_execve+0x70d/frame 0xfffffe00a5df2d80
sys_execve() at sys_execve+0x5a/frame 0xfffffe00a5df2e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00a5df2f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00a5df2f30
--- syscall (59, FreeBSD ELF64, sys_execve), rip = 0x1ec332b4b41a, rsp = 0x7fffffaa58e8, rbp = 0x7fffffaa58f0 ---

Tracing command KTLS pid 31829 tid 100103 td 0xfffffe009db75720
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5dcfd00
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5dcfd20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5dcfd60
_sleep() at _sleep+0x2e7/frame 0xfffffe00a5dcfe00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00a5dcfef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5dcff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5dcff30
--- trap 0xc, rip = 0x3b512cbcfd9a, rsp = 0x7fffff62f368, rbp = 0x7fffff62f380 ---

Tracing command KTLS pid 31829 tid 102182 td 0xfffffe00a8a341e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a8c4fd00
mi_switch() at mi_switch+0x157/frame 0xfffffe00a8c4fd20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a8c4fd60
_sleep() at _sleep+0x2e7/frame 0xfffffe00a8c4fe00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00a8c4fef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a8c4ff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a8c4ff30
--- trap 0xc, rip = 0x29416c57719a, rsp = 0x102ea8, rbp = 0x102ef0 ---

Tracing command KTLS pid 31829 tid 102183 td 0xfffffe00a8a61ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a8c40d40
mi_switch() at mi_switch+0x157/frame 0xfffffe00a8c40d60
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a8c40da0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a8c40e40
ktls_alloc_thread() at ktls_alloc_thread+0x204/frame 0xfffffe00a8c40ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a8c40f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a8c40f30
--- trap 0xc, rip = 0x5abddeefd9a, rsp = 0x604a88, rbp = 0x604aa0 ---

Tracing command ng_queue pid 36759 tid 101235 td 0xfffffe00a77e2560
sched_switch() at sched_switch+0x559/frame 0xfffffe00a8d4ed80
mi_switch() at mi_switch+0x157/frame 0xfffffe00a8d4eda0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a8d4ede0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a8d4ee80
ngthread() at ngthread+0x88/frame 0xfffffe00a8d4eef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a8d4ef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a8d4ef30
--- trap 0xc, rip = 0x285e0b743d9a, rsp = 0x7fffffafc568, rbp = 0x7fffffafc580 ---

Tracing command ng_queue pid 36759 tid 102214 td 0xfffffe00a8a31e40
sched_switch() at sched_switch+0x559/frame 0xfffffe00a785ed80
mi_switch() at mi_switch+0x157/frame 0xfffffe00a785eda0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a785ede0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a785ee80
ngthread() at ngthread+0x88/frame 0xfffffe00a785eef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a785ef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a785ef30
--- trap 0x16, rip = 0x3ff881bb6d9a, rsp = 0x805a88, rbp = 0x805aa0 ---
db:0:kdb.enter.panic> dump
Dumping 506 out of 4058 MB:..4%..13%..23%..32%..42%..51%..61%..73%..83%..92%
Dump complete
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-19873' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-dtrace-tests.sh
x ./auto-shutdown
x ./run.sh
x ./disable-zfs-tests.sh
x ./disable-notyet-tests.sh
x ./run-kyua.sh
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins5870342765827575744.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'a11983366ea72165809837a667d58e2ad440c496', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../a11983366ea72165809837a667d58e2ad440c496/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address