FreeBSD-main-amd64-test - Build #20437 - Failure

Reply: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #20438 - Still Failing"
In reply to: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #20436 - Still Unstable"
Go to: [ bottom of page ] [ top of archives ] [ this month ]
From: <jenkins-admin_at_FreeBSD.org>
Date: Fri, 21 Jan 2022 06:55:29 UTC
FreeBSD-main-amd64-test - Build #20437 (9ce46cbc95d7a6fccb55af0d42cbb85c29f10639) - Failure

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20437/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20437/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20437/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

58630bdd13fd086fe11f239528ee7a82e2b9d685 by wma:
Revert "ip_mroute: do not call epoch_waitwhen lock is taken"

9ce46cbc95d7a6fccb55af0d42cbb85c29f10639 by wma:
ip_mroute: move ip_mrouter_done outside lock



The end of the build log:

[...truncated 293.18 KB...]
Tracing command zfskern pid 24613 tid 100746 td 0xfffffe00cbe03020
sched_switch() at sched_switch+0x559/frame 0xfffffe00cc1adcc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00cc1adce0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cc1add20
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00cc1add70
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00cc1add80
_cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe00cc1adde0
zfs_zevent_wait() at zfs_zevent_wait+0x47/frame 0xfffffe00cc1ade00
sysevent_worker() at sysevent_worker+0x49/frame 0xfffffe00cc1adef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cc1adf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cc1adf30
--- trap 0xc, rip = 0x2b22aa3e32da, rsp = 0x2b2322234f48, rbp = 0x2b2322234f60 ---

Tracing command aiod1 pid 24620 tid 100100 td 0xfffffe00979dd3a0
sched_switch() at sched_switch+0x559/frame 0xfffffe00c2df6d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00c2df6d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00c2df6dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00c2df6e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00c2df6ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00c2df6ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00c2df6f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00c2df6f30
--- trap 0xc, rip = 0x1a3394482da, rsp = 0x1a337499558, rbp = 0x1a337499570 ---

Tracing command aiod2 pid 24621 tid 100111 td 0xfffffe00979e6ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1b4d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1b4d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1b4dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00cb1b4e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00cb1b4ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00cb1b4ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cb1b4f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cb1b4f30
--- trap 0xc, rip = 0x3e2fc64462da, rsp = 0x3e2fc4a86328, rbp = 0x3e2fc4a86340 ---

Tracing command aiod3 pid 24622 tid 100123 td 0xfffffe00c2fefc80
sched_switch() at sched_switch+0x559/frame 0xfffffe00977a3d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00977a3d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00977a3dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00977a3e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00977a3ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00977a3ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00977a3f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00977a3f30
--- trap 0xc, rip = 0x34edb20c22da, rsp = 0x34edae938138, rbp = 0x34edae938150 ---

Tracing command aiod4 pid 24623 tid 100110 td 0xfffffe00979e71e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1b9d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1b9d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1b9dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00cb1b9e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00cb1b9ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00cb1b9ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cb1b9f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cb1b9f30
--- trap 0xc, rip = 0x16be07fff2da, rsp = 0x16be02434c78, rbp = 0x16be02434c90 ---

Tracing command pf purge pid 108 tid 100092 td 0xfffffe00979e5560
sched_switch() at sched_switch+0x559/frame 0xfffffe0084f48d80
mi_switch() at mi_switch+0x157/frame 0xfffffe0084f48da0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0084f48de0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0084f48e20
_sleep() at _sleep+0x2ce/frame 0xfffffe0084f48ec0
pf_purge_thread() at pf_purge_thread+0xa2/frame 0xfffffe0084f48ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0084f48f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0084f48f30
--- trap 0xc, rip = 0x1a54c2e792da, rsp = 0x1a54c0931858, rbp = 0x1a54c0931870 ---

Tracing command sh pid 24838 tid 100113 td 0xfffffe00cbd44020
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1aaa10
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1aaa30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1aaa70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00cb1aaac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00cb1aaad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00cb1aab70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00cb1aac00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00cb1aae00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe00cb1aaf30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00cb1aaf30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x30fcddf0589a, rsp = 0x30fcda5bd3b8, rbp = 0x30fcda5bd470 ---

Tracing command atf-check pid 24851 tid 100427 td 0xfffffe00cbe25900
sched_switch() at sched_switch+0x559/frame 0xfffffe0084ff2a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0084ff2a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0084ff2a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0084ff2ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0084ff2ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0084ff2b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0084ff2c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0084ff2e00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe0084ff2f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0084ff2f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x1761ceb289a, rsp = 0x176190ac008, rbp = 0x176190ac040 ---

Tracing command ping pid 24852 tid 100114 td 0xfffffe00cbd43900 (CPU 0)
kdb_enter() at kdb_enter+0x37/frame 0xfffffe00cb1a5a10
vpanic() at vpanic+0x1b0/frame 0xfffffe00cb1a5a60
panic() at panic+0x43/frame 0xfffffe00cb1a5ac0
_epoch_enter_preempt() at _epoch_enter_preempt+0x204/frame 0xfffffe00cb1a5ae0
rip_detach() at rip_detach+0x41/frame 0xfffffe00cb1a5b40
sofree() at sofree+0x301/frame 0xfffffe00cb1a5b90
soclose() at soclose+0x280/frame 0xfffffe00cb1a5c00
_fdrop() at _fdrop+0x1b/frame 0xfffffe00cb1a5c20
closef() at closef+0x1db/frame 0xfffffe00cb1a5cb0
fdescfree() at fdescfree+0x453/frame 0xfffffe00cb1a5d80
exit1() at exit1+0x4ae/frame 0xfffffe00cb1a5df0
sys_exit() at sys_exit+0xd/frame 0xfffffe00cb1a5e00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe00cb1a5f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00cb1a5f30
--- syscall (1, FreeBSD ELF64, sys_exit), rip = 0xdf5d8b062da, rsp = 0xdf5d40c65f8, rbp = 0xdf5d40c6610 ---

Tracing command ping pid 24855 tid 100117 td 0xfffffe00cbd423a0
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb196ab0
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb196ad0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb196b10
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00cb196b60
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00cb196b70
_cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe00cb196bd0
kern_select() at kern_select+0xa95/frame 0xfffffe00cb196dc0
sys_select() at sys_select+0x56/frame 0xfffffe00cb196e00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe00cb196f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00cb196f30
--- syscall (93, FreeBSD ELF64, sys_select), rip = 0xdf5d8b0673a, rsp = 0xdf5d40c6368, rbp = 0xdf5d40c6420 ---

Tracing command devd pid 476 tid 100097 td 0xfffffe00979df020
sched_switch() at sched_switch+0x559/frame 0xfffffe0084f2fa60
mi_switch() at mi_switch+0x157/frame 0xfffffe0084f2fa80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0084f2fac0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0084f2fb10
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0084f2fb50
_cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe0084f2fbd0
kern_select() at kern_select+0xa6f/frame 0xfffffe0084f2fdc0
sys_select() at sys_select+0x56/frame 0xfffffe0084f2fe00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe0084f2ff30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0084f2ff30
--- syscall (93, FreeBSD ELF64, sys_select), rip = 0x28b22a, rsp = 0x820beaf68, rbp = 0x820bed100 ---

Tracing command auditd pid 676 tid 100103 td 0xfffffe00979dbe40
sched_switch() at sched_switch+0x559/frame 0xfffffe00c2de7b50
mi_switch() at mi_switch+0x157/frame 0xfffffe00c2de7b70
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00c2de7bb0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00c2de7c00
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00c2de7c10
_sleep() at _sleep+0x2dd/frame 0xfffffe00c2de7cb0
audit_read() at audit_read+0x9c/frame 0xfffffe00c2de7ce0
devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe00c2de7d40
dofileread() at dofileread+0x81/frame 0xfffffe00c2de7d90
sys_read() at sys_read+0xc0/frame 0xfffffe00c2de7e00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe00c2de7f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00c2de7f30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x34d15d6266ba, rsp = 0x34d15ad7f998, rbp = 0x34d15ad7f9e0 ---

Tracing command sh pid 728 tid 100091 td 0xfffffe00979e5c80
sched_switch() at sched_switch+0x559/frame 0xfffffe0084f4da10
mi_switch() at mi_switch+0x157/frame 0xfffffe0084f4da30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0084f4da70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0084f4dac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0084f4dad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0084f4db70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0084f4dc00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0084f4de00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe0084f4df30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0084f4df30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x323cd02cf89a, rsp = 0x323ccec2ea98, rbp = 0x323ccec2eb50 ---

Tracing command sh pid 741 tid 100093 td 0xfffffe00979e4e40
sched_switch() at sched_switch+0x559/frame 0xfffffe0084f43a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0084f43a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0084f43a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0084f43ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0084f43ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0084f43b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0084f43c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0084f43e00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe0084f43f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0084f43f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x14047c5d989a, rsp = 0x140479d5ea58, rbp = 0x140479d5eb10 ---

Tracing command sh pid 749 tid 100107 td 0xfffffe00979e8740
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1c8a10
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1c8a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1c8a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00cb1c8ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00cb1c8ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00cb1c8b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00cb1c8c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00cb1c8e00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe00cb1c8f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00cb1c8f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x43c9191c89a, rsp = 0x43c8fdd7be8, rbp = 0x43c8fdd7ca0 ---

Tracing command kyua pid 750 tid 100108 td 0xfffffe00979e8020
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1c3a10
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1c3a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1c3a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00cb1c3ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00cb1c3ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00cb1c3b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00cb1c3c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00cb1c3e00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe00cb1c3f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00cb1c3f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x4451a6189a, rsp = 0x444b7c9318, rbp = 0x444b7c9350 ---
db:0:kdb.enter.panic> dump
Dumping 456 out of 8156 MB:..4%..11%..22%..32%..43%..53%..64%..71%..81%..92%
Dump complete
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-20437' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-zfs-tests.sh
x ./run.sh
x ./disable-dtrace-tests.sh
x ./auto-shutdown
x ./disable-notyet-tests.sh
x ./run-kyua.sh
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins4902938781715389046.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '9ce46cbc95d7a6fccb55af0d42cbb85c29f10639', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../9ce46cbc95d7a6fccb55af0d42cbb85c29f10639/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address