FreeBSD-main-amd64-test - Build #23555 - Failure

From: <jenkins-admin_at_FreeBSD.org>
Date: Wed, 17 May 2023 04:55:06 UTC
FreeBSD-main-amd64-test - Build #23555 (cdc231bd49498481801686913872c361dbc01f95) - Failure

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/23555/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/23555/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/23555/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

cdc231bd49498481801686913872c361dbc01f95 by kp:
pfsync: Remove deletion of states using the full pfsync_state struct



The end of the build log:

[...truncated 4.85 MB...]
passed  [0.159s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4[change_new_weight1]  ->  epair0a: Ethernet address: 02:07:1c:31:5f:0a
epair0b: Ethernet address: 02:07:1c:31:5f:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.485s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4[change_new_weight2]  ->  epair0a: Ethernet address: 02:a8:2d:72:dc:0a
epair0b: Ethernet address: 02:a8:2d:72:dc:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.537s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4[change_new_weight3]  ->  epair0a: Ethernet address: 02:b9:f6:b4:4e:0a
epair0b: Ethernet address: 02:b9:f6:b4:4e:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.507s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4[change_same_weight1]  ->  epair0a: Ethernet address: 02:c1:1a:d3:c6:0a
epair0b: Ethernet address: 02:c1:1a:d3:c6:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.478s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4[change_same_weight2]  ->  epair0a: Ethernet address: 02:a1:12:e9:8c:0a
epair0b: Ethernet address: 02:a1:12:e9:8c:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.481s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4[correctness1]  ->  epair0a: Ethernet address: 02:e1:32:84:86:0a
epair0b: Ethernet address: 02:e1:32:84:86:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.531s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4[correctness2]  ->  epair0a: Ethernet address: 02:27:d8:54:69:0a
epair0b: Ethernet address: 02:27:d8:54:69:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.529s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4[transition_multi]  ->  epair0a: Ethernet address: 02:bd:ac:a2:13:0a
epair0b: Ethernet address: 02:bd:ac:a2:13:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.476s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4[transition_single1]  ->  epair0a: Ethernet address: 02:4e:fe:4c:8d:0a
epair0b: Ethernet address: 02:4e:fe:4c:8d:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.510s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4[transition_single2]  ->  epair0a: Ethernet address: 02:a6:15:04:e7:0a
epair0b: Ethernet address: 02:a6:15:04:e7:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.510s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4[weight1]  ->  epair0a: Ethernet address: 02:8a:27:94:fa:0a
epair0b: Ethernet address: 02:8a:27:94:fa:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.517s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4[weight2]  ->  epair0a: Ethernet address: 02:56:ae:94:be:0a
epair0b: Ethernet address: 02:56:ae:94:be:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.520s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4[weight3_max]  ->  epair0a: Ethernet address: 02:d1:0c:80:45:0a
epair0b: Ethernet address: 02:d1:0c:80:45:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.527s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4_add_same_eexist  ->  epair0a: Ethernet address: 02:9f:45:df:f7:0a
epair0b: Ethernet address: 02:9f:45:df:f7:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.455s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4_add_zero_weight  ->  epair0a: Ethernet address: 02:f2:42:60:b1:0a
epair0b: Ethernet address: 02:f2:42:60:b1:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.478s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4_change_unknown_esrch  ->  epair0a: Ethernet address: 02:d1:20:df:9c:0a
epair0b: Ethernet address: 02:d1:20:df:9c:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.491s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4_del_unknown_esrch  ->  epair0a: Ethernet address: 02:6e:ee:0b:da:0a
epair0b: Ethernet address: 02:6e:ee:0b:da:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.506s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath4_getroute  ->  epair0a: Ethernet address: 02:22:85:00:b8:0a
epair0b: Ethernet address: 02:22:85:00:b8:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.467s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath6[change_new_weight1]  ->  epair0a: Ethernet address: 02:87:fa:7e:eb:0a
epair0b: Ethernet address: 02:87:fa:7e:eb:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.531s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath6[change_new_weight2]  ->  epair0a: Ethernet address: 02:44:f8:02:79:0a
epair0b: Ethernet address: 02:44:f8:02:79:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.523s]
sys/net/routing/test_rtsock_multipath.py:TestRtmMultipath::test_rtm_multipath6[change_new_weight3]  ->  epair0a: Ethernet address: 02:da:c9:28:e2:0a
epair0b: Ethernet address: 02:da:c9:28:e2:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
panic: gr_idx != 0
cpuid = 1
time = 1684299305
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000ed92cc0
vpanic() at vpanic+0x152/frame 0xfffffe000ed92d10
panic() at panic+0x43/frame 0xfffffe000ed92d70
nhgrp_free() at nhgrp_free+0xed/frame 0xfffffe000ed92db0
destroy_fd_instance_epoch() at destroy_fd_instance_epoch+0x102/frame 0xfffffe000ed92df0
epoch_call_task() at epoch_call_task+0x13a/frame 0xfffffe000ed92e40
gtaskqueue_run_locked() at gtaskqueue_run_locked+0xa7/frame 0xfffffe000ed92ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xc2/frame 0xfffffe000ed92ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe000ed92f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000ed92f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
KDB: enter: panic
[ thread pid 0 tid 100009 ]
Stopped at      kdb_enter+0x32: movq    $0,0xde2ab3(%rip)
db:0:kdb.enter.panic> show pcpu
cpuid        = 1
dynamic pcpu = 0xfffffe008f9ce580
curthread    = 0xfffffe00112b2c80: pid 0 tid 100009 critnest 1 "softirq_1"
curpcb       = 0xfffffe00112b31a0
fpcurthread  = none
idlethread   = 0xfffffe0011229c80: tid 100004 "idle: cpu1"
self         = 0xffffffff82211000
curpmap      = 0xffffffff8194abb0
tssp         = 0xffffffff82211384
rsp0         = 0xfffffe000ed93000
kcr3         = 0x8000000002166004
ucr3         = 0xffffffffffffffff
scr3         = 0x2c79780d
gs32p        = 0xffffffff82211404
ldt          = 0xffffffff82211444
tss          = 0xffffffff82211434
curvnet      = 0xfffff800669c0c00
spin locks held:
db:0:kdb.enter.panic>  reset
Uptime: 1h6m15s
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-23555' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run.sh
x ./run-kyua.sh
x ./disable-dtrace-tests.sh
x ./disable-zfs-tests.sh
x ./auto-shutdown
x ./disable-notyet-tests.sh
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins10596238411093403468.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'cdc231bd49498481801686913872c361dbc01f95', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../cdc231bd49498481801686913872c361dbc01f95/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address