FreeBSD-main-amd64-test - Build #24584 - Still Failing

Reply: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #24585 - Still unstable"
In reply to: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #24583 - Failure"
Go to: [ bottom of page ] [ top of archives ] [ this month ]
From: <jenkins-admin_at_FreeBSD.org>
Date: Wed, 27 Dec 2023 09:25:43 UTC
FreeBSD-main-amd64-test - Build #24584 (407e3790c3a0652beb5c97e4049a58a6e2118ce4) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24584/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24584/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24584/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

dbc463119c8c3694e8f10a7bcf702a0bbfb373a7 by glebius:
netlink: remove unused structure

f27aff8f7f4f7628a652602e55409f7e858d7f56 by glebius:
linux/netlink: don't override sopt level

97958f5d5c674de5d05a6b547cb1c45f8c58791b by glebius:
netlink: simplify socket destruction

a6f795cc89cbedbf1be0ab504fa6ed863e1eec5e by kevans:
daemon: fix clang-tidy warnings

6ac7c9f06ae9b7ef070c1f8a57dcc52be4dd45b7 by kevans:
daemon: remove redundant parameter from listen_child()

24fd3e969ebe2ed44bc04f5ccc4db21cf02184d5 by kevans:
daemon: move buffer into daemon_state

5745a5841413da5c2e002ba65c60d7b9d594bc52 by kevans:
daemon: replace memchr with memrchr

407e3790c3a0652beb5c97e4049a58a6e2118ce4 by kevans:
daemon: separate pipe_fd[2] into pipe_rd and pipe_wr



The end of the build log:

[...truncated 4.31 MB...]
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.440s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsBroadcast::test_del[ifa_address-ipv6_gu_host]  ->  epair0a: Ethernet address: 02:80:77:43:4d:0a
epair0b: Ethernet address: 02:80:77:43:4d:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.439s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsBroadcast::test_del[ifa_address-ipv6_gu_prefix]  ->  epair0a: Ethernet address: 02:0f:81:05:21:0a
epair0b: Ethernet address: 02:0f:81:05:21:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.443s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsBroadcast::test_del[ifa_local-ipv4_host]  ->  epair0a: Ethernet address: 02:cf:db:91:65:0a
epair0b: Ethernet address: 02:cf:db:91:65:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.436s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsBroadcast::test_del[ifa_local-ipv4_prefix]  ->  epair0a: Ethernet address: 02:eb:af:2a:94:0a
epair0b: Ethernet address: 02:eb:af:2a:94:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.433s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsBroadcast::test_del[ifa_local-ipv6_gu_host]  ->  epair0a: Ethernet address: 02:b5:b5:04:12:0a
epair0b: Ethernet address: 02:b5:b5:04:12:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.404s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsBroadcast::test_del[ifa_local-ipv6_gu_prefix]  ->  epair0a: Ethernet address: 02:02:68:e9:80:0a
epair0b: Ethernet address: 02:02:68:e9:80:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.426s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_add_4[dst_inside_24]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.422s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_add_4[dst_inside_30]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.440s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_add_4[dst_inside_31]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.415s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_add_4[dst_outside_30]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.418s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_add_4[dst_outside_32]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.395s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_add_6[dst_inside_127]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
skipped: /usr/tests/sys/netlink/test_rtnl_ifaddr.py:592: AssertionError  [0.474s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_add_6[dst_inside_64]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
skipped: /usr/tests/sys/netlink/test_rtnl_ifaddr.py:592: AssertionError  [0.478s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_add_6[dst_outside_128]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.422s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_add_6[dst_outside_64]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
skipped: /usr/tests/sys/netlink/test_rtnl_ifaddr.py:592: AssertionError  [0.492s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_del[ifa_addr=addr,ifa_local=addr-ip6_dst_outside_128]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.433s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_del[ifa_addr=addr,ifa_local=addr-ipv4_dst_inside_30]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.417s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_del[ifa_addr=addr,ifa_local=addr-ipv4_dst_outside_32]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.439s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_del[ifa_addr=addr-ip6_dst_outside_128]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.446s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_del[ifa_addr=addr-ipv4_dst_inside_30]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.427s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_del[ifa_addr=addr-ipv4_dst_outside_32]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.419s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_del[ifa_local=addr-ip6_dst_outside_128]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.429s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_del[ifa_local=addr-ipv4_dst_inside_30]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.430s]
sys/netlink/test_rtnl_ifaddr.py:TestRtNlIfaddrOpsP2p::test_del[ifa_local=addr-ipv4_dst_outside_32]  ->  gif0: link state changed to DOWN
lo0: link state changed to UP
passed  [0.399s]
sys/netlink/test_rtnl_neigh.py:TestRtNlNeigh::test_4_filter_iface  ->  epair0a: Ethernet address: 02:40:73:3c:a8:0a
epair0b: Ethernet address: 02:40:73:3c:a8:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.455s]
sys/netlink/test_rtnl_neigh.py:TestRtNlNeigh::test_6_filter_iface  ->  epair0a: Ethernet address: 02:1d:f7:87:09:0a
epair0b: Ethernet address: 02:1d:f7:87:09:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.465s]
sys/netlink/test_rtnl_route.py:TestRtNlRoute::test_add_route4_ll_if_gw  ->  epair0a: Ethernet address: 02:17:4d:49:87:0a
epair0b: Ethernet address: 02:17:4d:49:87:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.493s]
sys/netlink/test_rtnl_route.py:TestRtNlRoute::test_add_route6_ll_gw  ->  epair0a: Ethernet address: 02:f6:ad:6e:3a:0a
epair0b: Ethernet address: 02:f6:ad:6e:3a:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
lo0: link state changed to UP
*** /usr/src/contrib/kyua/utils/process/executor.cpp:822: Invariant check failed: PID 39763 already in all_exec_handles; not properly cleaned up or reused too fast
*** Fatal signal 6 received
*** Log file is /.kyua/logs/kyua.20231227-084150.log
*** Please report this problem to kyua-discuss@googlegroups.com detailing what you were doing before the crash happened; if possible, include the log file mentioned above
pid 806 (kyua), jid 0, uid 0: exited on signal 6 (core dumped)
Abort trap (core dumped)
+ rc=134
+ set -e
+ [ 134 -ne 0 ]
+ [ 134 -ne 1 ]
+ exit 134
+ tar cvf /dev/vtbd1 -C /meta .
a .
a ./auto-shutdown
a ./disable-notyet-tests.sh
a ./run.sh
a ./run-kyua.sh
a ./disable-dtrace-tests.sh
a ./disable-zfs-tests.sh
+ [ -f /meta/auto-shutdown ]
+ uname -p
+ shutdown -p now
Shutdown NOW!
shutdown: [pid 39797]
+ startmsg .
+ check_startmsgs
+ [ -n yes ]
+ checkyesno rc_startmsgs
+ eval '_value=$rc_startmsgs'
+ _value=YES
+ debug 'checkyesno: rc_startmsgs is set to YES.'
+ return 0
+ echo .
.
+ _return=0
+ umask 0022
+ [ 0 -ne 0 ]
+ return 0
+ _run_rc_postcmd
+ [ -n '' ]
+ return 0
+ return 0
2023-12-27T09:25:35.306102+00:00 - shutdown 39797 - - power-down by root: 

System shutdown time has arrived
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop... epair0a: link state changed to DOWN
epair0b: link state changed to DOWN

Syncing disks, vnodes remaining... 3 0 done
All buffers synced.
lock order reversal:
 1st 0xfffff80009a333f0 devfs (devfs, lockmgr) @ /usr/src/sys/kern/vfs_mount.c:2253
 2nd 0xfffff80009a38cb0 fdescfs (fdescfs, lockmgr) @ /usr/src/sys/kern/vfs_subr.c:3294
lock order devfs -> fdescfs attempted at:
#0 0xffffffff80bc4ab3 at witness_checkorder+0xb63
#1 0xffffffff80b1d931 at lockmgr_lock_flags+0x181
#2 0xffffffff80c60be3 at _vn_lock+0x53
#3 0xffffffff80c4817d at vget_finish+0x4d
#4 0xffffffff82610262 at fdesc_root+0x22
#5 0xffffffff80c4920b at vflush+0x4b
#6 0xffffffff82610211 at fdesc_unmount+0x71
#7 0xffffffff80c3dd25 at dounmount+0x7b5
#8 0xffffffff80c4a94a at vfs_unmountall+0x6a
#9 0xffffffff80c1acaf at bufshutdown+0x31f
#10 0xffffffff80b50833 at kern_reboot+0x703
#11 0xffffffff80b500d9 at sys_reboot+0x3a9
#12 0xffffffff81057b5c at amd64_syscall+0x85c
#13 0xffffffff810292db at fast_syscall_common+0xf8
pid 520 (devd), jid 0, uid 0: exited on signal 11 (no core dump - other error)
Uptime: 43m49s
acpi0: Powering system off
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-24584' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./auto-shutdown
x ./disable-notyet-tests.sh
x ./run.sh
x ./run-kyua.sh
x ./disable-dtrace-tests.sh
x ./disable-zfs-tests.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins5462930555812213722.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '407e3790c3a0652beb5c97e4049a58a6e2118ce4', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../407e3790c3a0652beb5c97e4049a58a6e2118ce4/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address