FreeBSD-main-amd64-test - Build #20020 - Still Failing

From: <jenkins-admin_at_FreeBSD.org>
Date: Tue, 07 Dec 2021 08:18:11 UTC
FreeBSD-main-amd64-test - Build #20020 (25927e068fcbcac0a5111a881de723bd984b04b3) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20020/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20020/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20020/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

25927e068fcbcac0a5111a881de723bd984b04b3 by asomers:
fusefs: correctly handle an inode that changes file types



The end of the build log:

[...truncated 3.90 MB...]
epair104a: link state changed to DOWN
epair104b: link state changed to DOWN
passed  [1.222s]
sys/netpfil/pf/pass_block:v6  ->  epair104a: Ethernet address: 02:e3:b9:3f:14:0a
epair104b: Ethernet address: 02:e3:b9:3f:14:0b
epair104a: link state changed to UP
epair104b: link state changed to UP
epair104a: link state changed to DOWN
epair104b: link state changed to DOWN
passed  [2.283s]
sys/netpfil/pf/pfsync:basic  ->  epair104a: Ethernet address: 02:4a:40:89:c6:0a
epair104b: Ethernet address: 02:4a:40:89:c6:0b
epair104a: link state changed to UP
epair104b: link state changed to UP
epair122a: Ethernet address: 02:e7:7d:43:e0:0a
epair122b: Ethernet address: 02:e7:7d:43:e0:0b
epair122a: link state changed to UP
epair122b: link state changed to UP
epair123a: Ethernet address: 02:c8:a4:8c:48:0a
epair123b: Ethernet address: 02:c8:a4:8c:48:0b
epair123a: link state changed to UP
epair123b: link state changed to UP
lock order reversal: (sleepable after non-sleepable)
 1st 0xfffff8000cac3c60 pfsync (pfsync, sleep mutex) @ /usr/src/sys/netpfil/pf/if_pfsync.c:1394
 2nd 0xffffffff81f9d868 in_multi_sx (in_multi_sx, sx) @ /usr/src/sys/netinet/in_mcast.c:1206
lock order pfsync -> in_multi_sx attempted at:
#0 0xffffffff80c6e59d at witness_checkorder+0xbdd
#1 0xffffffff80c08893 at _sx_xlock+0x63
#2 0xffffffff80dbd7c1 at in_joingroup+0x31
#3 0xffffffff82560c09 at pfsync_multicast_setup+0x39
#4 0xffffffff8255fffa at pfsyncioctl+0x62a
#5 0xffffffff80d26ba4 at ifioctl+0x7f4
#6 0xffffffff80c74322 at kern_ioctl+0x202
#7 0xffffffff80c74076 at sys_ioctl+0x126
#8 0xffffffff810bdc94 at amd64_syscall+0x6b4
#9 0xffffffff8108ed2b at fast_syscall_common+0xf8
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by 240 to 240 (pfsync bulk start)
epair122b: link state changed to DOWN
epair122a: link state changed to DOWN
epair123b: link state changed to DOWN
epair123a: link state changed to DOWN
passed  [2.388s]
sys/netpfil/pf/pfsync:basic_defer  ->  epair122a: Ethernet address: 02:f8:1e:85:c1:0a
epair122b: Ethernet address: 02:f8:1e:85:c1:0b
epair122a: link state changed to UP
epair122b: link state changed to UP
epair123a: Ethernet address: 02:a5:07:74:09:0a
epair123b: Ethernet address: 02:a5:07:74:09:0b
epair123a: link state changed to UP
epair123b: link state changed to UP
epair124a: Ethernet address: 02:f7:d0:67:d6:0a
epair124b: Ethernet address: 02:f7:d0:67:d6:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by 240 to 240 (pfsync bulk start)
epair123b: link state changed to DOWN
epair123a: link state changed to DOWN
epair124b: link state changed to DOWN
epair124a: link state changed to DOWN
passed  [2.552s]
sys/netpfil/pf/pfsync:bulk  ->  epair123a: Ethernet address: 02:38:72:e8:f0:0a
epair123b: Ethernet address: 02:38:72:e8:f0:0b
epair123a: link state changed to UP
epair123b: link state changed to UP
epair124a: Ethernet address: 02:00:a7:7b:80:0a
epair124b: Ethernet address: 02:00:a7:7b:80:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair125a: Ethernet address: 02:ce:c7:8b:ed:0a
epair125b: Ethernet address: 02:ce:c7:8b:ed:0b
epair125a: link state changed to UP
epair125b: link state changed to UP
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by -240 to 0 (pfsync bulk done)
epair124b: link state changed to DOWN
epair124a: link state changed to DOWN
epair125b: link state changed to DOWN
epair125a: link state changed to DOWN
passed  [3.424s]
sys/netpfil/pf/pfsync:defer  ->  epair124a: Ethernet address: 02:df:25:d6:58:0a
epair124b: Ethernet address: 02:df:25:d6:58:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair125a: Ethernet address: 02:07:07:00:32:0a
epair125b: Ethernet address: 02:07:07:00:32:0b
epair125a: link state changed to UP
epair125b: link state changed to UP
epair126a: Ethernet address: 02:4f:5d:04:0c:0a
epair126b: Ethernet address: 02:4f:5d:04:0c:0b
epair126a: link state changed to UP
epair126b: link state changed to UP
carp: demoted by 240 to 240 (pfsync bulk start)
epair124b: promiscuous mode enabled
epair125b: promiscuous mode enabled
epair126b: promiscuous mode enabled
epair126b: promiscuous mode disabled
carp: demoted by -240 to 0 (pfsync bulk done)
epair124b: promiscuous mode disabled
epair125b: promiscuous mode disabled
epair124b: link state changed to DOWN
epair124a: link state changed to DOWN
epair125b: link state changed to DOWN
epair125a: link state changed to DOWN
epair126b: link state changed to DOWN
epair126a: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [4.405s]
sys/netpfil/pf/proxy:ftp  ->  skipped: Required program 'twistd' not found in PATH  [0.013s]
sys/netpfil/pf/rdr:basic  ->  epair124a: Ethernet address: 02:52:5b:35:da:0a
epair124b: Ethernet address: 02:52:5b:35:da:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair124a: link state changed to DOWN
epair124b: link state changed to DOWN
passed  [4.216s]
sys/netpfil/pf/ridentifier:basic  ->  epair124a: Ethernet address: 02:0a:a8:48:b2:0a
epair124b: Ethernet address: 02:0a:a8:48:b2:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
lo0: link state changed to UP
pflog0: promiscuous mode enabled
pflog0: promiscuous mode disabled
pflog0: promiscuous mode enabled
pflog0: promiscuous mode disabled
epair124a: link state changed to DOWN
epair124b: link state changed to DOWN
passed  [5.355s]
sys/netpfil/pf/route_to:icmp_nat  ->  epair124a: Ethernet address: 02:14:d1:17:e0:0a
epair124b: Ethernet address: 02:14:d1:17:e0:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair125a: Ethernet address: 02:c5:58:1e:58:0a
epair125b: Ethernet address: 02:c5:58:1e:58:0b
epair125a: link state changed to UP
epair125b: link state changed to UP
epair126a: Ethernet address: 02:f5:48:84:3d:0a
epair126b: Ethernet address: 02:f5:48:84:3d:0b
epair126a: link state changed to UP
epair126b: link state changed to UP
nd6_setmtu0: new link MTU on epair126a (500) is too small for IPv6
nd6_setmtu0: new link MTU on epair126b (500) is too small for IPv6
epair124a: promiscuous mode enabled
epair124a: promiscuous mode disabled
pid 752 (kyua), jid 0, uid 0, was killed: out of swap space
Killed
+ rc=137
+ set -e
+ [ 137 -ne 0 ]
+ [ 137 -ne 1 ]
+ exit 137
+ tar cvf /dev/vtbd1 -C /meta .
a .
a ./disable-notyet-tests.sh
a ./run.sh
a ./disable-zfs-tests.sh
a ./run-kyua.sh
a ./auto-shutdown
a ./disable-dtrace-tests.sh
+ [ -f /meta/auto-shutdown ]
+ uname -p
+ shutdown -p now
Shutdown NOW!
shutdown: [pid 14868]
+ echo .
.
+ _return=0
+ [ 0 -ne 0 ]
+ return 0
+ _run_rc_postcmd
+ [ -n '' ]
+ return 0
+ return 0
2021-12-07T08:18:01.969484+00:00 - shutdown 14868 - - power-down by root: 

System shutdown time has arrived
2021-12-07T08:18:01.975337+00:00 - auditd 679 - - auditd_wait_for_events: SIGTERM
2021-12-07T08:18:01.978329+00:00 - auditd 679 - - Auditing disabled
2021-12-07T08:18:01.980323+00:00 - auditd 679 - - renamed /var/audit/20211207074049.not_terminated to /var/audit/20211207074049.20211207081801
2021-12-07T08:18:01.983133+00:00 - auditd 679 - - Finished
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop... 
Syncing disks, vnodes remaining... 0 0 done
Waiting (max 60 seconds) for system thread `bufdaemon' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-0' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-1' to stop... done
All buffers synced.
Uptime: 37m21s
lock order reversal:
 1st 0xffffffff81f9dba0 cc_list (cc_list, rw) @ /usr/src/sys/netinet/cc/cc.c:245
 2nd 0xffffffff81f9d420 vnet_rwlock (vnet_rwlock, rw) @ /usr/src/sys/netinet/cc/cc.c:208
lock order cc_list -> vnet_rwlock attempted at:
#0 0xffffffff80c6e59d at witness_checkorder+0xbdd
#1 0xffffffff80bf9142 at __rw_rlock_int+0x82
#2 0xffffffff80dd3913 at cc_deregister_algo+0x113
#3 0xffffffff80dd3eca at cc_modevent+0x1a
#4 0xffffffff80bd8f3b at module_shutdown+0x6b
#5 0xffffffff80bfddfe at kern_reboot+0x4de
#6 0xffffffff80bfd8c8 at sys_reboot+0x3a8
#7 0xffffffff810bd70e at amd64_syscall+0x12e
#8 0xffffffff8108ed2b at fast_syscall_common+0xf8
acpi0: Powering system off
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-20020' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-notyet-tests.sh
x ./run.sh
x ./disable-zfs-tests.sh
x ./run-kyua.sh
x ./auto-shutdown
x ./disable-dtrace-tests.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins6671052123040375475.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '25927e068fcbcac0a5111a881de723bd984b04b3', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../25927e068fcbcac0a5111a881de723bd984b04b3/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address