FreeBSD-main-amd64-test - Build #20032 - Still Failing

From: <jenkins-admin_at_FreeBSD.org>
Date: Wed, 08 Dec 2021 09:41:56 UTC
FreeBSD-main-amd64-test - Build #20032 (935dc0de88195e8ce62be085ddfb002eb19ca17f) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20032/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20032/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20032/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

935dc0de88195e8ce62be085ddfb002eb19ca17f by mav:
mca: Remove excessively verbose debug messages.



The end of the build log:

[...truncated 3.89 MB...]
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by -240 to 0 (pfsync bulk done)
epair124b: link state changed to DOWN
epair124a: link state changed to DOWN
epair125b: link state changed to DOWN
epair125a: link state changed to DOWN
passed  [3.454s]
sys/netpfil/pf/pfsync:defer  ->  epair124a: Ethernet address: 02:c2:47:f9:a9:0a
epair124b: Ethernet address: 02:c2:47:f9:a9:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair125a: Ethernet address: 02:b0:e8:09:1b:0a
epair125b: Ethernet address: 02:b0:e8:09:1b:0b
epair125a: link state changed to UP
epair125b: link state changed to UP
epair126a: Ethernet address: 02:35:83:49:34:0a
epair126b: Ethernet address: 02:35:83:49:34:0b
epair126a: link state changed to UP
epair126b: link state changed to UP
carp: demoted by 240 to 240 (pfsync bulk start)
epair124b: promiscuous mode enabled
epair125b: promiscuous mode enabled
epair126b: promiscuous mode enabled
epair126b: promiscuous mode disabled
carp: demoted by -240 to 0 (pfsync bulk done)
epair124b: promiscuous mode disabled
epair125b: promiscuous mode disabled
epair124b: promiscuous mode enabled
epair126b: promiscuous mode enabled
epair125b: promiscuous mode enabled
epair126b: promiscuous mode disabled
epair124b: promiscuous mode disabled
epair125b: promiscuous mode disabled
epair124b: link state changed to DOWN
epair124a: link state changed to DOWN
epair125b: link state changed to DOWN
epair125a: link state changed to DOWN
epair126b: link state changed to DOWN
epair126a: link state changed to DOWN
passed  [8.673s]
sys/netpfil/pf/proxy:ftp  ->  skipped: Required program 'twistd' not found in PATH  [0.003s]
sys/netpfil/pf/rdr:basic  ->  epair124a: Ethernet address: 02:a6:4c:c3:17:0a
epair124b: Ethernet address: 02:a6:4c:c3:17:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair124a: link state changed to DOWN
epair124b: link state changed to DOWN
passed  [4.210s]
sys/netpfil/pf/ridentifier:basic  ->  epair124a: Ethernet address: 02:0e:e8:51:96:0a
epair124b: Ethernet address: 02:0e:e8:51:96:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
lo0: link state changed to UP
pflog0: promiscuous mode enabled
pflog0: promiscuous mode disabled
pflog0: promiscuous mode enabled
pflog0: promiscuous mode disabled
epair124a: link state changed to DOWN
epair124b: link state changed to DOWN
passed  [5.339s]
sys/netpfil/pf/route_to:icmp_nat  ->  epair124a: Ethernet address: 02:53:f1:38:f9:0a
epair124b: Ethernet address: 02:53:f1:38:f9:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair125a: Ethernet address: 02:f7:c2:9e:8c:0a
epair125b: Ethernet address: 02:f7:c2:9e:8c:0b
epair125a: link state changed to UP
epair125b: link state changed to UP
epair126a: Ethernet address: 02:2d:4b:f1:07:0a
epair126b: Ethernet address: 02:2d:4b:f1:07:0b
epair126a: link state changed to UP
epair126b: link state changed to UP
nd6_setmtu0: new link MTU on epair126a (500) is too small for IPv6
nd6_setmtu0: new link MTU on epair126b (500) is too small for IPv6
epair124a: promiscuous mode enabled
epair124a: promiscuous mode disabled
epair124a: link state changed to DOWN
epair124b: link state changed to DOWN
passed  [12.617s]
sys/netpfil/pf/route_to:multiwan  ->  epair124a: Ethernet address: 02:25:7c:78:12:0a
epair124b: Ethernet address: 02:25:7c:78:12:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair127a: Ethernet address: 02:e4:6c:b4:08:0a
epair127b: Ethernet address: 02:e4:6c:b4:08:0b
epair127a: link state changed to UP
epair127b: link state changed to UP
epair128a: Ethernet address: 02:c1:48:a0:aa:0a
epair128b: Ethernet address: 02:c1:48:a0:aa:0b
epair128a: link state changed to UP
epair128b: link state changed to UP
epair129a: Ethernet address: 02:b2:7c:a5:c1:0a
epair129b: Ethernet address: 02:b2:7c:a5:c1:0b
epair129a: link state changed to UP
epair129b: link state changed to UP
lo0: link state changed to UP
passed  [0.664s]
sys/netpfil/pf/route_to:multiwanlocal  ->  epair130a: Ethernet address: 02:04:32:43:e5:0a
epair130b: Ethernet address: 02:04:32:43:e5:0b
epair130a: link state changed to UP
epair130b: link state changed to UP
epair131a: Ethernet address: 02:7b:f1:2f:ca:0a
epair131b: Ethernet address: 02:7b:f1:2f:ca:0b
epair131a: link state changed to UP
epair131b: link state changed to UP
epair132a: Ethernet address: 02:62:0c:43:f0:0a
epair132b: Ethernet address: 02:62:0c:43:f0:0b
epair132a: link state changed to UP
epair132b: link state changed to UP
epair133a: Ethernet address: 02:1c:49:81:d3:0a
epair133b: Ethernet address: 02:1c:49:81:d3:0b
epair133a: link state changed to UP
epair133b: link state changed to UP
passed  [2.831s]
sys/netpfil/pf/route_to:v4  ->  epair134a: Ethernet address: 02:84:a9:04:a2:0a
epair134b: Ethernet address: 02:84:a9:04:a2:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
epair135a: Ethernet address: 02:53:92:1b:ad:0a
epair135b: Ethernet address: 02:53:92:1b:ad:0b
epair135a: link state changed to UP
epair135b: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
epair135a: link state changed to DOWN
epair135b: link state changed to DOWN
passed  [3.192s]
sys/netpfil/pf/route_to:v6  ->  epair134a: Ethernet address: 02:93:1a:a4:11:0a
epair134b: Ethernet address: 02:93:1a:a4:11:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
epair135a: Ethernet address: 02:68:9a:47:38:0a
epair135b: Ethernet address: 02:68:9a:47:38:0b
epair135a: link state changed to UP
epair135b: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
epair135a: link state changed to DOWN
epair135b: link state changed to DOWN
passed  [3.232s]
sys/netpfil/pf/rules_counter:get_clear  ->  epair134a: Ethernet address: 02:e4:8d:41:7a:0a
epair134b: Ethernet address: 02:e4:8d:41:7a:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
passed  [2.349s]
sys/netpfil/pf/rules_counter:keepcounters  ->  epair134a: Ethernet address: 02:d2:52:6b:e2:0a
epair134b: Ethernet address: 02:d2:52:6b:e2:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
passed  [6.368s]
sys/netpfil/pf/set_skip:pr255852  ->  epair134a: Ethernet address: 02:c7:2f:93:52:0a
epair134b: Ethernet address: 02:c7:2f:93:52:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
lo0: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
passed  [1.232s]
sys/netpfil/pf/set_skip:set_skip_dynamic  ->  epair134a: Ethernet address: 02:72:6c:3f:b0:0a
epair134b: Ethernet address: 02:72:6c:3f:b0:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
passed  [0.172s]
sys/netpfil/pf/set_skip:set_skip_group  ->  lo0: link state changed to UP
passed  [0.152s]
sys/netpfil/pf/set_skip:set_skip_group_lo  ->  pid 752 (kyua), jid 0, uid 0, was killed: out of swap space
pid 679 (auditd), jid 0, uid 0, was killed: out of swap space
pid 479 (devd), jid 0, uid 0, was killed: out of swap space
pid 3655 (sh), jid 0, uid 0, was killed: out of swap space
pid 751 (sh), jid 0, uid 0, was killed: out of swap space
pid 744 (sh), jid 0, uid 0, was killed: out of swap space
pid 3676 (jail), jid 0, uid 0, was killed: out of swap space
pid 731 (sh), jid 0, uid 0, was killed: out of swap space
carp: demoted by -240 to 0 (pfsync bulk fail)
2021-12-08T09:41:49.114445+00:00 - init 1 - - some processes would not die; ps axl advised
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop... 
Syncing disks, vnodes remaining... 0 done
Waiting (max 60 seconds) for system thread `bufdaemon' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-1' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-0' to stop... done
All buffers synced.
Uptime: 1h57m17s
pid 15 (sh), jid 0, uid 0, was killed: out of swap space
lock order reversal:
 1st 0xffffffff81f9dba0 cc_list (cc_list, rw) @ /usr/src/sys/netinet/cc/cc.c:245
 2nd 0xffffffff81f9d420 vnet_rwlock (vnet_rwlock, rw) @ /usr/src/sys/netinet/cc/cc.c:208
lock order cc_list -> vnet_rwlock attempted at:
#0 0xffffffff80c6e59d at witness_checkorder+0xbdd
#1 0xffffffff80bf9142 at __rw_rlock_int+0x82
#2 0xffffffff80dd3913 at cc_deregister_algo+0x113
#3 0xffffffff80dd3eca at cc_modevent+0x1a
#4 0xffffffff80bd8f3b at module_shutdown+0x6b
#5 0xffffffff80bfddfe at kern_reboot+0x4de
#6 0xffffffff80bfd8c8 at sys_reboot+0x3a8
#7 0xffffffff810bdc94 at amd64_syscall+0x6b4
#8 0xffffffff8108ed0b at fast_syscall_common+0xf8
acpi0: Powering system off
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-20032' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-dtrace-tests.sh
x ./disable-zfs-tests.sh
x ./disable-notyet-tests.sh
x ./auto-shutdown
x ./run-kyua.sh
x ./run.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins8004860006951092962.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '935dc0de88195e8ce62be085ddfb002eb19ca17f', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../935dc0de88195e8ce62be085ddfb002eb19ca17f/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address