FreeBSD-main-amd64-test - Build #20028 - Still Failing

From: <jenkins-admin_at_FreeBSD.org>
Date: Wed, 08 Dec 2021 01:48:54 UTC
FreeBSD-main-amd64-test - Build #20028 (e9aeb50797fcaab1829ea626c1efd75de203a410) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20028/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20028/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20028/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

e9aeb50797fcaab1829ea626c1efd75de203a410 by se:
sys/_bitset.h: revert commit 74e014dbfab



The end of the build log:

[...truncated 4.22 MB...]
#6 0xffffffff80c74322 at kern_ioctl+0x202
#7 0xffffffff80c74076 at sys_ioctl+0x126
#8 0xffffffff810bdc94 at amd64_syscall+0x6b4
#9 0xffffffff8108ed2b at fast_syscall_common+0xf8
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by 240 to 240 (pfsync bulk start)
epair122b: link state changed to DOWN
epair122a: link state changed to DOWN
epair123b: link state changed to DOWN
epair123a: link state changed to DOWN
passed  [2.489s]
sys/netpfil/pf/pfsync:basic_defer  ->  epair122a: Ethernet address: 02:49:10:14:1c:0a
epair122b: Ethernet address: 02:49:10:14:1c:0b
epair122a: link state changed to UP
epair122b: link state changed to UP
epair123a: Ethernet address: 02:52:6f:35:4b:0a
epair123b: Ethernet address: 02:52:6f:35:4b:0b
epair123a: link state changed to UP
epair123b: link state changed to UP
epair124a: Ethernet address: 02:e3:c6:a4:a3:0a
epair124b: Ethernet address: 02:e3:c6:a4:a3:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by 240 to 240 (pfsync bulk start)
epair123b: link state changed to DOWN
epair123a: link state changed to DOWN
epair124b: link state changed to DOWN
epair124a: link state changed to DOWN
passed  [2.391s]
sys/netpfil/pf/pfsync:bulk  ->  epair123a: Ethernet address: 02:78:52:c3:f6:0a
epair123b: Ethernet address: 02:78:52:c3:f6:0b
epair123a: link state changed to UP
epair123b: link state changed to UP
epair124a: Ethernet address: 02:8d:ad:60:22:0a
epair124b: Ethernet address: 02:8d:ad:60:22:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair125a: Ethernet address: 02:7d:38:9f:20:0a
epair125b: Ethernet address: 02:7d:38:9f:20:0b
epair125a: link state changed to UP
epair125b: link state changed to UP
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by -240 to 0 (pfsync bulk done)
epair124b: link state changed to DOWN
epair124a: link state changed to DOWN
epair125b: link state changed to DOWN
epair125a: link state changed to DOWN
passed  [3.462s]
sys/netpfil/pf/pfsync:defer  ->  epair124a: Ethernet address: 02:d7:56:86:f0:0a
epair124b: Ethernet address: 02:d7:56:86:f0:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair125a: Ethernet address: 02:7b:93:db:82:0a
epair125b: Ethernet address: 02:7b:93:db:82:0b
epair125a: link state changed to UP
epair125b: link state changed to UP
epair126a: Ethernet address: 02:6d:9e:e9:6a:0a
epair126b: Ethernet address: 02:6d:9e:e9:6a:0b
epair126a: link state changed to UP
epair126b: link state changed to UP
carp: demoted by 240 to 240 (pfsync bulk start)
epair124b: promiscuous mode enabled
epair125b: promiscuous mode enabled
epair126b: promiscuous mode enabled
epair126b: promiscuous mode disabled
carp: demoted by -240 to 0 (pfsync bulk done)
epair124b: promiscuous mode disabled
epair125b: promiscuous mode disabled
epair124b: link state changed to DOWN
epair124a: link state changed to DOWN
epair125b: link state changed to DOWN
epair125a: link state changed to DOWN
epair126b: link state changed to DOWN
epair126a: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [4.316s]
sys/netpfil/pf/proxy:ftp  ->  skipped: Required program 'twistd' not found in PATH  [0.002s]
sys/netpfil/pf/rdr:basic  ->  epair124a: Ethernet address: 02:4e:bd:3a:8b:0a
epair124b: Ethernet address: 02:4e:bd:3a:8b:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair124a: link state changed to DOWN
epair124b: link state changed to DOWN
passed  [4.193s]
sys/netpfil/pf/ridentifier:basic  ->  epair124a: Ethernet address: 02:0e:5f:aa:67:0a
epair124b: Ethernet address: 02:0e:5f:aa:67:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
lo0: link state changed to UP
pflog0: promiscuous mode enabled
pflog0: promiscuous mode disabled
pflog0: promiscuous mode enabled
pflog0: promiscuous mode disabled
epair124a: link state changed to DOWN
epair124b: link state changed to DOWN
passed  [5.327s]
sys/netpfil/pf/route_to:icmp_nat  ->  epair124a: Ethernet address: 02:84:4e:d9:22:0a
epair124b: Ethernet address: 02:84:4e:d9:22:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair125a: Ethernet address: 02:a3:d5:30:c8:0a
epair125b: Ethernet address: 02:a3:d5:30:c8:0b
epair125a: link state changed to UP
epair125b: link state changed to UP
epair126a: Ethernet address: 02:8d:29:ac:49:0a
epair126b: Ethernet address: 02:8d:29:ac:49:0b
epair126a: link state changed to UP
epair126b: link state changed to UP
nd6_setmtu0: new link MTU on epair126a (500) is too small for IPv6
nd6_setmtu0: new link MTU on epair126b (500) is too small for IPv6
epair124a: promiscuous mode enabled
epair124a: promiscuous mode disabled
epair124a: link state changed to DOWN
epair124b: link state changed to DOWN
passed  [12.379s]
sys/netpfil/pf/route_to:multiwan  ->  epair124a: Ethernet address: 02:7b:91:6c:44:0a
epair124b: Ethernet address: 02:7b:91:6c:44:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair127a: Ethernet address: 02:52:75:e3:ee:0a
epair127b: Ethernet address: 02:52:75:e3:ee:0b
epair127a: link state changed to UP
epair127b: link state changed to UP
epair128a: Ethernet address: 02:5f:ea:e5:24:0a
epair128b: Ethernet address: 02:5f:ea:e5:24:0b
epair128a: link state changed to UP
epair128b: link state changed to UP
epair129a: Ethernet address: 02:6e:fa:5c:02:0a
epair129b: Ethernet address: 02:6e:fa:5c:02:0b
epair129a: link state changed to UP
epair129b: link state changed to UP
lo0: link state changed to UP
passed  [0.644s]
sys/netpfil/pf/route_to:multiwanlocal  ->  epair130a: Ethernet address: 02:e5:9c:0c:f4:0a
epair130b: Ethernet address: 02:e5:9c:0c:f4:0b
epair130a: link state changed to UP
epair130b: link state changed to UP
epair131a: Ethernet address: 02:ab:ec:e4:1d:0a
epair131b: Ethernet address: 02:ab:ec:e4:1d:0b
epair131a: link state changed to UP
epair131b: link state changed to UP
epair132a: Ethernet address: 02:94:cf:3e:54:0a
epair132b: Ethernet address: 02:94:cf:3e:54:0b
epair132a: link state changed to UP
epair132b: link state changed to UP
epair133a: Ethernet address: 02:5f:e0:26:6a:0a
epair133b: Ethernet address: 02:5f:e0:26:6a:0b
epair133a: link state changed to UP
epair133b: link state changed to UP
pid 752 (kyua), jid 0, uid 0, was killed: out of swap space
pid 679 (auditd), jid 0, uid 0, was killed: out of swap space
pid 99137 (sh), jid 0, uid 0, was killed: out of swap space
pid 479 (devd), jid 0, uid 0, was killed: out of swap space
pid 751 (sh), jid 0, uid 0, was killed: out of swap space
pid 744 (sh), jid 0, uid 0, was killed: out of swap space
pid 99242 (sh), jid 0, uid 0, was killed: out of swap space
pid 99238 (jail), jid 0, uid 0, was killed: out of swap space
pid 731 (sh), jid 0, uid 0, was killed: out of swap space
pid 99243 (sysctl), jid 0, uid 0, was killed: out of swap space
carp: demoted by -240 to 0 (pfsync bulk fail)
2021-12-08T01:48:45.141962+00:00 - init 1 - - some processes would not die; ps axl advised
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop... 
Syncing disks, vnodes remaining... 0 done
Waiting (max 60 seconds) for system thread `bufdaemon' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-0' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-1' to stop... done
All buffers synced.
lock order reversal:
 1st 0xfffff8000586f230 devfs (devfs, lockmgr) @ /usr/src/sys/kern/vfs_mount.c:2122
 2nd 0xfffff80005920af0 fdescfs (fdescfs, lockmgr) @ /usr/src/sys/kern/vfs_subr.c:2995
lock order devfs -> fdescfs attempted at:
#0 0xffffffff80c6e59d at witness_checkorder+0xbdd
#1 0xffffffff80bccaa2 at lockmgr_lock_flags+0x182
#2 0xffffffff80d04124 at _vn_lock+0x54
#3 0xffffffff80cec63f at vget_finish+0x4f
#4 0xffffffff82510242 at fdesc_root+0x22
#5 0xffffffff80ced7bc at vflush+0x4c
#6 0xffffffff825101f2 at fdesc_unmount+0x72
#7 0xffffffff80ce2903 at dounmount+0x7c3
#8 0xffffffff80ceeeca at vfs_unmountall+0x6a
#9 0xffffffff80cc046c at bufshutdown+0x31c
#10 0xffffffff80bfdb23 at kern_reboot+0x203
#11 0xffffffff80bfd8c8 at sys_reboot+0x3a8
#12 0xffffffff810bdc94 at amd64_syscall+0x6b4
#13 0xffffffff8108ed2b at fast_syscall_common+0xf8
pid 99244 (jail), jid 0, uid 0: exited on signal 11
Uptime: 1h57m18s
lock order reversal:
 1st 0xffffffff81f9dba0 cc_list (cc_list, rw) @ /usr/src/sys/netinet/cc/cc.c:245
 2nd 0xffffffff81f9d420 vnet_rwlock (vnet_rwlock, rw) @ /usr/src/sys/netinet/cc/cc.c:208
lock order cc_list -> vnet_rwlock attempted at:
#0 0xffffffff80c6e59d at witness_checkorder+0xbdd
#1 0xffffffff80bf9142 at __rw_rlock_int+0x82
#2 0xffffffff80dd3913 at cc_deregister_algo+0x113
#3 0xffffffff80dd3eca at cc_modevent+0x1a
#4 0xffffffff80bd8f3b at module_shutdown+0x6b
#5 0xffffffff80bfddfe at kern_reboot+0x4de
#6 0xffffffff80bfd8c8 at sys_reboot+0x3a8
#7 0xffffffff810bdc94 at amd64_syscall+0x6b4
#8 0xffffffff8108ed2b at fast_syscall_common+0xf8
acpi0: Powering system off
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-20028' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run.sh
x ./disable-notyet-tests.sh
x ./disable-zfs-tests.sh
x ./disable-dtrace-tests.sh
x ./auto-shutdown
x ./run-kyua.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins2572468253072262333.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'e9aeb50797fcaab1829ea626c1efd75de203a410', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../e9aeb50797fcaab1829ea626c1efd75de203a410/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address