FreeBSD-main-amd64-test - Build #20042 - Still Failing

From: <jenkins-admin_at_FreeBSD.org>
Date: Thu, 09 Dec 2021 05:29:46 UTC
FreeBSD-main-amd64-test - Build #20042 (a6765c4b449d79c6ee24dd7c37deb2239f6281a4) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20042/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20042/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20042/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

2a31cd215d9757a8fd6483c58fa965fc7d8aa91b by emaste:
Apply ASAN/UBSAN Makefile check only for build target

a6765c4b449d79c6ee24dd7c37deb2239f6281a4 by jhb:
libmd: Only define SHA256_Transform_c when using the ARM64 ifunc.



The end of the build log:

[...truncated 4.23 MB...]
epair125b: Ethernet address: 02:ce:10:bd:58:0b
epair125a: link state changed to UP
epair125b: link state changed to UP
epair126a: Ethernet address: 02:90:89:db:5c:0a
epair126b: Ethernet address: 02:90:89:db:5c:0b
epair126a: link state changed to UP
epair126b: link state changed to UP
carp: demoted by 240 to 240 (pfsync bulk start)
epair124b: promiscuous mode enabled
epair125b: promiscuous mode enabled
epair126b: promiscuous mode enabled
epair126b: promiscuous mode disabled
carp: demoted by -240 to 0 (pfsync bulk done)
epair124b: promiscuous mode disabled
epair125b: promiscuous mode disabled
epair124b: link state changed to DOWN
epair124a: link state changed to DOWN
epair125b: link state changed to DOWN
epair125a: link state changed to DOWN
epair126b: link state changed to DOWN
epair126a: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [4.411s]
sys/netpfil/pf/proxy:ftp  ->  skipped: Required program 'twistd' not found in PATH  [0.003s]
sys/netpfil/pf/rdr:basic  ->  epair124a: Ethernet address: 02:91:10:d4:66:0a
epair124b: Ethernet address: 02:91:10:d4:66:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair124a: link state changed to DOWN
epair124b: link state changed to DOWN
passed  [4.212s]
sys/netpfil/pf/ridentifier:basic  ->  epair124a: Ethernet address: 02:51:da:3f:b0:0a
epair124b: Ethernet address: 02:51:da:3f:b0:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
lo0: link state changed to UP
pflog0: promiscuous mode enabled
pflog0: promiscuous mode disabled
pflog0: promiscuous mode enabled
pflog0: promiscuous mode disabled
epair124a: link state changed to DOWN
epair124b: link state changed to DOWN
passed  [5.302s]
sys/netpfil/pf/route_to:icmp_nat  ->  epair124a: Ethernet address: 02:57:6c:20:08:0a
epair124b: Ethernet address: 02:57:6c:20:08:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair125a: Ethernet address: 02:46:3a:bb:7c:0a
epair125b: Ethernet address: 02:46:3a:bb:7c:0b
epair125a: link state changed to UP
epair125b: link state changed to UP
epair126a: Ethernet address: 02:64:32:5d:61:0a
epair126b: Ethernet address: 02:64:32:5d:61:0b
epair126a: link state changed to UP
epair126b: link state changed to UP
nd6_setmtu0: new link MTU on epair126a (500) is too small for IPv6
nd6_setmtu0: new link MTU on epair126b (500) is too small for IPv6
epair124a: promiscuous mode enabled
epair124a: promiscuous mode disabled
epair124a: link state changed to DOWN
epair124b: link state changed to DOWN
passed  [12.649s]
sys/netpfil/pf/route_to:multiwan  ->  epair124a: Ethernet address: 02:a5:32:7e:ee:0a
epair124b: Ethernet address: 02:a5:32:7e:ee:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair127a: Ethernet address: 02:94:cb:26:0b:0a
epair127b: Ethernet address: 02:94:cb:26:0b:0b
epair127a: link state changed to UP
epair127b: link state changed to UP
epair128a: Ethernet address: 02:68:15:5a:13:0a
epair128b: Ethernet address: 02:68:15:5a:13:0b
epair128a: link state changed to UP
epair128b: link state changed to UP
epair129a: Ethernet address: 02:8b:ec:41:7b:0a
epair129b: Ethernet address: 02:8b:ec:41:7b:0b
epair129a: link state changed to UP
epair129b: link state changed to UP
lo0: link state changed to UP
passed  [0.676s]
sys/netpfil/pf/route_to:multiwanlocal  ->  epair130a: Ethernet address: 02:3f:a1:c5:85:0a
epair130b: Ethernet address: 02:3f:a1:c5:85:0b
epair130a: link state changed to UP
epair130b: link state changed to UP
epair131a: Ethernet address: 02:68:db:5f:1c:0a
epair131b: Ethernet address: 02:68:db:5f:1c:0b
epair131a: link state changed to UP
epair131b: link state changed to UP
epair132a: Ethernet address: 02:ca:64:b3:3f:0a
epair132b: Ethernet address: 02:ca:64:b3:3f:0b
epair132a: link state changed to UP
epair132b: link state changed to UP
epair133a: Ethernet address: 02:ec:18:50:fa:0a
epair133b: Ethernet address: 02:ec:18:50:fa:0b
epair133a: link state changed to UP
epair133b: link state changed to UP
passed  [2.949s]
sys/netpfil/pf/route_to:v4  ->  epair134a: Ethernet address: 02:3f:4b:27:f6:0a
epair134b: Ethernet address: 02:3f:4b:27:f6:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
epair135a: Ethernet address: 02:52:e1:2b:c5:0a
epair135b: Ethernet address: 02:52:e1:2b:c5:0b
epair135a: link state changed to UP
epair135b: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
epair135a: link state changed to DOWN
epair135b: link state changed to DOWN
passed  [3.276s]
sys/netpfil/pf/route_to:v6  ->  epair134a: Ethernet address: 02:ae:e1:35:22:0a
epair134b: Ethernet address: 02:ae:e1:35:22:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
epair135a: Ethernet address: 02:f1:e1:d3:02:0a
epair135b: Ethernet address: 02:f1:e1:d3:02:0b
epair135a: link state changed to UP
epair135b: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
epair135a: link state changed to DOWN
epair135b: link state changed to DOWN
passed  [3.214s]
sys/netpfil/pf/rules_counter:get_clear  ->  epair134a: Ethernet address: 02:6d:91:0f:aa:0a
epair134b: Ethernet address: 02:6d:91:0f:aa:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
passed  [2.220s]
sys/netpfil/pf/rules_counter:keepcounters  ->  epair134a: Ethernet address: 02:6d:b1:2b:2d:0a
epair134b: Ethernet address: 02:6d:b1:2b:2d:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
passed  [6.374s]
sys/netpfil/pf/set_skip:pr255852  ->  epair134a: Ethernet address: 02:bb:f0:5b:c5:0a
epair134b: Ethernet address: 02:bb:f0:5b:c5:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
lo0: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
passed  [1.219s]
sys/netpfil/pf/set_skip:set_skip_dynamic  ->  pid 752 (kyua), jid 0, uid 0, was killed: out of swap space
pid 679 (auditd), jid 0, uid 0, was killed: out of swap space
pid 479 (devd), jid 0, uid 0, was killed: out of swap space
pid 2185 (sh), jid 0, uid 0, was killed: out of swap space
pid 751 (sh), jid 0, uid 0, was killed: out of swap space
pid 744 (sh), jid 0, uid 0, was killed: out of swap space
pid 2206 (jail), jid 0, uid 0, was killed: out of swap space
pid 731 (sh), jid 0, uid 0, was killed: out of swap space
carp: demoted by -240 to 0 (pfsync bulk fail)
2021-12-09T05:29:36.368178+00:00 - init 1 - - some processes would not die; ps axl advised
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop... 
Syncing disks, vnodes remaining... 0 lock order reversal:
 1st 0xfffff800058ee770 syncer (syncer, lockmgr) @ /usr/src/sys/kern/vfs_subr.c:2603
 2nd 0xfffff800038ea230 mntfs (mntfs, lockmgr) @ /usr/src/sys/ufs/ffs/ffs_vfsops.c:1783
lock order syncer -> mntfs attempted at:
#0 0xffffffff80c6e82d at witness_checkorder+0xbdd
#1 0xffffffff80bcca72 at lockmgr_lock_flags+0x182
#2 0xffffffff80d043b4 at _vn_lock+0x54
#3 0xffffffff80f27e30 at ffs_sync+0x2a0
#4 0xffffffff80cf79ab at sync_fsync+0xeb
#5 0xffffffff80cf4e19 at sched_sync+0x419
#6 0xffffffff80bb5f60 at fork_exit+0x80
#7 0xffffffff8108f8be at fork_trampoline+0xe
0 done
Waiting (max 60 seconds) for system thread `bufdaemon' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-0' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-1' to stop... done
All buffers synced.
lock order reversal:
 1st 0xfffff800058f8cb0 devfs (devfs, lockmgr) @ /usr/src/sys/kern/vfs_mount.c:2122
 2nd 0xfffff80005a94070 fdescfs (fdescfs, lockmgr) @ /usr/src/sys/kern/vfs_subr.c:2995
lock order devfs -> fdescfs attempted at:
#0 0xffffffff80c6e82d at witness_checkorder+0xbdd
#1 0xffffffff80bcca72 at lockmgr_lock_flags+0x182
#2 0xffffffff80d043b4 at _vn_lock+0x54
#3 0xffffffff80cec8cf at vget_finish+0x4f
#4 0xffffffff82510242 at fdesc_root+0x22
#5 0xffffffff80ceda4c at vflush+0x4c
#6 0xffffffff825101f2 at fdesc_unmount+0x72
#7 0xffffffff80ce2b93 at dounmount+0x7c3
#8 0xffffffff80cef15a at vfs_unmountall+0x6a
#9 0xffffffff80cc06fc at bufshutdown+0x31c
#10 0xffffffff80bfdaf3 at kern_reboot+0x203
#11 0xffffffff80bfd898 at sys_reboot+0x3a8
#12 0xffffffff810bec94 at amd64_syscall+0x6b4
#13 0xffffffff8108f15b at fast_syscall_common+0xf8
Uptime: 1h57m19s
pid 15 (sh), jid 0, uid 0, was killed: out of swap space
lock order reversal:
 1st 0xffffffff81f9dc20 cc_list (cc_list, rw) @ /usr/src/sys/netinet/cc/cc.c:245
 2nd 0xffffffff81f9d4a0 vnet_rwlock (vnet_rwlock, rw) @ /usr/src/sys/netinet/cc/cc.c:208
lock order cc_list -> vnet_rwlock attempted at:
#0 0xffffffff80c6e82d at witness_checkorder+0xbdd
#1 0xffffffff80bf9112 at __rw_rlock_int+0x82
#2 0xffffffff80dd3ba3 at cc_deregister_algo+0x113
#3 0xffffffff80dd415a at cc_modevent+0x1a
#4 0xffffffff80bd8f0b at module_shutdown+0x6b
#5 0xffffffff80bfddce at kern_reboot+0x4de
#6 0xffffffff80bfd898 at sys_reboot+0x3a8
#7 0xffffffff810bec94 at amd64_syscall+0x6b4
#8 0xffffffff8108f15b at fast_syscall_common+0xf8
acpi0: Powering system off
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-20042' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run-kyua.sh
x ./disable-zfs-tests.sh
x ./disable-notyet-tests.sh
x ./auto-shutdown
x ./run.sh
x ./disable-dtrace-tests.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins1951395330650787251.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'a6765c4b449d79c6ee24dd7c37deb2239f6281a4', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../a6765c4b449d79c6ee24dd7c37deb2239f6281a4/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address