FreeBSD-main-amd64-test - Build #20013 - Still Failing

Reply: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #20014 - Still Failing"
In reply to: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #20012 - Still Failing"
Go to: [ bottom of page ] [ top of archives ] [ this month ]
From: <jenkins-admin_at_FreeBSD.org>
Date: Mon, 06 Dec 2021 19:50:53 UTC
FreeBSD-main-amd64-test - Build #20013 (7e0bba4d8083b6fac71180681b51aee9ed5fb664) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20013/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20013/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20013/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

dbf05458e3bd8c46f5e49918593557293a29d41a by markj:
libdwarf: Support consumption of compressed ELF sections

f06f1d1fdb969fa7a0a6eefa030d8536f365eb6e by markj:
x86: Deduplicate clock.h

62d09b46ad7508ae74d462e49234f0a80f91ff69 by markj:
x86: Defer LAPIC calibration until after timecounters are available

553af8f1ec71d397b5b4fd5876622b9269936e63 by markj:
x86: Perform late TSC calibration before LAPIC timer calibration

5fecc5a79a3833a4e2f57f103deef1e87eed839e by kp:
dummynet tests: disable for now

053f8ed6ebf2355a92cb1798a9701f701610771c by imp:
nvme: Move to a quirk for the Intel alignment data

7cf8d63c884c484fee9b287f792549ee15270ae7 by imp:
nvme_ahci: Mark AHCI devices as such in the controller

b8194f37666768dac35a0e1105c41242aad9b2d0 by imp:
nvd: For AHCI attached devices, report ahci bridge

8f07932272c4b34804bc575c4f8bffecd15cd4ef by imp:
nvme_sim: Only report PCI related stats when we can

8062e5759cb4886ad4630d52c212d8ca77ef9c95 by glebius:
ifnet: allocate index at the end of if_alloc_domain()

450394af27bcb61beb6b641ff3ee6a6af01d4bb7 by glebius:
ifnet: use ck_pr(3) store & load setting ifnet pointer in ifindex

6ff4cac2ee9ee74911b538a67337bf510c4cffe4 by glebius:
ifnet: initial if_grow() shall always succeed

7b40b00fad1606eaa98a7b116ba8651221d55f62 by glebius:
ifnet: merge ifindex_alloc(), ifnet_setbyindex(), if_grow() and call

d74b7baeb0d419fce46994075b6ccf944a0fae9a by glebius:
ifnet_byindex() actually requires network epoch

7e0bba4d8083b6fac71180681b51aee9ed5fb664 by glebius:
ifnet: make V_if_index static to if.c



The end of the build log:

[...truncated 4.16 MB...]
epair122a: promiscuous mode enabled
epair104a: promiscuous mode enabled
epair104a: promiscuous mode disabled
epair122a: promiscuous mode disabled
epair122a: promiscuous mode enabled
epair104a: promiscuous mode enabled
epair122a: promiscuous mode disabled
epair104a: promiscuous mode disabled
epair104a: promiscuous mode enabled
epair122a: promiscuous mode enabled
epair104a: promiscuous mode disabled
epair122a: promiscuous mode disabled
epair122a: promiscuous mode enabled
epair104a: promiscuous mode enabled
epair122a: promiscuous mode disabled
epair104a: promiscuous mode disabled
epair104a: link state changed to DOWN
epair104b: link state changed to DOWN
epair122a: link state changed to DOWN
epair122b: link state changed to DOWN
passed  [10.459s]
sys/netpfil/pf/pass_block:v4  ->  epair104a: Ethernet address: 02:e0:43:22:50:0a
epair104b: Ethernet address: 02:e0:43:22:50:0b
epair104a: link state changed to UP
epair104b: link state changed to UP
epair104a: link state changed to DOWN
epair104b: link state changed to DOWN
passed  [1.233s]
sys/netpfil/pf/pass_block:v6  ->  epair104a: Ethernet address: 02:39:74:d1:2e:0a
epair104b: Ethernet address: 02:39:74:d1:2e:0b
epair104a: link state changed to UP
epair104b: link state changed to UP
epair104a: link state changed to DOWN
epair104b: link state changed to DOWN
passed  [2.383s]
sys/netpfil/pf/pfsync:basic  ->  epair104a: Ethernet address: 02:b0:f3:c4:82:0a
epair104b: Ethernet address: 02:b0:f3:c4:82:0b
epair104a: link state changed to UP
epair104b: link state changed to UP
epair122a: Ethernet address: 02:a6:5b:fe:6f:0a
epair122b: Ethernet address: 02:a6:5b:fe:6f:0b
epair122a: link state changed to UP
epair122b: link state changed to UP
epair123a: Ethernet address: 02:1c:a3:c7:23:0a
epair123b: Ethernet address: 02:1c:a3:c7:23:0b
epair123a: link state changed to UP
epair123b: link state changed to UP
lock order reversal: (sleepable after non-sleepable)
 1st 0xfffff800755dc960 pfsync (pfsync, sleep mutex) @ /usr/src/sys/netpfil/pf/if_pfsync.c:1394
 2nd 0xffffffff81f9d868 in_multi_sx (in_multi_sx, sx) @ /usr/src/sys/netinet/in_mcast.c:1206
lock order pfsync -> in_multi_sx attempted at:
#0 0xffffffff80c6e0fd at witness_checkorder+0xbdd
#1 0xffffffff80c083f3 at _sx_xlock+0x63
#2 0xffffffff80dbd321 at in_joingroup+0x31
#3 0xffffffff82560c09 at pfsync_multicast_setup+0x39
#4 0xffffffff8255fffa at pfsyncioctl+0x62a
#5 0xffffffff80d26704 at ifioctl+0x7f4
#6 0xffffffff80c73e82 at kern_ioctl+0x202
#7 0xffffffff80c73bd6 at sys_ioctl+0x126
#8 0xffffffff810bdcb4 at amd64_syscall+0x6b4
#9 0xffffffff8108e88b at fast_syscall_common+0xf8
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by 240 to 240 (pfsync bulk start)
epair122b: link state changed to DOWN
epair122a: link state changed to DOWN
epair123b: link state changed to DOWN
epair123a: link state changed to DOWN
passed  [2.407s]
sys/netpfil/pf/pfsync:basic_defer  ->  epair122a: Ethernet address: 02:67:ac:c3:1b:0a
epair122b: Ethernet address: 02:67:ac:c3:1b:0b
epair122a: link state changed to UP
epair122b: link state changed to UP
epair123a: Ethernet address: 02:86:b1:80:62:0a
epair123b: Ethernet address: 02:86:b1:80:62:0b
epair123a: link state changed to UP
epair123b: link state changed to UP
epair124a: Ethernet address: 02:9d:fe:f8:25:0a
epair124b: Ethernet address: 02:9d:fe:f8:25:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by 240 to 240 (pfsync bulk start)
epair123b: link state changed to DOWN
epair123a: link state changed to DOWN
epair124b: link state changed to DOWN
epair124a: link state changed to DOWN
passed  [2.441s]
sys/netpfil/pf/pfsync:bulk  ->  epair123a: Ethernet address: 02:0d:d3:de:62:0a
epair123b: Ethernet address: 02:0d:d3:de:62:0b
epair123a: link state changed to UP
epair123b: link state changed to UP
epair124a: Ethernet address: 02:21:ad:6a:cc:0a
epair124b: Ethernet address: 02:21:ad:6a:cc:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair125a: Ethernet address: 02:23:8f:b9:15:0a
epair125b: Ethernet address: 02:23:8f:b9:15:0b
epair125a: link state changed to UP
epair125b: link state changed to UP
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by -240 to 0 (pfsync bulk done)
epair124b: link state changed to DOWN
epair124a: link state changed to DOWN
epair125b: link state changed to DOWN
epair125a: link state changed to DOWN
passed  [3.432s]
sys/netpfil/pf/pfsync:defer  ->  epair124a: Ethernet address: 02:e9:a6:6f:ff:0a
epair124b: Ethernet address: 02:e9:a6:6f:ff:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair125a: Ethernet address: 02:c2:ae:fd:01:0a
epair125b: Ethernet address: 02:c2:ae:fd:01:0b
epair125a: link state changed to UP
epair125b: link state changed to UP
epair126a: Ethernet address: 02:4d:b5:f0:1f:0a
epair126b: Ethernet address: 02:4d:b5:f0:1f:0b
epair126a: link state changed to UP
epair126b: link state changed to UP
carp: demoted by 240 to 240 (pfsync bulk start)
epair124b: promiscuous mode enabled
epair126b: promiscuous mode enabled
epair125b: promiscuous mode enabled
epair126b: promiscuous mode disabled
carp: demoted by -240 to 0 (pfsync bulk done)
epair124b: promiscuous mode disabled
epair125b: promiscuous mode disabled
epair124b: promiscuous mode enabled
epair126b: promiscuous mode enabled
epair125b: promiscuous mode enabled
epair126b: promiscuous mode disabled
epair124b: promiscuous mode disabled
epair125b: promiscuous mode disabled
epair124b: link state changed to DOWN
epair124a: link state changed to DOWN
epair125b: link state changed to DOWN
epair125a: link state changed to DOWN
epair126b: link state changed to DOWN
epair126a: link state changed to DOWN
passed  [9.002s]
sys/netpfil/pf/proxy:ftp  ->  skipped: Required program 'twistd' not found in PATH  [0.003s]
sys/netpfil/pf/rdr:basic  ->  epair124a: Ethernet address: 02:81:0b:91:8d:0a
epair124b: Ethernet address: 02:81:0b:91:8d:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
pid 752 (kyua), jid 0, uid 0, was killed: out of swap space
Killed
+ rc=137
+ set -e
+ [ 137 -ne 0 ]
+ [ 137 -ne 1 ]
+ exit 137
+ tar cvf /dev/vtbd1 -C /meta .
a .
a ./run-kyua.sh
a ./disable-dtrace-tests.sh
a ./run.sh
a ./auto-shutdown
a ./disable-notyet-tests.sh
a ./disable-zfs-tests.sh
+ [ -f /meta/auto-shutdown ]
+ uname -p
+ shutdown -p now
Shutdown NOW!
shutdown: [pid 72601]
+ echo .
.
+ _return=0
+ [ 0 -ne 0 ]
+ return 0
+ _run_rc_postcmd
+ [ -n '' ]
+ return 0
+ return 0
2021-12-06T19:50:44.420395+00:00 - shutdown 72601 - - power-down by root: 

System shutdown time has arrived
2021-12-06T19:50:44.424641+00:00 - auditd 679 - - auditd_wait_for_events: SIGTERM
2021-12-06T19:50:44.426937+00:00 - auditd 679 - - Auditing disabled
2021-12-06T19:50:44.429102+00:00 - auditd 679 - - renamed /var/audit/20211206185810.not_terminated to /var/audit/20211206185810.20211206195044
2021-12-06T19:50:44.431499+00:00 - auditd 679 - - Finished
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop... 
Syncing disks, vnodes remaining... 0 0 done
Waiting (max 60 seconds) for system thread `bufdaemon' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-0' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-1' to stop... done
All buffers synced.
Uptime: 52m42s
lock order reversal:
 1st 0xffffffff81f9dba0 cc_list (cc_list, rw) @ /usr/src/sys/netinet/cc/cc.c:245
 2nd 0xffffffff81f9d420 vnet_rwlock (vnet_rwlock, rw) @ /usr/src/sys/netinet/cc/cc.c:208
lock order cc_list -> vnet_rwlock attempted at:
#0 0xffffffff80c6e0fd at witness_checkorder+0xbdd
#1 0xffffffff80bf8dd2 at __rw_rlock_int+0x82
#2 0xffffffff80dd3473 at cc_deregister_algo+0x113
#3 0xffffffff80dd3a2a at cc_modevent+0x1a
#4 0xffffffff80bd8beb at module_shutdown+0x6b
#5 0xffffffff80bfd95e at kern_reboot+0x4de
#6 0xffffffff80bfd428 at sys_reboot+0x3a8
#7 0xffffffff810bd72e at amd64_syscall+0x12e
#8 0xffffffff8108e88b at fast_syscall_common+0xf8
acpi0: Powering system off
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-20013' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run-kyua.sh
x ./disable-dtrace-tests.sh
x ./run.sh
x ./auto-shutdown
x ./disable-notyet-tests.sh
x ./disable-zfs-tests.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins6066378944352136630.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '7e0bba4d8083b6fac71180681b51aee9ed5fb664', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../7e0bba4d8083b6fac71180681b51aee9ed5fb664/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address