FreeBSD-main-amd64-test - Build #24420 - Still Failing

Reply: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #24421 - Still Failing"
In reply to: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #24419 - Failure"
Go to: [ bottom of page ] [ top of archives ] [ this month ]
From: <jenkins-admin_at_FreeBSD.org>
Date: Tue, 21 Nov 2023 13:58:05 UTC
FreeBSD-main-amd64-test - Build #24420 (fb51ddb20d57a43d666508e600af1bc7ac85c4e8) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24420/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24420/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24420/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

6c6fae6fae5547482a9b6160125be4ce66ee8216 by noreply:
Fix memory leak in zfs_setprocinit code

92dc4ad83d95b88c87b03682f50bbbde20513244 by noreply:
Consider `dnode_t` allocations in dbuf cache size accounting

22c8c33a588d08a58b4808bbc69c32123fd72a6d by noreply:
Use abd_zero_off() where applicable

5a3bffab10799c832292366cbe018c01c031ddff by noreply:
ZIO: Optimize zio_flush()

cd67bc0ae470776b8bb6949a689822c4b9acbe35 by noreply:
freebsd: remove __FBSDID macro use

a94860a6dee1c07bb96ee36dafcba40b804560cc by noreply:
ZTS: Fix 'could not unmount datasets' on Alma 9 (#15542)

db94e7c3f9a2344958667e756015393ad3124b3e by brooks:
vis: relocate _DIAGASSERT() define

ea2be8ed283597062853935a5a29dfd67973044b by brooks:
Remove __FBSDID from netbsd libc sources

bbde5c0725a5b34c456b3818cc69d17f22cef9f8 by brooks:
pf: Remove __FBSDID() macro use

fb51ddb20d57a43d666508e600af1bc7ac85c4e8 by rew:
bhyve: increase fbuf display resolution limit



The end of the build log:

Started by upstream project "FreeBSD-main-amd64-testvm" build number 26074
originally caused by:
 Started by upstream project "FreeBSD-main-amd64-build" build number 27657
 originally caused by:
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
  Started by an SCM change
Running as SYSTEM
[EnvInject] - Loading node environment variables.
[EnvInject] - Preparing an environment for the build.
[EnvInject] - Keeping Jenkins system variables.
[EnvInject] - Keeping Jenkins build variables.
[EnvInject] - Injecting as environment variables the properties content 
LINK_TYPE=latest_tested
FBSD_TARGET_ARCH=amd64
FBSD_TARGET=amd64
FBSD_BRANCH=main

[EnvInject] - Variables injected successfully.
[EnvInject] - Injecting contributions.
Building remotely on lancelot.nyi.freebsd.org (vmhost_qemu vmhost_bhyve image_builder) in workspace /jenkins/workspace/FreeBSD-main-amd64-test
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://git.freebsd.org/src.git
 > git init /jenkins/workspace/FreeBSD-main-amd64-test/src # timeout=10
Using reference repository: /home/git/src.git
Fetching upstream changes from https://git.freebsd.org/src.git
 > git --version # timeout=10
 > git --version # 'git version 2.41.0'
Setting http proxy: proxy.nyi.FreeBSD.org:3128
 > git fetch --tags --force --progress -- https://git.freebsd.org/src.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://git.freebsd.org/src.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
Avoid second fetch
Checking out Revision fb51ddb20d57a43d666508e600af1bc7ac85c4e8 (refs/remotes/origin/main)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f fb51ddb20d57a43d666508e600af1bc7ac85c4e8 # timeout=10
Commit message: "bhyve: increase fbuf display resolution limit"
 > git rev-list --no-walk bbbd7aab1bed9122e7137ee0957d50c9ef22b315 # timeout=10
Checking for pre-build
Executing pre-build step
Checking if email needs to be generated
No emails were triggered.
Checking for pre-build
Executing pre-build step
Checking if email needs to be generated
No emails were triggered.
Checking for pre-build
Executing pre-build step
Checking if email needs to be generated
No emails were triggered.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins11806563020444993321.sh
+ rm -fr freebsd-ci
+ git clone '--depth=1' --single-branch -b master https://github.com/freebsd/freebsd-ci.git
Cloning into 'freebsd-ci'...
+ cd freebsd-ci
+ git rev-parse HEAD
823549f8f63f75ecaa86f9a40940160f982be6a1
+ cd ..
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins11569365008597564122.sh
+ sh -ex freebsd-ci/jobs/FreeBSD-main-amd64-test/build.sh
+ export 'TARGET=amd64'
+ export 'TARGET_ARCH=amd64'
+ export 'USE_TEST_SUBR=
disable-dtrace-tests.sh
disable-zfs-tests.sh
disable-notyet-tests.sh
run-kyua.sh
'
+ sh -x freebsd-ci/scripts/test/run-tests.sh
+ SSL_CA_CERT_FILE=/usr/local/share/certs/ca-root-nss.crt
+ [ -z fb51ddb20d57a43d666508e600af1bc7ac85c4e8 ]
+ KERNCONF=GENERIC
+ ARTIFACT_SERVER=artifact.ci.freebsd.org
+ ARTIFACT_SUBDIR=snapshot/main/fb51ddb20d57a43d666508e600af1bc7ac85c4e8/amd64/amd64
+ [ GENERIC '=' GENERIC ]
+ IMG_NAME=disk-test.img
+ JOB_DIR=freebsd-ci/jobs/FreeBSD-main-amd64-test
+ dirname freebsd-ci/scripts/test/run-tests.sh
+ TEST_BASE=freebsd-ci/scripts/test
+ TIMEOUT_MS=14400000
+ TIMEOUT=14400
+ TIMEOUT_EXPECT=14340
+ TIMEOUT_VM=14220
+ : 2
+ : 8192m
+ EXTRA_DISK_NUM=5
+ BHYVE_EXTRA_DISK_PARAM=''
+ METADIR=meta
+ METAOUTDIR=meta-out
+ fetch https://artifact.ci.freebsd.org/snapshot/main/fb51ddb20d57a43d666508e600af1bc7ac85c4e8/amd64/amd64/disk-test.img.zst
disk-test.img.zst                                     1445 MB  108 MBps    13s
+ zstd --rm -fd disk-test.img.zst
disk-test.img.zst    : 0 MB...     disk-test.img.zst    : 635 MB...     disk-test.img.zst    : 1083 MB...     disk-test.img.zst    : 1196 MB...     disk-test.img.zst    : 1309 MB...     disk-test.img.zst    : 1413 MB...     disk-test.img.zst    : 1523 MB...     disk-test.img.zst    : 1615 MB...     disk-test.img.zst    : 1731 MB...     disk-test.img.zst    : 1823 MB...     disk-test.img.zst    : 2005 MB...     disk-test.img.zst    : 2088 MB...     disk-test.img.zst    : 2180 MB...     disk-test.img.zst    : 2272 MB...     disk-test.img.zst    : 2370 MB...     disk-test.img.zst    : 2470 MB...     disk-test.img.zst    : 2564 MB...     disk-test.img.zst    : 2653 MB...     disk-test.img.zst    : 2729 MB...     disk-test.img.zst    : 2805 MB...     disk-test.img.zst    : 2885 MB...     disk-test.img.zst    : 2889 MB...     disk-test.img.zst    : 2946 MB...     disk-test.img.zst    : 3022 MB...     disk-test.img.zst    : 3093 MB...     disk-test.img.zst    : 3182 MB...     disk-test.img.zst    : 3255 MB...     disk-test.img.zst    : 3331 MB...     disk-test.img.zst    : 3416 MB...     disk-test.img.zst    : 3440 MB...     disk-test.img.zst    : 3516 MB...     disk-test.img.zst    : 3615 MB...     disk-test.img.zst    : 3704 MB...     disk-test.img.zst    : 3820 MB...     disk-test.img.zst    : 3923 MB...     disk-test.img.zst    : 4015 MB...     disk-test.img.zst    : 4089 MB...     disk-test.img.zst    : 4203 MB...     disk-test.img.zst    : 4288 MB...     disk-test.img.zst    : 4375 MB...     disk-test.img.zst    : 4468 MB...     disk-test.img.zst    : 4591 MB...     disk-test.img.zst    : 4731 MB...     disk-test.img.zst    : 4842 MB...     disk-test.img.zst    : 4902 MB...     disk-test.img.zst    : 5000 MB...     disk-test.img.zst    : 5099 MB...     disk-test.img.zst    : 5199 MB...     disk-test.img.zst    : 5292 MB...     disk-test.img.zst    : 5382 MB...     disk-test.img.zst    : 5479 MB...     disk-test.img.zst    : 5554 MB...     disk-test.img.zst    : 5635 MB...     disk-test.img.zst    : 5710 MB...     disk-test.img.zst    : 5793 MB...     disk-test.img.zst    : 5834 MB...     disk-test.img.zst    : 5888 MB...     disk-test.img.zst    : 5961 MB...     disk-test.img.zst    : 6026 MB...     disk-test.img.zst    : 6126 MB...     disk-test.img.zst    : 6204 MB...     disk-test.img.zst    : 6822 MB...     disk-test.img.zst    : 7438 MB...     disk-test.img.zst    : 8071 MB...     disk-test.img.zst    : 8695 MB...                                                                                    disk-test.img.zst   : 9663741440 bytes 
+ truncate -s 128m disk-cam
+ BHYVE_EXTRA_DISK_PARAM=' -s 4:0,ahci-hd,disk-cam'
+ jot 5
+ truncate -s 128m disk1
+ BHYVE_EXTRA_DISK_PARAM=' -s 4:0,ahci-hd,disk-cam -s 5:0,virtio-blk,disk1'
+ truncate -s 128m disk2
+ BHYVE_EXTRA_DISK_PARAM=' -s 4:0,ahci-hd,disk-cam -s 5:0,virtio-blk,disk1 -s 6:0,virtio-blk,disk2'
+ truncate -s 128m disk3
+ BHYVE_EXTRA_DISK_PARAM=' -s 4:0,ahci-hd,disk-cam -s 5:0,virtio-blk,disk1 -s 6:0,virtio-blk,disk2 -s 7:0,virtio-blk,disk3'
+ truncate -s 128m disk4
+ BHYVE_EXTRA_DISK_PARAM=' -s 4:0,ahci-hd,disk-cam -s 5:0,virtio-blk,disk1 -s 6:0,virtio-blk,disk2 -s 7:0,virtio-blk,disk3 -s 8:0,virtio-blk,disk4'
+ truncate -s 128m disk5
+ BHYVE_EXTRA_DISK_PARAM=' -s 4:0,ahci-hd,disk-cam -s 5:0,virtio-blk,disk1 -s 6:0,virtio-blk,disk2 -s 7:0,virtio-blk,disk3 -s 8:0,virtio-blk,disk4 -s 9:0,virtio-blk,disk5'
+ rm -fr meta
+ mkdir meta
+ cp -R freebsd-ci/jobs/FreeBSD-main-amd64-test/meta/ meta/
+ cp freebsd-ci/scripts/test/subr/disable-dtrace-tests.sh meta/
+ cp freebsd-ci/scripts/test/subr/disable-zfs-tests.sh meta/
+ cp freebsd-ci/scripts/test/subr/disable-notyet-tests.sh meta/
+ cp freebsd-ci/scripts/test/subr/run-kyua.sh meta/
+ touch meta/auto-shutdown
+ sh -ex freebsd-ci/scripts/test/create-meta.sh
+ rm -f meta.tar
+ truncate -s 512M meta.tar
+ tar rvf meta.tar -C meta .
a .
a ./disable-notyet-tests.sh
a ./run.sh
a ./disable-zfs-tests.sh
a ./auto-shutdown
a ./run-kyua.sh
a ./disable-dtrace-tests.sh
+ echo main
+ sed -e 's,.*-,,'
+ FBSD_BRANCH_SHORT=main
+ TEST_VM_NAME=testvm-main-amd64-24420
+ [ '' '=' 1 ]
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-24420' --destroy
vm_open: testvm-main-amd64-24420 could not be opened: No such file or directory
+ true
+ sudo /usr/sbin/bhyveload -c stdio -m 8192m -d disk-test.img testvm-main-amd64-24420
Consoles: userboot  

FreeBSD/amd64 User boot lua, Revision 1.2
(Wed Jun  7 08:49:12 UTC 2023 root@build-13.freebsd.org)
|/-\|Loading /boot/defaults/loader.conf
Loading /boot/defaults/loader.conf
Loading /boot/device.hints
/Loading /boot/loader.conf
Loading /boot/loader.conf.local
-\c|/[H[J[7;48H  [31m```                        [31;1m`[31m[8;48H s` `.....---...[31;1m....--.```   -/[31m[9;48H +o   .--`         [31;1m/y:`      +.[31m[10;48H  yo`:.            [31;1m:o      `+-[31m[11;48H   y/               [31;1m-/`   -o/[31m[12;48H  .-                  [31;1m::/sy+:.[31m[13;48H  /                     [31;1m`--  /[31m[14;48H `:                          [31;1m:`[31m[15;48H `:                          [31;1m:`[31m[16;48H  /                          [31;1m/[31m[17;48H  .-                        [31;1m-.[31m[18;48H   --                      [31;1m-.[31m[19;48H    `:`                  [31;1m`:`[20;48H      [31;1m.--             `--.[21;48H         .---.....----.[m[1;2H  ______               ____   _____ _____  [2;2H |  ____|             |  _ \ / ____|  __ \ [3;2H | |___ _ __ ___  ___ | |_) | (___ | |  | |[4;2H |  ___| '__/ _ \/ _ \|  _ < \___ \| |  | |[5;2H | |   | | |  __/  __/| |_) |____) | |__| |[6;2H | |   | | |    |    ||     |      |      |[7;2H |_|   |_|  \___|\___||____/|_____/|_____/ [9;2H+[22;2H+[9;44H+[22;44H+[9;3H-----------------------------------------[22;3H-----------------------------------------[10;2H|[10;44H|[11;2H|[11;44H|[12;2H|[12;44H|[13;2H|[13;44H|[14;2H|[14;44H|[15;2H|[15;44H|[16;2H|[16;44H|[17;2H|[17;44H|[18;2H|[18;44H|[19;2H|[19;44H|[20;2H|[20;44H|[21;2H|[21;44H|[9;13H Welcome to FreeBSD [11;5H1. [1mB[22moot Multi user [1m[Enter][22m[12;5H2. Boot [1mS[22mingle user[13;5H3. [1mEsc[22mape to loader prompt[14;5H4. [1mR[22meboot[15;5H5. [1mC[22mons: Serial[16;5H[17;5HOptions:[18;5H-\|/-\|/-\|6. [1mK[22mernel: default/[32mkernel[39m (1 of 1)[19;5H7. Boot [1mO[22mptions[25;0H[23;4HAutoboot in 1 seconds. [Space] to pause 
[25;0H[23;4HAutoboot in 0 seconds. [Space] to pause 
[25;0HLoading kernel...
/-/boot/kernel/kernel text=0x17ed50 \text=0xdb2e50 |/-\|/-text=0x4753f4 \|data=0x180 data=0x1905b0+0x46ea50 /0x8+0x196698-+0x8+0x1ba8ac\
Loading configured modules...
can't find '/etc/hostid'
|/boot/entropy size=0x1000
/-/boot/kernel/mac_bsdextended.ko size 0x61f0 at 0x1f52000
\+ set +e
+ expect -c $'set timeout 14340; \t\tspawn sudo /usr/bin/timeout -k 60 14220 /usr/sbin/bhyve \t\t-c 2 -m 8192m -A -H -P \t\t-s 0:0,hostbridge \t\t-s 1:0,lpc \t\t-s 2:0,virtio-blk,disk-test.img \t\t-s 3:0,virtio-blk,meta.tar \t\t -s 4:0,ahci-hd,disk-cam -s 5:0,virtio-blk,disk1 -s 6:0,virtio-blk,disk2 -s 7:0,virtio-blk,disk3 -s 8:0,virtio-blk,disk4 -s 9:0,virtio-blk,disk5 \t\t-l com1,stdio \t\ttestvm-main-amd64-24420; \t\texpect { eof }'
spawn sudo /usr/bin/timeout -k 60 14220 /usr/sbin/bhyve -c 2 -m 8192m -A -H -P -s 0:0,hostbridge -s 1:0,lpc -s 2:0,virtio-blk,disk-test.img -s 3:0,virtio-blk,meta.tar -s 4:0,ahci-hd,disk-cam -s 5:0,virtio-blk,disk1 -s 6:0,virtio-blk,disk2 -s 7:0,virtio-blk,disk3 -s 8:0,virtio-blk,disk4 -s 9:0,virtio-blk,disk5 -l com1,stdio testvm-main-amd64-24420
GDB: no debug ports present
KDB: debugger backends: ddb
KDB: current backend: ddb
---<<BOOT>>---
panic: running without device atpic requires a local APIC
cpuid = 0
time = 1
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffffff8215fdf0
vpanic() at vpanic+0x132/frame 0xffffffff8215ff20
panic() at panic+0x43/frame 0xffffffff8215ff80
apic_init() at apic_init+0xfc/frame 0xffffffff8215ffa0
mi_startup() at mi_startup+0x1c8/frame 0xffffffff8215fff0
KDB: enter: panic
[ thread pid 0 tid 0 ]
Stopped at      kdb_enter+0x32: movq    $0,0xe2abf3(%rip)
db> + rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-24420' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-notyet-tests.sh
x ./run.sh
x ./disable-zfs-tests.sh
x ./auto-shutdown
x ./run-kyua.sh
x ./disable-dtrace-tests.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins5395572570759112295.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'fb51ddb20d57a43d666508e600af1bc7ac85c4e8', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../fb51ddb20d57a43d666508e600af1bc7ac85c4e8/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address