FreeBSD-main-amd64-test - Build #20010 - Still Failing

FreeBSD-main-amd64-test - Build #20010 (9c612a5d0af17021abc6e1bb2a8baa5a4c97d05f) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20010/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20010/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20010/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

9c612a5d0af17021abc6e1bb2a8baa5a4c97d05f by avg:
vmxnet3: skip zero-length descriptor in the middle of a packet



The end of the build log:

[...truncated 4.23 MB...]
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9b9dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9b9de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9b9e20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9b9ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d9b9ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9b9f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9b9f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 19994 tid 100137 td 0xfffffe00a70b4020
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9b4dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9b4de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9b4e20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9b4ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d9b4ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9b4f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9b4f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 19994 tid 100138 td 0xfffffe00a70b3900
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9afdc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9afde0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9afe20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9afec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d9afef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9aff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9aff30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 19994 tid 100139 td 0xfffffe00a70b31e0
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9aadc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9aade0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9aae20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9aaec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d9aaef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9aaf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9aaf30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 19994 tid 100140 td 0xfffffe00a70b2ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9a5dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9a5de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9a5e20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9a5ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d9a5ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9a5f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9a5f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 19994 tid 100141 td 0xfffffe00a70b23a0
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9a0dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9a0de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9a0e20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9a0ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d9a0ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9a0f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9a0f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 19994 tid 100142 td 0xfffffe00a70b1c80
sched_switch() at sched_switch+0x559/frame 0xfffffe009d99bdc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d99bde0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d99be20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d99bec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d99bef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d99bf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d99bf30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 19994 tid 100143 td 0xfffffe00a7172900
sched_switch() at sched_switch+0x559/frame 0xfffffe009d996dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d996de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d996e20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d996ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d996ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d996f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d996f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 19994 tid 100144 td 0xfffffe00a71721e0
sched_switch() at sched_switch+0x559/frame 0xfffffe009d991dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d991de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d991e20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d991ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d991ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d991f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d991f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 19994 tid 100145 td 0xfffffe00a7171ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe009d98cdc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d98cde0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d98ce20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d98cec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d98cef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d98cf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d98cf30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 19994 tid 100146 td 0xfffffe00a71713a0
sched_switch() at sched_switch+0x559/frame 0xfffffe009d987dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d987de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d987e20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d987ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d987ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d987f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d987f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 19994 tid 100147 td 0xfffffe00a7170c80
sched_switch() at sched_switch+0x559/frame 0xfffffe009d982dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d982de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d982e20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d982ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d982ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d982f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d982f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 19994 tid 100148 td 0xfffffe00a7170560
sched_switch() at sched_switch+0x559/frame 0xfffffe009d97dc20
mi_switch() at mi_switch+0x157/frame 0xfffffe009d97dc40
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d97dc80
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe009d97dcc0
_cv_timedwait_sbt() at _cv_timedwait_sbt+0x19a/frame 0xfffffe009d97dd40
l2arc_feed_thread() at l2arc_feed_thread+0x274/frame 0xfffffe009d97def0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d97df30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d97df30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 19994 tid 100149 td 0xfffffe00a716fe40
sched_switch() at sched_switch+0x559/frame 0xfffffe009d978dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d978de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d978e20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d978ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d978ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d978f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d978f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 19994 tid 100150 td 0xfffffe00a716f720
sched_switch() at sched_switch+0x559/frame 0xfffffe009d973cc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d973ce0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d973d20
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe009d973d70
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe009d973d80
_cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe009d973de0
zfs_zevent_wait() at zfs_zevent_wait+0x47/frame 0xfffffe009d973e00
sysevent_worker() at sysevent_worker+0x49/frame 0xfffffe009d973ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d973f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d973f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command atf-check pid 44572 tid 102072 td 0xfffffe00a8818000
sched_switch() at sched_switch+0x559/frame 0xfffffe00acf2ea10
mi_switch() at mi_switch+0x157/frame 0xfffffe00acf2ea30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00acf2ea70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00acf2eac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00acf2ead0
_sleep() at _sleep+0x2dd/frame 0xfffffe00acf2eb70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00acf2ec00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00acf2ee00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00acf2ef30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00acf2ef30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x3134bb5d563a, rsp = 0x7fffffcffb08, rbp = 0x7fffffcffb40 ---

Tracing command ping6 pid 44573 tid 100096 td 0xfffffe00767d0560
sched_switch() at sched_switch+0x559/frame 0xfffffe0063bc7a20
mi_switch() at mi_switch+0x157/frame 0xfffffe0063bc7a40
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063bc7a80
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063bc7ad0
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0063bc7b10
_cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe0063bc7b90
kern_select() at kern_select+0xa6f/frame 0xfffffe0063bc7d80
sys_pselect() at sys_pselect+0x127/frame 0xfffffe0063bc7e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063bc7f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063bc7f30
--- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0xe5ce25e841a, rsp = 0x7fffff251a78, rbp = 0x7fffff2544f0 ---

Tracing command ping6 pid 44576 tid 101868 td 0xfffffe00a7b69c80
sched_switch() at sched_switch+0x559/frame 0xfffffe00a73e4ab0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a73e4ad0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a73e4b10
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00a73e4b60
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00a73e4b70
_cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe00a73e4bd0
kern_select() at kern_select+0xa95/frame 0xfffffe00a73e4dc0
sys_select() at sys_select+0x56/frame 0xfffffe00a73e4e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00a73e4f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00a73e4f30
--- syscall (93, FreeBSD ELF64, sys_select), rip = 0xe5ce25e84da, rsp = 0x7fffff2517f8, rbp = 0x7fffff2518b0 ---

Tracing command aiod2 pid 20002 tid 100111 td 0xfffffe009db87020
sched_switch() at sched_switch+0x559/frame 0xfffffe00765e4d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00765e4d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00765e4dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00765e4e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00765e4ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00765e4ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00765e4f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00765e4f30
--- trap 0xc, rip = 0x195e148b009a, rsp = 0x7fffffe098e8, rbp = 0x7fffffe09900 ---
db:0:kdb.enter.panic> dump

Dump failed. Partition too small (about 2845MB were needed this time).
Cannot dump: unknown error (error=7).
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-20010' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run-kyua.sh
x ./disable-notyet-tests.sh
x ./run.sh
x ./disable-zfs-tests.sh
x ./disable-dtrace-tests.sh
x ./auto-shutdown
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins9204484429886612644.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '9c612a5d0af17021abc6e1bb2a8baa5a4c97d05f', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../9c612a5d0af17021abc6e1bb2a8baa5a4c97d05f/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address