FreeBSD-main-amd64-test - Build #19785 - Still Failing

FreeBSD-main-amd64-test - Build #19785 (b39a93b18ef17dcb1897186b1f01999337b9f8b9) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19785/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19785/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19785/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

b39a93b18ef17dcb1897186b1f01999337b9f8b9 by osa:
ktls.4: fix openssl-devel port name



The end of the build log:

[...truncated 4.10 MB...]
fork_exit() at fork_exit+0x80/frame 0xfffffe00a70c7f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a70c7f30
--- trap 0xc, rip = 0x8011ecbba, rsp = 0x7fffc8741f48, rbp = 0x7fffc8741f60 ---

Tracing command zfskern pid 58002 tid 100592 td 0xfffffe00a6b05e40
sched_switch() at sched_switch+0x578/frame 0xfffffe00a70bddc0
mi_switch() at mi_switch+0x155/frame 0xfffffe00a70bdde0
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00a70bde20
_sleep() at _sleep+0x29e/frame 0xfffffe00a70bdec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a70bdef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a70bdf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a70bdf30
--- trap 0xc, rip = 0x8011ecbba, rsp = 0x7fffc833ff48, rbp = 0x7fffc833ff60 ---

Tracing command zfskern pid 58002 tid 100593 td 0xfffffe00a6b2b900
sched_switch() at sched_switch+0x578/frame 0xfffffe00a70fedc0
mi_switch() at mi_switch+0x155/frame 0xfffffe00a70fede0
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00a70fee20
_sleep() at _sleep+0x29e/frame 0xfffffe00a70feec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a70feef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a70fef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a70fef30
--- trap 0xc, rip = 0x8011ecbba, rsp = 0x7fffc9d4cf48, rbp = 0x7fffc9d4cf60 ---

Tracing command zfskern pid 58002 tid 100594 td 0xfffffe00a6b11900
sched_switch() at sched_switch+0x578/frame 0xfffffe00a70f4dc0
mi_switch() at mi_switch+0x155/frame 0xfffffe00a70f4de0
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00a70f4e20
_sleep() at _sleep+0x29e/frame 0xfffffe00a70f4ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a70f4ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a70f4f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a70f4f30
--- trap 0xc, rip = 0x8011ecbba, rsp = 0x7fffc994af48, rbp = 0x7fffc994af60 ---

Tracing command zfskern pid 58002 tid 100595 td 0xfffffe00a6b073a0
sched_switch() at sched_switch+0x578/frame 0xfffffe00a70eadc0
mi_switch() at mi_switch+0x155/frame 0xfffffe00a70eade0
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00a70eae20
_sleep() at _sleep+0x29e/frame 0xfffffe00a70eaec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a70eaef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a70eaf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a70eaf30
--- trap 0xc, rip = 0x8011ecbba, rsp = 0x7fffc9548f48, rbp = 0x7fffc9548f60 ---

Tracing command zfskern pid 58002 tid 100596 td 0xfffffe00a6b1fe40
sched_switch() at sched_switch+0x578/frame 0xfffffe00a70e0dc0
mi_switch() at mi_switch+0x155/frame 0xfffffe00a70e0de0
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00a70e0e20
_sleep() at _sleep+0x29e/frame 0xfffffe00a70e0ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a70e0ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a70e0f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a70e0f30
--- trap 0xc, rip = 0x8011ecbba, rsp = 0x7fffc9146f48, rbp = 0x7fffc9146f60 ---

Tracing command zfskern pid 58002 tid 100597 td 0xfffffe00a6a593a0
sched_switch() at sched_switch+0x578/frame 0xfffffe00a70d6dc0
mi_switch() at mi_switch+0x155/frame 0xfffffe00a70d6de0
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00a70d6e20
_sleep() at _sleep+0x29e/frame 0xfffffe00a70d6ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a70d6ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a70d6f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a70d6f30
--- trap 0xc, rip = 0x8011ecbba, rsp = 0x7fffc8d44f48, rbp = 0x7fffc8d44f60 ---

Tracing command zfskern pid 58002 tid 100598 td 0xfffffe00a6a61c80
sched_switch() at sched_switch+0x578/frame 0xfffffe00a70ccdc0
mi_switch() at mi_switch+0x155/frame 0xfffffe00a70ccde0
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00a70cce20
_sleep() at _sleep+0x29e/frame 0xfffffe00a70ccec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a70ccef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a70ccf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a70ccf30
--- trap 0xc, rip = 0x8011ecbba, rsp = 0x7fffc8942f48, rbp = 0x7fffc8942f60 ---

Tracing command zfskern pid 58002 tid 100599 td 0xfffffe00a6b0ee40
sched_switch() at sched_switch+0x578/frame 0xfffffe00a70c2dc0
mi_switch() at mi_switch+0x155/frame 0xfffffe00a70c2de0
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00a70c2e20
_sleep() at _sleep+0x29e/frame 0xfffffe00a70c2ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a70c2ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a70c2f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a70c2f30
--- trap 0xc, rip = 0x8011ecbba, rsp = 0x7fffc8540f48, rbp = 0x7fffc8540f60 ---

Tracing command zfskern pid 58002 tid 100600 td 0xfffffe00a6b2c020
sched_switch() at sched_switch+0x578/frame 0xfffffe00a70b8dc0
mi_switch() at mi_switch+0x155/frame 0xfffffe00a70b8de0
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00a70b8e20
_sleep() at _sleep+0x29e/frame 0xfffffe00a70b8ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a70b8ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a70b8f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a70b8f30
--- trap 0xc, rip = 0x8011ecbba, rsp = 0x7fffc813ef48, rbp = 0x7fffc813ef60 ---

Tracing command zfskern pid 58002 tid 100601 td 0xfffffe00a6a5b020
sched_switch() at sched_switch+0x578/frame 0xfffffe00a6ca9c20
mi_switch() at mi_switch+0x155/frame 0xfffffe00a6ca9c40
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00a6ca9c80
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a6ca9cc0
_cv_timedwait_sbt() at _cv_timedwait_sbt+0x19b/frame 0xfffffe00a6ca9d40
l2arc_feed_thread() at l2arc_feed_thread+0x274/frame 0xfffffe00a6ca9ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6ca9f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6ca9f30
--- trap 0xc, rip = 0x8011f0bba, rsp = 0x7fffdfffdf48, rbp = 0x7fffdfffdf60 ---

Tracing command zfskern pid 58002 tid 100602 td 0xfffffe00a6b103a0
sched_switch() at sched_switch+0x578/frame 0xfffffe00a6c27dc0
mi_switch() at mi_switch+0x155/frame 0xfffffe00a6c27de0
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00a6c27e20
_sleep() at _sleep+0x29e/frame 0xfffffe00a6c27ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a6c27ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6c27f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6c27f30
--- trap 0xc, rip = 0x8011f0bba, rsp = 0x7fffdfffdf48, rbp = 0x7fffdfffdf60 ---

Tracing command zfskern pid 58002 tid 100603 td 0xfffffe00a6b07ac0
sched_switch() at sched_switch+0x578/frame 0xfffffe009d9c5cc0
mi_switch() at mi_switch+0x155/frame 0xfffffe009d9c5ce0
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe009d9c5d20
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe009d9c5d70
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe009d9c5d80
_cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe009d9c5de0
zfs_zevent_wait() at zfs_zevent_wait+0x47/frame 0xfffffe009d9c5e00
sysevent_worker() at sysevent_worker+0x49/frame 0xfffffe009d9c5ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9c5f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9c5f30
--- trap 0xc, rip = 0x8011f0bba, rsp = 0x7fffdfffdf48, rbp = 0x7fffdfffdf60 ---

Tracing command sh pid 664 tid 100108 td 0xfffffe00779aa020
sched_switch() at sched_switch+0x578/frame 0xfffffe00a5d8fa10
mi_switch() at mi_switch+0x155/frame 0xfffffe00a5d8fa30
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00a5d8fa70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00a5d8fac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00a5d8fad0
_sleep() at _sleep+0x294/frame 0xfffffe00a5d8fb70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00a5d8fc00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00a5d8fe00
amd64_syscall() at amd64_syscall+0x5cd/frame 0xfffffe00a5d8ff30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00a5d8ff30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80120a15a, rsp = 0x7fffffffe7f8, rbp = 0x7fffffffe8a0 ---

Tracing command kyua pid 665 tid 100113 td 0xfffffe009daffac0
sched_switch() at sched_switch+0x578/frame 0xfffffe00777f3a10
mi_switch() at mi_switch+0x155/frame 0xfffffe00777f3a30
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00777f3a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00777f3ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00777f3ad0
_sleep() at _sleep+0x294/frame 0xfffffe00777f3b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00777f3c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00777f3e00
amd64_syscall() at amd64_syscall+0x5cd/frame 0xfffffe00777f3f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00777f3f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80154815a, rsp = 0x7fffffffdc58, rbp = 0x7fffffffdc90 ---

Tracing command KTLS pid 7201 tid 100115 td 0xfffffe009dafec80
sched_switch() at sched_switch+0x578/frame 0xfffffe00777e9d00
mi_switch() at mi_switch+0x155/frame 0xfffffe00777e9d20
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00777e9d60
_sleep() at _sleep+0x29e/frame 0xfffffe00777e9e00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00777e9ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00777e9f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00777e9f30
--- trap 0xc, rip = 0x801209bba, rsp = 0x7fffffffe838, rbp = 0x7fffffffe930 ---

Tracing command KTLS pid 7201 tid 101680 td 0xfffffe00a6a57000
sched_switch() at sched_switch+0x578/frame 0xfffffe00a6cb8d00
mi_switch() at mi_switch+0x155/frame 0xfffffe00a6cb8d20
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00a6cb8d60
_sleep() at _sleep+0x29e/frame 0xfffffe00a6cb8e00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00a6cb8ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6cb8f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6cb8f30
--- trap 0x16, rip = 0x801415bba, rsp = 0x7fffdfffda88, rbp = 0x7fffdfffdaa0 ---

Tracing command KTLS pid 7201 tid 101681 td 0xfffffe00a6a60e40
sched_switch() at sched_switch+0x578/frame 0xfffffe00a6cc7d40
mi_switch() at mi_switch+0x155/frame 0xfffffe00a6cc7d60
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00a6cc7da0
_sleep() at _sleep+0x29e/frame 0xfffffe00a6cc7e40
ktls_alloc_thread() at ktls_alloc_thread+0x204/frame 0xfffffe00a6cc7ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6cc7f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6cc7f30
--- trap 0x16, rip = 0x801415bba, rsp = 0x7fffdfbfba88, rbp = 0x7fffdfbfbaa0 ---

Tracing command ng_queue pid 11888 tid 100118 td 0xfffffe009dbc7ac0
sched_switch() at sched_switch+0x578/frame 0xfffffe0063bd9d80
mi_switch() at mi_switch+0x155/frame 0xfffffe0063bd9da0
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0063bd9de0
_sleep() at _sleep+0x29e/frame 0xfffffe0063bd9e80
ngthread() at ngthread+0x88/frame 0xfffffe0063bd9ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063bd9f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063bd9f30
--- trap 0xc, rip = 0x801209bba, rsp = 0x7fffffffe858, rbp = 0x7fffffffe950 ---

Tracing command ng_queue pid 11888 tid 101712 td 0xfffffe00a6b28000
sched_switch() at sched_switch+0x578/frame 0xfffffe009d9c0d80
mi_switch() at mi_switch+0x155/frame 0xfffffe009d9c0da0
sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe009d9c0de0
_sleep() at _sleep+0x29e/frame 0xfffffe009d9c0e80
ngthread() at ngthread+0x88/frame 0xfffffe009d9c0ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9c0f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9c0f30
--- trap 0xc, rip = 0x8011ecbba, rsp = 0x7fffde7f1f48, rbp = 0x7fffde7f1f60 ---
db:0:kdb.enter.panic> dump
Dumping 448 out of 4058 MB:..4%..11%..22%..33%..43%..54%..61%..72%..83%..93%
Dump complete
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-19785' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run-kyua.sh
x ./disable-dtrace-tests.sh
x ./auto-shutdown
x ./disable-notyet-tests.sh
x ./run.sh
x ./disable-zfs-tests.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins7004131290238021903.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'b39a93b18ef17dcb1897186b1f01999337b9f8b9', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../b39a93b18ef17dcb1897186b1f01999337b9f8b9/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address