FreeBSD-main-amd64-test - Build #22933 - Still Failing

From: <jenkins-admin_at_FreeBSD.org>
Date: Mon, 06 Feb 2023 21:35:45 UTC
FreeBSD-main-amd64-test - Build #22933 (f711d5c3d06677740dc04a0ced27b2bce894bae1) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/22933/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/22933/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/22933/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

6680cfe8e0eec4427716ab50d73ab8231dd9ab28 by des:
sha512_224: Fix SHA512_224_Final() on little-endian machines.

2768d7056727c414241ebc4b9d26e62dd5460760 by des:
libmd / md5: Add SHA-512/224.

2e828220579e3ada74ed0613871ec6ec61d669ba by emaste:
ssh: Be more paranoid with host/domain names coming from the

c079c82646e83454d3dac7228320b11bb3df5cdc by ambrisko:
enic: Cleanup module Makefile

1e6131bad6b47efbd35c5e7095637ed2aeaecd70 by jhibbits:
IfAPI: Add needed APIs for mbuf support

6472761966f78b364b370d61f452fedde0d19c8c by jhibbits:
IfAPI: use IfAPI in mbuf

a6c0f09aa35da3700fa600b2913d95759cc36fe1 by jhibbits:
ath(4) IfAPI fixups

47842ecfe01d19516d7197603e5949d4dbb3e558 by jhibbits:
Mechanically convert if_tsec(4) to IfAPI

3f14814f05b5085b408ea25ae0bca68f4603c0ea by jhibbits:
Mechanically convert ae(4) to IfAPI

76614fdc8c7b1a1a6f35471c91a247a91d70500c by jhibbits:
Mechanically convert iwi(4) and iwn(4) to IfAPI

2568cd2ae95a541c5d58e9efec29fbae146b69e3 by jhibbits:
Mechanically convert if_plip(4) to IfAPI

de17d6f9a6944dfc182ba538e0ec5a0a8c03284e by jhibbits:
Mechanically convert if_ti(4) to IfAPI

c0e5e270a5ddfa073c22e30a8d75f8860690d20a by jhibbits:
Mechanically convert if_bfe(4) to IfAPI

6712df3ab04ac5ccd4c4335e3df24f7f3a190ec1 by jhibbits:
Mechanically convert if_ste(4) to IfAPI

3486b835044be423439394dceadf8dfd536af8b4 by jhibbits:
Mechanically convert if_vte(4) to IfAPI

0d1025348b7ff181d01593a773ba289f4ddddf4f by jhibbits:
Mechanically convert if_vr(4) to IfAPI

ac8e2243b88c95642a5e3f409edc52a859938c00 by jhibbits:
Mechanically convert if_rl(4) to IfAPI

3ac0cb328ae31f194a1792f30e7eb5b03d0c1bb9 by jhibbits:
Mechanically convert if_vge(4) to IfAPI

7c509be1c6c3f689ca2d7c62731e6c5cc204f5b5 by jhibbits:
Mechanically convert if_et(4) to IfAPI

3fba06ad1342a0f374dc66dda6a5ca691a012e81 by jhibbits:
Mechanically convert sbni(4) to IfAPI

61c05f13d2d3eff2b8ca325cb3be99616aee5f6e by jhibbits:
Mechanically convert fwe(4) and fwip(4) to IfAPI

59dc03deec00347141ef8320b5e524276f252f2d by jhibbits:
Mechanically convert jme(4) to IfAPI

08e67568b0794e35c1c91a7b530a8d18bceb72f0 by jhibbits:
Mechanically convert lge(4) to IfAPI

1125d093632ea9efc73f2393ecee5ed3724441ee by jhibbits:
Mechanically convert sis(4) to IfAPI

8c259c504842638d4e69e1ab25b922eab1b3ee42 by jhibbits:
Mechanically convert smc(4) to IfAPI

ccfbf57f838a6b0e4b5f031282b4440f8b0cdb44 by jhibbits:
Mechanically convert sk(4) to IfAPI

df40efe17afb82398621cc31b907432bb6668bce by jhibbits:
Mechanically convert le(4) to IfAPI

0292389aca300090c674c85616084db079d8b200 by jhibbits:
Mechanically convert bce(4) to IfAPI

da247e0dac2f845d32560a5f60f09eb521a9c0b3 by jhibbits:
Mechanically convert ic(4) to IfAPI

5ab8c4b836c27f05e7ecd6c67c693c892a6275a0 by jhibbits:
Mechanically convert msk(4) to IfAPI

12d29e15684780c2dd65e38924c861a855837271 by jhibbits:
Mechanically convert if_my(4) to IfAPI

76cb2c1ce00e7dc0afa42d6cdcccb0b5f16dd90e by jhibbits:
Mechanically convert nge(4) to IfAPI

91f3f3fc712218b5daa96f3f18099474851e0c7e by jhibbits:
Mechanically convert dc(4) to IfAPI

bc14c73b7b9c8dc43675a24f7da2040e469db328 by jhibbits:
Mechanically convert al_eth(4) to IfAPI

524364126752a6986acdd9f2ecfff4cafd8bb439 by jhibbits:
Mechanically convert age(4), alc(4), and ale(4) to IfAPI

e948d066fa8232ff69aa608ffdcdf6f4526eab91 by jhibbits:
Mechanically convert sge(4) to IfAPI

93037a67bf4b734ad10dc867340ba3633c379a8d by jhibbits:
Mechanically convert mxge(4) to IfAPI

655d043b496e19e4e1463a12278a895d0d40b33d by jhibbits:
Remove gxemul drivers.

61593cb297023ac0fb226f3deb157ed63047d6a2 by jhibbits:
Remove Doxyfiles for recently removed drivers.

4a1c4de232af202aa5fa02c7adaa97174997ae61 by emaste:
Allow sysctl hw.machine/hw.machine_arch in capability mode

0e563bde48b1af6bd472e940f04a8d76315749ab by mhorne:
dtrace_asm.S: properly enter/exit user access

06faad1de2c9aadcfd606d5f7121b201dbfbaa9d by mhorne:
dtrace: handle page faults in riscv dtrace_trap()

38720107324b3903f342bcb0306c72c4e4235053 by mhorne:
dtrace: Fix RISC-V user stack unwinder

c6943b44f7d73176acd2e36e0615e1b2ded02c0a by mhorne:
dtrace: implement riscv dtrace_getustackdepth()

2166649fa1def0506f05a485919e277bf2a04a64 by mhorne:
libdtrace: drop remaining mips support

f711d5c3d06677740dc04a0ced27b2bce894bae1 by mhorne:
libdtrace: add riscv support



The end of the build log:

[...truncated 4.23 MB...]
lib/libc/sys/write_test:write_pipe  ->  passed  [0.004s]
lib/libc/sys/write_test:write_pos  ->  passed  [0.005s]
lib/libc/sys/write_test:write_ret  ->  passed  [0.005s]
lib/libc/sys/write_test:writev_iovmax  ->  passed  [0.004s]
lib/libc/termios/tcsetpgrp_test:tcsetpgrp_err  ->  passed  [0.005s]
lib/libc/time/mktime_test:localtime_r_gmt  ->  passed  [0.004s]
lib/libc/time/mktime_test:mktime_negyear  ->  passed  [0.004s]
lib/libc/time/mktime_test:timegm_epoch  ->  passed  [0.004s]
lib/libc/time/strptime_test:Zone  ->  passed  [0.005s]
lib/libc/time/strptime_test:common  ->  passed  [0.005s]
lib/libc/time/strptime_test:day  ->  passed  [0.004s]
lib/libc/time/strptime_test:hour  ->  passed  [0.004s]
lib/libc/time/strptime_test:month  ->  passed  [0.004s]
lib/libc/time/strptime_test:seconds  ->  passed  [0.004s]
lib/libc/time/strptime_test:year  ->  passed  [0.004s]
lib/libc/time/strptime_test:zone  ->  passed  [0.004s]
lib/libc/tls/tls_dlopen_test:t_tls_dlopen  ->  passed  [0.004s]
lib/libc/tls/tls_dynamic_test:t_tls_dynamic  ->  passed  [0.005s]
lib/libc/ttyio/ttyio_test:ioctl  ->  passed  [2.014s]
lib/libc/iconv/iconvctl_test:iconvctl_trivialp_test  ->  passed  [0.008s]
lib/libc/locale/btowc_test:btowc_test  ->  passed  [0.004s]
lib/libc/locale/c16rtomb_test:c16rtomb_c_locale_test  ->  passed  [0.005s]
lib/libc/locale/c16rtomb_test:c16rtomb_iso_8859_15_test  ->  passed  [0.005s]
lib/libc/locale/c16rtomb_test:c16rtomb_iso_8859_1_test  ->  passed  [0.005s]
lib/libc/locale/c16rtomb_test:c16rtomb_utf_8_test  ->  skipped: https://bugs.freebsd.org/265871  [0.004s]
lib/libc/locale/iswctype_test:iswctype_c_locale_test  ->  passed  [0.004s]
lib/libc/locale/iswctype_test:iswctype_euc_jp_test  ->  passed  [0.052s]
lib/libc/locale/mblen_test:mblen_test  ->  passed  [0.004s]
lib/libc/locale/mbrlen_test:mbrlen_test  ->  passed  [0.004s]
lib/libc/locale/mbrtoc16_test:mbrtoc16_c_locale_test  ->  passed  [0.005s]
lib/libc/locale/mbrtoc16_test:mbrtoc16_iso_8859_15_test  ->  passed  [0.004s]
lib/libc/locale/mbrtoc16_test:mbrtoc16_iso_8859_1_test  ->  passed  [0.005s]
lib/libc/locale/mbrtoc16_test:mbrtoc16_utf_8_test  ->  passed  [0.004s]
lib/libc/locale/mbrtowc_2_test:mbrtowc_test  ->  passed  [0.004s]
lib/libc/locale/mbrtowc_test:mbrtowc_internal  ->  passed  [0.005s]
lib/libc/locale/mbrtowc_test:mbrtowc_object  ->  passed  [0.004s]
lib/libc/locale/mbsnrtowcs_2_test:mbsnrtowcs_test  ->  passed  [0.005s]
lib/libc/locale/mbsnrtowcs_test:mbsnrtowcs  ->  passed  [0.004s]
lib/libc/locale/mbsrtowcs_test:mbsrtowcs_test  ->  passed  [0.004s]
lib/libc/locale/mbstowcs_2_test:mbstowcs_test  ->  passed  [0.004s]
lib/libc/locale/mbstowcs_test:mbstowcs_basic  ->  passed  [0.004s]
lib/libc/locale/mbtowc_2_test:mbtowc_test  ->  passed  [0.004s]
lib/libc/locale/mbtowc_test:mbtowc  ->  passed  [0.008s]
lib/libc/locale/towctrans_test:towctrans_test  ->  passed  [0.012s]
lib/libc/locale/wcrtomb_test:wcrtomb_test  ->  passed  [0.005s]
lib/libc/locale/wcscspn_test:wcscspn  ->  passed  [0.005s]
lib/libc/locale/wcsnrtombs_test:wcsnrtombs_test  ->  passed  [0.004s]
lib/libc/locale/wcspbrk_test:wcspbrk  ->  passed  [0.004s]
lib/libc/locale/wcsrtombs_test:wcsrtombs_test  ->  passed  [0.004s]
lib/libc/locale/wcsspn_test:wcsspn  ->  passed  [0.004s]
lib/libc/locale/wcstod_test:wcstod  ->  passed  [0.005s]
lib/libc/locale/wcstombs_test:wcstombs_test  ->  passed  [0.004s]
lib/libc/locale/wctomb_2_test:wctomb_test  ->  passed  [0.004s]
lib/libc/locale/wctomb_test:wcrtomb  ->  passed  [0.004s]
lib/libc/locale/wctomb_test:wcrtomb_state  ->  passed  [0.004s]
lib/libc/locale/wctomb_test:wctomb  ->  passed  [0.004s]
lib/libc/ssp/ssp_test:fgets  ->  pid 3357 (h_fgets), jid 0, uid 0: exited on signal 6
passed  [0.032s]
lib/libc/ssp/ssp_test:getcwd  ->  passed  [0.024s]
lib/libc/ssp/ssp_test:gets  ->  pid 3393 (h_gets), jid 0, uid 0: exited on signal 6
passed  [0.032s]
lib/libc/ssp/ssp_test:memcpy  ->  pid 3410 (h_memcpy), jid 0, uid 0: exited on signal 6
passed  [0.024s]
lib/libc/ssp/ssp_test:memmove  ->  pid 3427 (h_memmove), jid 0, uid 0: exited on signal 6
passed  [0.029s]
lib/libc/ssp/ssp_test:memset  ->  pid 3444 (h_memset), jid 0, uid 0: exited on signal 6
passed  [0.029s]
lib/libc/ssp/ssp_test:raw  ->  skipped: /usr/tests/lib/libc/ssp/h_raw is missing; skipping testcase  [0.018s]
lib/libc/ssp/ssp_test:read  ->  pid 3479 (h_read), jid 0, uid 0: exited on signal 6
passed  [0.033s]
lib/libc/ssp/ssp_test:readlink  ->  pid 3496 (h_readlink), jid 0, uid 0: exited on signal 6
passed  [0.030s]
lib/libc/ssp/ssp_test:snprintf  ->  pid 3513 (h_snprintf), jid 0, uid 0: exited on signal 6
passed  [0.028s]
lib/libc/ssp/ssp_test:sprintf  ->  pid 3530 (h_sprintf), jid 0, uid 0: exited on signal 6
passed  [0.025s]
lib/libc/ssp/ssp_test:stpcpy  ->  pid 3547 (h_stpcpy), jid 0, uid 0: exited on signal 6
passed  [0.029s]
lib/libc/ssp/ssp_test:stpncpy  ->  pid 3564 (h_stpncpy), jid 0, uid 0: exited on signal 6
passed  [0.023s]
lib/libc/ssp/ssp_test:strcat  ->  pid 3581 (h_strcat), jid 0, uid 0: exited on signal 6
passed  [0.023s]
lib/libc/ssp/ssp_test:strcpy  ->  pid 3598 (h_strcpy), jid 0, uid 0: exited on signal 6
passed  [0.023s]
lib/libc/ssp/ssp_test:strncat  ->  pid 3615 (h_strncat), jid 0, uid 0: exited on signal 6
passed  [0.028s]
lib/libc/ssp/ssp_test:strncpy  ->  pid 3632 (h_strncpy), jid 0, uid 0: exited on signal 6
passed  [0.024s]
lib/libc/ssp/ssp_test:vsnprintf  ->  pid 3649 (h_vsnprintf), jid 0, uid 0: exited on signal 6
passed  [0.025s]
lib/libc/ssp/ssp_test:vsprintf  ->  pid 3666 (h_vsprintf), jid 0, uid 0: exited on signal 6
passed  [0.029s]
lib/msun/acos_test:acos_inrange  ->  passed  [0.004s]
lib/msun/acos_test:acos_is_nan  ->  passed  [0.004s]
lib/msun/acos_test:acos_is_plus_zero  ->  passed  [0.005s]
lib/msun/asin_test:asin_inf_neg  ->  passed  [0.004s]
lib/msun/asin_test:asin_inf_pos  ->  passed  [0.004s]
lib/msun/asin_test:asin_inrange  ->  passed  [0.004s]
lib/msun/asin_test:asin_nan  ->  passed  [0.005s]
lib/msun/asin_test:asin_range  ->  passed  [0.004s]
lib/msun/asin_test:asin_zero_neg  ->  passed  [0.004s]
lib/msun/asin_test:asin_zero_pos  ->  passed  [0.004s]
lib/msun/asin_test:asinf_inf_neg  ->  passed  [0.004s]
lib/msun/asin_test:asinf_inf_pos  ->  *** /usr/src/contrib/kyua/utils/process/executor.cpp:779: Invariant check failed: PID 3680 already in all_exec_handles; not properly cleaned up or reused too fast
*** Fatal signal 6 received
*** Log file is /.kyua/logs/kyua.20230206-203346.log
*** Please report this problem to kyua-discuss@googlegroups.com detailing what you were doing before the crash happened; if possible, include the log file mentioned above
pid 781 (kyua), jid 0, uid 0: exited on signal 6 (core dumped)
Abort trap (core dumped)
+ rc=134
+ set -e
+ [ 134 -ne 0 ]
+ [ 134 -ne 1 ]
+ exit 134
+ tar cvf /dev/vtbd1 -C /meta .
a .
a ./run-kyua.sh
a ./auto-shutdown
a ./disable-notyet-tests.sh
a ./run.sh
a ./disable-dtrace-tests.sh
a ./disable-zfs-tests.sh
+ [ -f /meta/auto-shutdown ]
+ uname -p
+ shutdown -p now
Shutdown NOW!
shutdown: [pid 3684]
+ startmsg .
+ check_startmsgs
+ [ -n yes ]
+ checkyesno rc_startmsgs
+ eval '_value=$rc_startmsgs'
+ _value=YES
+ debug 'checkyesno: rc_startmsgs is set to YES.'
+ return 0
+ echo .
.
+ _return=0
+ umask 0022
+ [ 0 -ne 0 ]
+ return 0
+ _run_rc_postcmd
+ [ -n '' ]
+ return 0
+ return 0
2023-02-06T21:35:37.426405+00:00 - shutdown 3684 - - power-down by root: 

System shutdown time has arrived
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop... 
Syncing disks, vnodes remaining... 2 0 done
All buffers synced.
lock order reversal:
 1st 0xfffff8001942dcb0 ufs (ufs, lockmgr) @ /usr/src/sys/kern/vfs_mount.c:2158
 2nd 0xfffff80019453af0 tarfsz (tarfsz, lockmgr) @ /usr/src/sys/fs/tarfs/tarfs_io.c:689
lock order tarfsz -> ufs established at:
#0 0xffffffff80c5f45d at witness_checkorder+0x32d
#1 0xffffffff80bbac3c at lockmgr_lock_flags+0x7c
#2 0xffffffff80f52afc at ffs_lock+0x6c
#3 0xffffffff80cf9b64 at _vn_lock+0x54
#4 0xffffffff828859bd at tarfs_zread+0x1fd
#5 0xffffffff811b3e34 at VOP_READ_APV+0x34
#6 0xffffffff82885092 at tarfs_io_read+0x92
#7 0xffffffff828851d2 at tarfs_io_read_buf+0x52
#8 0xffffffff828886f3 at tarfs_alloc_mount+0x2d3
#9 0xffffffff82887f71 at tarfs_mount+0x3b1
#10 0xffffffff80cd9e50 at vfs_domount_first+0x250
#11 0xffffffff80cd63b1 at vfs_domount+0x2f1
#12 0xffffffff80cd4d45 at vfs_donmount+0x895
#13 0xffffffff80cd4479 at sys_nmount+0x69
#14 0xffffffff810e3bc4 at amd64_syscall+0x6b4
#15 0xffffffff810b608b at fast_syscall_common+0xf8
lock order ufs -> tarfsz attempted at:
#0 0xffffffff80c5fd2d at witness_checkorder+0xbfd
#1 0xffffffff80bbad42 at lockmgr_lock_flags+0x182
#2 0xffffffff80cf9b64 at _vn_lock+0x54
#3 0xffffffff828854cb at tarfs_io_fini+0x3b
#4 0xffffffff82889457 at tarfs_free_mount+0x87
#5 0xffffffff82888055 at tarfs_unmount+0x65
#6 0xffffffff80cd7393 at dounmount+0x7c3
#7 0xffffffff80ce3d3a at vfs_unmountall+0x6a
#8 0xffffffff80cb48ce at bufshutdown+0x34e
#9 0xffffffff80bed5a4 at kern_reboot+0x764
#10 0xffffffff80becde8 at sys_reboot+0x3a8
#11 0xffffffff810e3bc4 at amd64_syscall+0x6b4
#12 0xffffffff810b608b at fast_syscall_common+0xf8
lock order reversal:
 1st 0xfffff80006b253f0 devfs (devfs, lockmgr) @ /usr/src/sys/kern/vfs_mount.c:2158
 2nd 0xfffff80003acfcb0 fdescfs (fdescfs, lockmgr) @ /usr/src/sys/kern/vfs_subr.c:3043
lock order devfs -> fdescfs attempted at:
#0 0xffffffff80c5fd2d at witness_checkorder+0xbfd
#1 0xffffffff80bbad42 at lockmgr_lock_flags+0x182
#2 0xffffffff80cf9b64 at _vn_lock+0x54
#3 0xffffffff80ce14ef at vget_finish+0x4f
#4 0xffffffff82710242 at fdesc_root+0x22
#5 0xffffffff80ce254c at vflush+0x4c
#6 0xffffffff827101f2 at fdesc_unmount+0x72
#7 0xffffffff80cd7393 at dounmount+0x7c3
#8 0xffffffff80ce3d3a at vfs_unmountall+0x6a
#9 0xffffffff80cb48ce at bufshutdown+0x34e
#10 0xffffffff80bed5a4 at kern_reboot+0x764
#11 0xffffffff80becde8 at sys_reboot+0x3a8
#12 0xffffffff810e3bc4 at amd64_syscall+0x6b4
#13 0xffffffff810b608b at fast_syscall_common+0xf8
pid 495 (devd), jid 0, uid 0: exited on signal 11
Uptime: 1h2m0s
acpi0: Powering system off
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-22933' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run-kyua.sh
x ./auto-shutdown
x ./disable-notyet-tests.sh
x ./run.sh
x ./disable-dtrace-tests.sh
x ./disable-zfs-tests.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins7136679089553808492.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'f711d5c3d06677740dc04a0ced27b2bce894bae1', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../f711d5c3d06677740dc04a0ced27b2bce894bae1/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address