FreeBSD-main-amd64-test - Build #23032 - Still Failing

From: <jenkins-admin_at_FreeBSD.org>
Date: Thu, 23 Feb 2023 01:22:12 UTC
FreeBSD-main-amd64-test - Build #23032 (fe5c211ba87315b098769a7e6d50b41f00f6fed4) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/23032/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/23032/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/23032/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

10dff9da9748b0eadd2d02dded3afd2321d15537 by rmacklem:
nfsd: Return ENXIO instead of EPERM when nfsd(8) already running

fe5c211ba87315b098769a7e6d50b41f00f6fed4 by rmacklem:
nfsd.c: Log a more meaningful failure message



The end of the build log:

[...truncated 51.79 KB...]
sbin/pfctl/pfctl_test:selfpf0081  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf0082  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf0084  ->  passed  [0.008s]
sbin/pfctl/pfctl_test:selfpf0085  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf0087  ->  passed  [0.009s]
sbin/pfctl/pfctl_test:selfpf0088  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf0089  ->  passed  [0.008s]
sbin/pfctl/pfctl_test:selfpf0090  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf0091  ->  passed  [0.009s]
sbin/pfctl/pfctl_test:selfpf0092  ->  passed  [0.008s]
sbin/pfctl/pfctl_test:selfpf0094  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf0095  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf0096  ->  passed  [0.009s]
sbin/pfctl/pfctl_test:selfpf0097  ->  passed  [0.008s]
sbin/pfctl/pfctl_test:selfpf0098  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf0100  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf0101  ->  passed  [0.008s]
sbin/pfctl/pfctl_test:selfpf0102  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf0104  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf1001  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf1002  ->  passed  [0.006s]
sbin/pfctl/pfctl_test:selfpf1003  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf1004  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf1005  ->  passed  [0.008s]
sbin/pfctl/pfctl_test:selfpf1006  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf1007  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf1008  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf1009  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf1010  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf1011  ->  passed  [0.007s]
sbin/pfctl/pfctl_test:selfpf1012  ->  passed  [0.007s]
sbin/devd/client_test:seqpacket  ->  passed  [0.011s]
sbin/devd/client_test:stream  ->  passed  [0.011s]
sbin/bectl/bectl_test:bectl_create  ->  ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
passed  [1.204s]
sbin/bectl/bectl_test:bectl_destroy  ->  passed  [3.134s]
sbin/bectl/bectl_test:bectl_export_import  ->  passed  [0.268s]
sbin/bectl/bectl_test:bectl_jail  ->  passed  [0.997s]
sbin/bectl/bectl_test:bectl_list  ->  passed  [0.271s]
sbin/bectl/bectl_test:bectl_mount  ->  passed  [0.296s]
sbin/bectl/bectl_test:bectl_rename  ->  passed  [0.181s]
libexec/rtld-elf/ld_library_pathfds:bad_library_directories  ->  passed  [0.004s]
libexec/rtld-elf/ld_library_pathfds:first_library_directory  ->  passed  [0.005s]
libexec/rtld-elf/ld_library_pathfds:last_library_directory  ->  passed  [0.005s]
libexec/rtld-elf/ld_library_pathfds:middle_library_directory  ->  passed  [0.005s]
libexec/rtld-elf/ld_library_pathfds:missing_library  ->  passed  [0.005s]
libexec/rtld-elf/ld_library_pathfds:single_library_directory  ->  passed  [0.005s]
libexec/rtld-elf/ld_library_pathfds:wrong_library_directories  ->  passed  [0.004s]
libexec/rtld-elf/ld_preload_fds:bad_librarys  ->  passed  [0.004s]
libexec/rtld-elf/ld_preload_fds:missing_library  ->  passed  [0.004s]
libexec/rtld-elf/ld_preload_fds:single_library  ->  passed  [0.005s]
libexec/rtld-elf/ld_preload_fds:two_librarys  ->  passed  [0.005s]
libexec/tftpd/functional:abspath_v4  ->  passed  [0.007s]
libexec/tftpd/functional:abspath_v6  ->  passed  [0.005s]
libexec/tftpd/functional:dotdot_v4  ->  passed  [0.009s]
libexec/tftpd/functional:dotdot_v6  ->  passed  [0.009s]
libexec/tftpd/functional:rrq_dropped_ack_v4  ->  passed  [5.013s]
libexec/tftpd/functional:rrq_dropped_ack_v6  ->  passed  [5.011s]
libexec/tftpd/functional:rrq_dropped_data_v4  ->  passed  [0.007s]
libexec/tftpd/functional:rrq_dropped_data_v6  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_duped_ack_v4  ->  passed  [0.007s]
libexec/tftpd/functional:rrq_duped_ack_v6  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_eaccess_v4  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_eaccess_v6  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_empty_v4  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_empty_v6  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_medium_v4  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_medium_v6  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_medium_window_v4  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_medium_window_v6  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_netascii_v4  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_netascii_v6  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_nonexistent_v4  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_nonexistent_v6  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_path_max_v4  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_path_max_v6  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_small_v4  ->  passed  [0.006s]
libexec/tftpd/functional:rrq_small_v6  ->  passed  [0.005s]
libexec/tftpd/functional:rrq_window_rfc7440_v4  ->  passed  [5.009s]
libexec/tftpd/functional:rrq_window_rfc7440_v6  ->  passed  [5.013s]
libexec/tftpd/functional:s_flag_v4  ->  passed  [0.007s]
libexec/tftpd/functional:s_flag_v6  ->  passed  [0.006s]
libexec/tftpd/functional:unknown_modes_v4  ->  passed  [0.012s]
libexec/tftpd/functional:unknown_modes_v6  ->  passed  [0.012s]
libexec/tftpd/functional:unknown_opcode_v4  ->  passed  [0.006s]
libexec/tftpd/functional:unknown_opcode_v6  ->  passed  [0.006s]
libexec/tftpd/functional:w_flag_v4  ->  passed  [0.007s]
libexec/tftpd/functional:w_flag_v6  ->  passed  [0.006s]
libexec/tftpd/functional:wrq_dropped_ack_v4  ->  passed  [5.011s]
libexec/tftpd/functional:wrq_dropped_ack_v6  ->  passed  [5.012s]
libexec/tftpd/functional:wrq_dropped_data_v4  ->  passed  [5.012s]
libexec/tftpd/functional:wrq_dropped_data_v6  ->  passed  [5.011s]
libexec/tftpd/functional:wrq_duped_data_v4  ->  passed  [0.007s]
libexec/tftpd/functional:wrq_duped_data_v6  ->  passed  [0.006s]
libexec/tftpd/functional:wrq_eaccess_v4  ->  passed  [0.005s]
libexec/tftpd/functional:wrq_eaccess_v6  ->  passed  [0.005s]
libexec/tftpd/functional:wrq_eaccess_world_readable_v4  ->  passed  [0.006s]
libexec/tftpd/functional:wrq_eaccess_world_readable_v6  ->  passed  [0.007s]
libexec/tftpd/functional:wrq_medium_v4  ->  passed  [0.007s]
libexec/tftpd/functional:wrq_medium_v6  ->  passed  [0.006s]
libexec/tftpd/functional:wrq_medium_window_v4  ->  passed  [0.006s]
libexec/tftpd/functional:wrq_medium_window_v6  ->  passed  [0.005s]
libexec/tftpd/functional:wrq_netascii_v4  ->  passed  [0.006s]
libexec/tftpd/functional:wrq_netascii_v6  ->  passed  [0.006s]
libexec/tftpd/functional:wrq_nonexistent_v4  ->  passed  [0.006s]
libexec/tftpd/functional:wrq_nonexistent_v6  ->  passed  [0.006s]
libexec/tftpd/functional:wrq_small_v4  ->  passed  [0.005s]
libexec/tftpd/functional:wrq_small_v6  ->  passed  [0.005s]
libexec/tftpd/functional:wrq_truncate_v4  ->  passed  [0.005s]
libexec/tftpd/functional:wrq_truncate_v6  ->  passed  [0.005s]
libexec/tftpd/functional:wrq_window_rfc7440_v4  ->  passed  [5.010s]
libexec/tftpd/functional:wrq_window_rfc7440_v6  ->  passed  [5.013s]
libexec/rc/rc_subr_test:oomprotect_all  ->  passed  [0.081s]
libexec/rc/rc_subr_test:oomprotect_yes  ->  passed  [0.072s]
libexec/atf/atf-sh/atf_check_test:equal  ->  passed  [0.074s]
libexec/atf/atf-sh/atf_check_test:experr_mismatch  ->  passed  [0.044s]
libexec/atf/atf-sh/atf_check_test:expout_mismatch  ->  passed  [0.047s]
libexec/atf/atf-sh/atf_check_test:flush_stdout_on_death  ->  passed  [1.025s]
libexec/atf/atf-sh/atf_check_test:info_ok  ->  passed  [0.050s]
libexec/atf/atf-sh/atf_check_test:null_stderr  ->  passed  [0.042s]
libexec/atf/atf-sh/atf_check_test:null_stdout  ->  passed  [0.041s]
libexec/atf/atf-sh/config_test:get  ->  passed  [0.046s]
libexec/atf/atf-sh/config_test:has  ->  passed  [0.053s]
libexec/atf/atf-sh/integration_test:arguments  ->  passed  [0.042s]
libexec/atf/atf-sh/integration_test:custom_shell__command_line  ->  passed  [0.035s]
libexec/atf/atf-sh/integration_test:custom_shell__shebang  ->  passed  [0.035s]
libexec/atf/atf-sh/integration_test:missing_script  ->  passed  [0.020s]
libexec/atf/atf-sh/integration_test:no_args  ->  passed  [0.022s]
libexec/atf/atf-sh/integration_test:set_e  ->  passed  [0.030s]
libexec/atf/atf-sh/normalize_test:main  ->  passed  [0.035s]
libexec/atf/atf-sh/tc_test:default_status  ->  passed  [0.055s]
libexec/atf/atf-sh/tc_test:missing_body  ->  passed  [0.025s]
libexec/atf/atf-sh/tp_test:srcdir  ->  passed  [0.033s]
libexec/atf/atf-check/atf-check_test:eflag_empty  ->  passed  [0.033s]
libexec/atf/atf-check/atf-check_test:eflag_file  ->  passed  [0.062s]
libexec/atf/atf-check/atf-check_test:eflag_ignore  ->  passed  [0.033s]
libexec/atf/atf-check/atf-check_test:eflag_inline  ->  passed  [0.086s]
libexec/atf/atf-check/atf-check_test:eflag_match  ->  passed  [0.059s]
libexec/atf/atf-check/atf-check_test:eflag_multiple  ->  passed  [0.053s]
libexec/atf/atf-check/atf-check_test:eflag_negated  ->  passed  [0.055s]
libexec/atf/atf-check/atf-check_test:eflag_save  ->  passed  [0.025s]
libexec/atf/atf-check/atf-check_test:invalid_umask  ->  passed  [0.021s]
libexec/atf/atf-check/atf-check_test:oflag_empty  ->  passed  [0.034s]
libexec/atf/atf-check/atf-check_test:oflag_file  ->  passed  [0.063s]
libexec/atf/atf-check/atf-check_test:oflag_ignore  ->  passed  [0.033s]
libexec/atf/atf-check/atf-check_test:oflag_inline  ->  passed  [0.093s]
libexec/atf/atf-check/atf-check_test:oflag_match  ->  passed  [0.054s]
libexec/atf/atf-check/atf-check_test:oflag_multiple  ->  passed  [0.055s]
libexec/atf/atf-check/atf-check_test:oflag_negated  ->  passed  [0.052s]
libexec/atf/atf-check/atf-check_test:oflag_save  ->  passed  [0.025s]
libexec/atf/atf-check/atf-check_test:sflag_eq_ne  ->  passed  [0.073s]
libexec/atf/atf-check/atf-check_test:sflag_exit  ->  passed  [0.095s]
libexec/atf/atf-check/atf-check_test:sflag_ignore  ->  passed  [0.034s]
libexec/atf/atf-check/atf-check_test:sflag_signal  ->  passed  [0.060s]
libexec/atf/atf-check/atf-check_test:stdin  ->  passed  [0.024s]
libexec/atf/atf-check/atf-check_test:xflag  ->  passed  [0.030s]
sys/acl/00:main  ->  passed  [0.404s]
sys/acl/01:main  ->  passed  [0.775s]
sys/acl/02:main  ->  Memory modified after free 0xfffffe00e7a58000(8184) val=0 @ 0xfffffe00e7a58698
panic: Most recently used by temp

cpuid = 1
time = 1677115332
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00cb1c9850
vpanic() at vpanic+0x152/frame 0xfffffe00cb1c98a0
panic() at panic+0x43/frame 0xfffffe00cb1c9900
mtrash_dtor() at mtrash_dtor/frame 0xfffffe00cb1c9920
item_ctor() at item_ctor+0x11f/frame 0xfffffe00cb1c9970
malloc() at malloc+0x7f/frame 0xfffffe00cb1c99b0
ffs_deleteextattr() at ffs_deleteextattr+0xf3/frame 0xfffffe00cb1c9a00
VOP_DELETEEXTATTR_APV() at VOP_DELETEEXTATTR_APV+0x3c/frame 0xfffffe00cb1c9a20
vn_extattr_rm() at vn_extattr_rm+0xd2/frame 0xfffffe00cb1c9aa0
ufs_setacl_nfs4_internal() at ufs_setacl_nfs4_internal+0x63/frame 0xfffffe00cb1c9ae0
ufs_chmod() at ufs_chmod+0x1b6/frame 0xfffffe00cb1c9b50
ufs_setattr() at ufs_setattr+0x430/frame 0xfffffe00cb1c9bb0
VOP_SETATTR_APV() at VOP_SETATTR_APV+0x3c/frame 0xfffffe00cb1c9bd0
setfmode() at setfmode+0xb1/frame 0xfffffe00cb1c9ce0
kern_fchmodat() at kern_fchmodat+0x174/frame 0xfffffe00cb1c9e00
amd64_syscall() at amd64_syscall+0x6e2/frame 0xfffffe00cb1c9f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00cb1c9f30
--- syscall (490, FreeBSD ELF64, fchmodat), rip = 0xd4f856737da, rsp = 0xd4f82d80ef8, rbp = 0xd4f82d80f70 ---
KDB: enter: panic
[ thread pid 25189 tid 100132 ]
Stopped at      kdb_enter+0x32: movq    $0,0x1293d53(%rip)
db:0:kdb.enter.panic> show pcpu
cpuid        = 1
dynamic pcpu = 0xfffffe008f587640
curthread    = 0xfffffe00cbe201e0: pid 25189 tid 100132 critnest 1 "chmod"
curpcb       = 0xfffffe00cbe20700
fpcurthread  = 0xfffffe00cbe201e0: pid 25189 "chmod"
idlethread   = 0xfffffe0011223c80: tid 100004 "idle: cpu1"
self         = 0xffffffff82611000
curpmap      = 0xfffffe00c161b130
tssp         = 0xffffffff82611384
rsp0         = 0xfffffe00cb1ca000
kcr3         = 0x80000000448a17ab
ucr3         = 0x8000000044ce8fab
scr3         = 0x44ce8fab
gs32p        = 0xffffffff82611404
ldt          = 0xffffffff82611444
tss          = 0xffffffff82611434
curvnet      = 0
spin locks held:
db:0:kdb.enter.panic>  reset
Uptime: 5m29s
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-23032' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run-kyua.sh
x ./disable-dtrace-tests.sh
x ./run.sh
x ./disable-notyet-tests.sh
x ./auto-shutdown
x ./disable-zfs-tests.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins230429087815629449.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'fe5c211ba87315b098769a7e6d50b41f00f6fed4', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../fe5c211ba87315b098769a7e6d50b41f00f6fed4/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address