RE: New panic in main-n253273-a52d8d4a6c6:

-----Original Message-----
From: owner-freebsd-current@freebsd.org [mailto:owner-freebsd-current@freebsd.org] On Behalf Of Hans Petter Selasky
Sent: Monday, February 21, 2022 2:48 AM
To: Michael Jung <mikej@paymentallianceintl.com>; freebsd-current <freebsd-current@freebsd.org>
Subject: Re: New panic in main-n253273-a52d8d4a6c6:

On 2/20/22 21:53, Michael Jung wrote:
> Hi!
>
> The box was quite busy at the time.  The only odd thing I am aware of
> and which I do not think is related is I have not been able to expand
> one of my zpool's.  ZFS sees my added draid2:2d:10c:0s vdev but I
> can't seem to force zpool's expansion - my bet this is somehow related
> to the mirrored special device in the pool even though autoexpand is set to 'on' for the pool.
>
> Not asking anyone to solve this, I plan on putting together a "how to
> reproduce" and post to freebsd-fs@ but wanted to note this oddity.
>
> --mikej
>
> This is a unmodified GENERIC kernel.
>
>
> Unread portion of the kernel message buffer:
> panic: refcount 0xfffff801cc119284 wraparound cpuid = 7 time =
> 1645382575
> KDB: stack backtrace:
> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame
> 0xfffffe0119a83c80
> vpanic() at vpanic+0x17f/frame 0xfffffe0119a83cd0
> panic() at panic+0x43/frame 0xfffffe0119a83d30
> fdclose() at fdclose/frame 0xfffffe0119a83dc0
> closefp_impl() at closefp_impl+0x77/frame 0xfffffe0119a83e00
> amd64_syscall() at amd64_syscall+0x12e/frame 0xfffffe0119a83f30
> fast_syscall_common() at fast_syscall_common+0xf8/frame
> 0xfffffe0119a83f30
> --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x3309a531b62a, rsp =
> 0x3309a2802bc8, rbp = 0x3309a2803000 ---
> KDB: enter: panic
>

This may be a refcount leak. Are you able to dump "fdp" at:

#16 0xffffffff80bad587 in closefp_impl (fdp=0xfffffe012b7c0430, fd=4,
     fp=0xfffff801cc119280, td=0xfffffe00df8d0560, audit=true)
     at /usr/src/sys/kern/kern_descrip.c:1300

frame 16
print /x *fdp

--HPS


 [root@draid /var/crash]# kgdb kernel.full.0 vmcore.0
GNU gdb (GDB) 11.2 [GDB v11.2 for FreeBSD]
Copyright (C) 2022 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-portbld-freebsd14.0".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<https://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from kernel.full.0...

Unread portion of the kernel message buffer:
panic: refcount 0xfffff801cc119284 wraparound
cpuid = 7
time = 1645382575
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0119a83c80
vpanic() at vpanic+0x17f/frame 0xfffffe0119a83cd0
panic() at panic+0x43/frame 0xfffffe0119a83d30
fdclose() at fdclose/frame 0xfffffe0119a83dc0
closefp_impl() at closefp_impl+0x77/frame 0xfffffe0119a83e00
amd64_syscall() at amd64_syscall+0x12e/frame 0xfffffe0119a83f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0119a83f30
--- syscall (6, FreeBSD ELF64, sys_close), rip = 0x3309a531b62a, rsp = 0x3309a2802bc8, rbp = 0x3309a2803000 ---
KDB: enter: panic

__curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55
55              __asm("movq %%gs:%P1,%0" : "=r" (td) : "n" (offsetof(struct pcpu,

(kgdb) fram 16
#16 0xffffffff80bad587 in closefp_impl (fdp=0xfffffe012b7c0430, fd=4, fp=0xfffff801cc119280, td=0xfffffe00df8d0560, audit=true) at /usr/src/sys/kern/kern_descrip.c:1300
1300            error = closef(fp, td);

(kgdb) print /x *fdp
$1 = {fd_files = 0xfffffe00df6d9000, fd_map = 0xfffff80001bb1800, fd_freefile = 0x4, fd_refcnt = 0x1, fd_holdcnt = 0x1, fd_sx = {lock_object = {lo_name = 0xffffffff8124f6a9, lo_flags = 0x2330000, lo_data = 0x0,
      lo_witness = 0xfffff8041eb94000}, sx_lock = 0x1}, fd_kqlist = {tqh_first = 0x0, tqh_last = 0x0}, fd_holdleaderscount = 0x0, fd_holdleaderswakeup = 0x0}
(kgdb)




CONFIDENTIALITY NOTE: This message is intended only for the use
of the individual or entity to whom it is addressed and may
contain information that is privileged, confidential, and
exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying
of this communication is strictly prohibited. If you have
received this transmission in error, please notify us by
telephone at (502) 212-4000 or notify us at PAI, Dept. 99,
2101 High Wickham Place, Suite 101, Louisville, KY 40245

Disclaimer

The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.

This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast, a leader in email security and cyber resilience. Mimecast integrates email defenses with brand protection, security awareness training, web security, compliance and other essential capabilities. Mimecast helps protect large and small organizations from malicious activity, human error and technology failure; and to lead the movement toward building a more resilient world. To find out more, visit our website.