From nobody Sat Jan 20 19:17:18 2024 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4THR7g2NW9z56YWY for ; Sat, 20 Jan 2024 19:17:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4THR7f6YMqz4jXf for ; Sat, 20 Jan 2024 19:17:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1705778238; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=eJUQ22bIuGXGyBDTv5pRrpss8Pj59r5yiD46UWYWjtE=; b=nt6i/0Vs0KuooArbVImJ3H3jkBf9MIgFoh/+LRAPt+TBN+kTDzMwctHTrQ6pdOgEc+6jEi +PYysUwy2QQD/O7ktEjc2o8OiLLVuLnady++e4Wt18CVM0cIq5XC0uzMQ3lKpL4Of4mHYX 5KVc2E+8smJN8AGyU7POtMtL830ExZxuEbaEUIzmNt6/BpM5jqrVcVbu3fKGiOiJDy7MwW PX8Yh/+xD49rypfdyO0iyQKtnbjMn/Llr9BvCYdAnxgXp5DaLSImag+ZyU09pAXfITpuoO kS2toctdi70JuRu6J8e7UjZIuuVhFhx3G+nMfkfbJRO4T0LZnmWJMEf96dl4zA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1705778238; a=rsa-sha256; cv=none; b=OE4Ov13/fYvlVEOp+sAfkOkP74X+tmnwblM/uAWzWaFKA++JcGBa/i2zYJJa7/ILNyzwKo SD7BN/O/oUagmdMj3H2dJOiPbCBv9xeFyOyqUCLGN2KbHFci1fKr0318hA2uotf84Cms+6 ZFUxw/G2K5IkCzr8Xpagn0FQBaAE8zwBhGYz5SyVZSrIlIG5U/UL8K+5eUVo4/n9ZQYKrD PXIx2AnZmVvFL8hFKzzzUCmbhFXfG+xwVfNLurmxd6eRcxCh3u0smvcdiR1SRh0sfjIRCj tRZwINgkrNXJZp824DpcxAdtNxojqVJEuyvNOXozFJKGF45iBNWCIS/mQBRjAg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4THR7f5YDKzmp9 for ; Sat, 20 Jan 2024 19:17:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 40KJHIpE056746 for ; Sat, 20 Jan 2024 19:17:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 40KJHIA9056745 for fs@FreeBSD.org; Sat, 20 Jan 2024 19:17:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 276341] zfs panic: VERIFY3(rc->rc_count == number) failed Date: Sat, 20 Jan 2024 19:17:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 15.0-CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jfc@mit.edu X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D276341 --- Comment #8 from John F. Carr --- Here is the object being destroyed on my system: (kgdb) p ARC_anon.arcs_size[0] $3 =3D {rc_count =3D 262144, rc_mtx =3D {lock_object =3D {lo_name =3D 0xfff= f000000c8d8f6 "rc->rc_mtx",=20 lo_flags =3D 577830912, lo_data =3D 0, lo_witness =3D 0x0}, sx_lock = =3D 1}, rc_tree =3D {avl_root =3D 0x0,=20 avl_compar =3D 0xffff0000001630f0 , avl_offset = =3D 0, avl_numnodes =3D 0},=20 rc_removed =3D {list_size =3D 48, list_offset =3D 0, list_head =3D { list_next =3D 0xffff0000010e6ad8 , list_prev =3D 0xffff0000010e6ad8 }},=20 rc_removed_count =3D 0, rc_tracked =3D 0} The sx_lock field is the correct value for a mutex to be passed to sx_destr= oy. The avl tree is supposed to be empty because rc_tracked=3D0. The value comes from the global variable reference_tracking_enable. Setting that to 1 at compile time might shed some light on the problem. ARC_anon+216 is the address of rc_removed.list_head. lo_flags =3D 577830912 =3D 0x22710000 =3D class 0x22, LO_INITIALIZED|LO_WITNESS|LO_QUIET. So there's nothing obviously wrong here except the accumulated count added to and subtracted from the counter is not zero. This is an ARC counter. I do not expect scrubbing to have any effect. I ran zpool scrub and it found no errors. --=20 You are receiving this mail because: You are the assignee for the bug.=