From nobody Tue Jul 16 19:31:50 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WNq2Z2v26z5Rq37 for ; Tue, 16 Jul 2024 19:32:06 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-55.consmr.mail.gq1.yahoo.com (sonic315-55.consmr.mail.gq1.yahoo.com [98.137.65.31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4WNq2Y1XkRz42j1 for ; Tue, 16 Jul 2024 19:32:05 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=oEkQHH25; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.31 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1721158322; bh=EQUWExfEUzwSjknHWLIHwx1LGQuZtuAFW3CY9OH9eCs=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=oEkQHH25Mlrm21aUJYW13C6YsLkp1eh7YisbEouVhQ0hIJ/OIfAESHeArVp6zNysCdel1dAs8Fp5xu4rq6AuTTIp0sGSB78xuafEQu9jeIf+yxPKi9vUH0VVqL08eaK9gZxrpJsleaoLVzZLb6WuPGw9x6EpfQRC7JhoubmGlUjFfcS6bzcemMChxeIL/Rn4E8w9RObVRRwUQ11AmApZn2G1b9JB/hxzVVGrKebmXVpuPlTunYo9EBK2hyV6uv6bDbuhU+2R1o+/TOjjTc2K25ujps7NZlmSW3hs9JF2Xn71nJd0JBN3sr4PibKTavyDGt71kpjwG6U7Ak0ZJllHEw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1721158322; bh=OJC2kKkJg/2vXpXE55FJFjOusBhIgDWJ53YV6bf14QB=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=njEklq05GyusnrOBjsQ2aRVROpNMDtebZSNRCT7nY8BLZ6ebCi6m7MMJlApUn2JRq5CbVgMREy8dwcmQd1esAA68Vkntna5ZwtnhIPq/oAnBkUV1INM+nIU8I+LrFvOFZCquR+ZMIL8sXUh5hUPjTmWvj0cAmBz1FP7gGwTgBDSJJjJuKU+b7i6VxNv+c3IBJ65lYQ/5lVH+rHQPfRYiOCRVW9cwirMDz3lKFA+0uVwrR3lSms97pzs/WS/y1/Uz1qRJR/kgVoEmzb1AKaBSNdN9prvm33RvHgLUPrM1KXUxsPBoRvgUM75lXUHt6iqCYMEIMkN/7EnAfEdMoyWElg== X-YMail-OSG: I1z70hkVM1mkgievlVVcs6J7i2XACH3jvAsmcAEk3t1rLKcMBywxXoEexFhlars i5SKEVYVmOGZtNwT5ufhpAjZDT3VJoRB62F61L.KiwsvwZRNoLvTu.hCMYrilM8W6FJBkYOL7dDw XDZa5thkovchDT8w4kOlboBe.SCRMF5K2RkUO5qe9RHM2B60XpJydrCQd8DQVOAWBflK3moXDmS6 CprQWfDwA8KMB7xFV20BCnsIPrUpkaMhbL1xZ8htXDC83D7Rdvar3UvRmOIALIVeC8mZhSGV89cs MCigqe6.z_G9yOp8bLN4tuyzc1oKf1PFsMaCDvuHm6P1O3KwMh2y1pJeM2EQyDqDquie4EOUrok3 _IH0V01optmXaiHPkKS7x_r0.qmw.HGEzpSY05iEC_7PNjNlVZEjzcFKDCm7Yejh_TVd13pcX7ck JN6mfQ71rXn5.RgYk9LunT2vrML4i.OV76GbZ0bzItU3cORGQUw6iI37FFq1_7uzlw2LQhJhdQ38 iJ5rhstjRYAYaSwJ0UN_10yaE.lRodpHvC2lVj0qoi2_nX2uTLlrK8rGJLkieTDs8ywtE9cWysP5 PzSapmxUpSRodtRj05h1EKemGiGvgqzCoklhuZo4LqiMhJPNeHGzcAoXeCXoFgznTnJsQTIrIjmU kzrsLaIA4IDLYNjMs95DTrkPEOXI.EXdCoaGoWBVeKWzIWQtTJ0yVewcHiT3Sn5TMXgWbRIu.ZUH loD6efPqGCCVjZoAbsGNbowoCeXM2Y0i_zyK063Q5EqwDBC1SP.VOhrqtaTJTOFHP6kdqHOvu3c1 LgFyE9g1bYf24tekUXXkvIYx293TKjrYtv9gJjluU5uwfjO8Twp4i..sOHH8A9DAkw_UbFjJFVF9 PJEA2O7rLBsUiz2vb6Vc_SYHPmUc6CgfAZbgzRS4LJNTm63Ub.x_dWk.tu07aUSEH1G2oNJp2ujV CfsY5mnsilxO1fNwPef1c4fY3Cncb6bgPketjCvutS9rfVfU9lA0AJd0jWCv9q.ClkgH9WyHtfg_ lgMCMW9KjzZxt0zRMJlHyzXJpiqwQZWEjN5wWZUrtu17cMPpdRNJ1k46Jm7aEq1nBG.WC6XkO_2T 2yY4RllWpBYnh.ZumalA4K22cUlg.YgB4cbkUhworb27TTW02eD9FI6b.UdYwmilSnONMeojpXwr 2gv3jzqS9eViJCuIXx71TmJ5DECfPB1JHeLQoU04RhmtzrzdU2.6WRSHBJyrsXmxFNK.mHrW7wET CkeCKBtLXvFo5blRGXUp7AToje9W321KePtdPZ8rI5gdTfwKCbosemZBIADkTyo9Qmd0avkuJycd WILkVQ8.47jW7zl70OnewUgL_8bBip.rJNSJUeSbmt37yos26HNo8T63j0O_BjEJRtTCDRy60Yt8 xRmvfuIu86FvMOoH2JWvS3uEUaTaV9NynBDWWci5WjZb7DTa18J7sTzg8SdLNnLSBvWk6nQRaxaB 0W3UUNwqoCkEka2flapNyXpgBNNljz7kigcG64F0Ay0GAMEC7hWe4exFHwfqoKJcXGb55EUhMWrU xCigRRXC.DDqxnuPtvB2XEnmutyaM2mCzDpdE3VGwuEDc4j7WhCatjt8bgFqqXR_E9TwcV2p61Bx Ol46RkHBh3VmuhSlzSO68MEPjLOFD5BfoolUxk0RqlNHbd6ecsDd7ne2uYzR4cvK.tqOrgfV0p7U zuyTms37fztbu7SDFcwq6OJ6b2wsqG3tjusa53R8dLzb2How_9oILOnFRIT1h26FFgcbP1u_KJkD guqTXPtDjQ37vaqSDY96TQKcyxnbSHQ_CBDy.XZCeYehcZx5eW0_HtbTZ1ipNJ.ZqUKhkNwOcTm8 gXWDm8h9Y8lT8AfXs9jBtpVcaxotposW1aNaO04CwyTfhLv.RM6OlbYZvQqz6Ohc3fyKlYS_3fJN PkVWKZgR.RhLSnbZdq2kaN_INiVNHN3sZvGUYF.LZT9.rJLtKsUDrFoYIg01yIBdu6kNmoBcuhOY aS4A2x.aaiOOjreGC69ddfVejw9j2nq6Mf_LrP4zLd4P4DAGbtBnqMfZvYUXps7k78YPTbyNRCKK .laNOm66tEy4ucx5B54N9dXH8IgzOphDOnr55HEn5MRmsDrifbAEu49KBNQoiF9P3zVO8T7dh4Fy ZmbPSGKoetsgj9jFsK57Wim4SIoiYoMht962wHsMMIQf6ARKD.6s7eOP9qFAIrN48Q17Yf9Ua5mt sahEAc.SctWyUbI46Vy4WjMrPJWZ6fb_7RibpnAh56YqJSu2RmKmjsn61u6Pq8kbuNLxmwTurKXi UXu58d9lhYIq2 X-Sonic-MF: X-Sonic-ID: 15dca736-2803-4353-b960-d47a0a37332f Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Tue, 16 Jul 2024 19:32:02 +0000 Received: by hermes--production-gq1-799bb7c8cf-b6h6x (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID fa2e09fa8f8b471444b445f4c010eb76; Tue, 16 Jul 2024 19:32:01 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.600.62\)) Subject: ufs / tmpfs _vn_lock order reversal during poudriere unmount activity: ufs (ufs, lockmgr) @ . . ./vfs_mount.c:2260 vs. tmpfs (tmpfs, lockmgr) @ . . ./vfs_subr.c:4172 Message-Id: Date: Tue, 16 Jul 2024 12:31:50 -0700 Cc: Bryan Drewery To: Current FreeBSD , FreeBSD Mailing List X-Mailer: Apple Mail (2.3774.600.62) References: X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.94 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.94)[-0.943]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_THREE(0.00)[3]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; APPLE_MAILER_COMMON(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.31:from]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.31:from] X-Rspamd-Queue-Id: 4WNq2Y1XkRz42j1 [I CC'd Bryan D. in case this is related to the failed rm activity tied to disamounts that are not happening first. I had reported on an example.] I got the following from poudriere-devel activity on a system running a pkgbase main debug kernel. Note that nullfs_unmount and null_lock are also involved: lock order reversal: 1st 0xffffa0009027d3f0 ufs (ufs, lockmgr) @ = /home/pkgbuild/worktrees/main/sys/kern/vfs_mount.c:2260 2nd 0xffffa000903b05b0 tmpfs (tmpfs, lockmgr) @ = /home/pkgbuild/worktrees/main/sys/kern/vfs_subr.c:4172 lock order tmpfs -> ufs established at: #0 0xffff00000052708c at witness_checkorder+0x344 #1 0xffff00000047d0b8 at lockmgr_lock_flags+0x1fc #2 0xffff0000007d43bc at ffs_lock+0x64 #3 0xffff000156483cd8 at null_lock+0xb4 #4 0xffff0000005c0ab0 at _vn_lock+0x58 #5 0xffff0000005aa5c0 at vflush+0x138 #6 0xffff000156482a94 at nullfs_unmount+0x3c #7 0xffff00000059f040 at dounmount+0x714 #8 0xffff00000059e8c4 at kern_unmount+0x298 #9 0xffff00000086cee4 at do_el0_sync+0x5dc #10 0xffff00000084493c at handle_el0_sync+0x4c lock order ufs -> tmpfs attempted at: #0 0xffff00000052782c at witness_checkorder+0xae4 #1 0xffff00000047d0b8 at lockmgr_lock_flags+0x1fc #2 0xffff0000005c0ab0 at _vn_lock+0x58 #3 0xffff0000005aa5c0 at vflush+0x138 #4 0xffff0000003dc280 at tmpfs_unmount+0x58 #5 0xffff00000059f040 at dounmount+0x714 #6 0xffff00000059e8c4 at kern_unmount+0x298 #7 0xffff00000086cee4 at do_el0_sync+0x5dc #8 0xffff00000084493c at handle_el0_sync+0x4c It is not always obvious when lock order reversal notices are significant. Sorry if this is just noise. The context happened to be an aarch64 system doing armv7 poudriere bulk build activity. For reference (outside the jail/chroot): # uname -apKU FreeBSD aarch64-main-pbase 15.0-CURRENT FreeBSD 15.0-CURRENT = main-n271137-d68d12481778 GENERIC arm64 aarch64 1500019 1500019 That is from: .snap20240711212638 The armv7 jail directory tree is from: .snap20240711211723 =3D=3D=3D Mark Millard marklmi at yahoo.com