From nobody Sat Sep 09 01:19:09 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjFWL2JKFz4rw1p for ; Sat, 9 Sep 2023 01:19:26 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-21.consmr.mail.gq1.yahoo.com (sonic313-21.consmr.mail.gq1.yahoo.com [98.137.65.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjFWK09NKz3c5n for ; Sat, 9 Sep 2023 01:19:24 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=tphWE8p3; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694222363; bh=wqX5AFH2jH+nSZtZh3giI4iv5Iq0vNudXur0k95KmeE=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=tphWE8p3+zDN4B2kRkBB7jA5NQnQZTwQVuNulalPc92bwd3jUKaLXhfG50WvjmUHp8ePGH7I8AHTWVXzScfoTX1skjpaqxP6AIrS05ItLKMf4HT6K3heOploJkwq1NuBHqPS26+LHr957bXhJyvaRx3+uJwEuj3/3su+tAm+632LtuoNl4G4AtbhhgaZTzUUBNFD6JOn5Ri9WOj2srVSI8whKTuNMaObKpZ0ABd8lkoZWvgETAbcKNuPRNOLOTjKPfpfEQRRQs1gLYGbh/LssdIWQUmrvsxSr4ZWRREc/Bq5Xw8A3qzb9O4bdA4CKSgKmvwqe7biSPNHk8unvqIbpw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694222363; bh=1TpCDeS5If32Qv/NV8n3/H/SDYbpxTsehHbgFlgrEDk=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=G1RgmNrQMarxfrOXFfizTfT1OEWgTG33EnVqiDEP4IvxWKASniVQZ6+pEGarHZv+ND7WAa/uZhqMvSqI94YNWk+HSV4XYifXBa6ZKPr+m9iQ+ptTKIE1pQJS6e7oBsAEgg/JxF34T6BTOK+ExIP2NMmStV//jsaYmr8EYKv/YK+nzXgpbySSuuzzlxsp5wVal0ul8Ao6nglqCFsJPuJqpfG6xyQS3k7PPjfNx3ty6U9fldxV1JjnPgE7U+TYfGjQoNckN4p0mf1dNUhndCRdngVPQjvKMlt58/TtCBAAyGxOOKo0sIbankYkA4IKB42lYz5REQp/4FHRrOxk6GEvAA== X-YMail-OSG: SHWlyX0VM1nwkdKGbY0mw7w.xpYhCnuu3ZsUjiKH3_osr4o22ERo2aeQPMMYgfM y9vEUex8UiL.eoGiF7WkkGeS2mAuKlM0d0qSYuFyz78ruteYkckPixJ2u3hFRMD0tS2KO3nh1zZ9 Tw0oDcwfB8s9KuYE8ONj3SgM.svvj_jo0NeCk0yN.V67YIOF3tx_xrDdnrb4QiYzdqfg9T3BcQj4 8K.Zcag4KVOgBV4oX9yYfLypftnY5Zw6eG4Dn_MDfRguBrxUbZnahlZq.SDmwR5I.EzEcVojDWaw EpLYuK7ud9T9uq3BusD.amxrWkTZwR_YGK_FcNuSM.CEw1DR1yIQlSK0Cfq8HMi_b_SUzg0d9ADd A0gK1mBJE0Zom84JSpkdmyYpKL2K59f.4FK01gydJsT1JsxmwUxE4gtg_LKkATlB3rQolFZicnSS VCkTw_HTrcFuZ5ZqlNWHqlNJafg4oitOfAV5lAc7RClPYThLsKugmSl.l7HyDBXRsLO5TN1Q9qnX 850YPQ6ul32JNFo_4vx1hS_hG96DCFguUP00tqYgOtg.4fjAh93eQUnAf_32xF7PRzbE.1Auc9CY .zew3mIxeD1ZYF4WcaHX.jEjFO.UDGmpvC0FJMW3urAK.OhtQXPExTUcAb9KwtSt390Yd7Kcsiw6 E0Stb4ims7SY6doUsAgZkx9fmu5ziEnY326pySqq0B5LNst9kXqcfS82hXZ1IHBIV07HICQ3G1YT 473rflZ.HRYS2O5jjfhAlwFhbS5jcT7DKJmkl.hL6iSylLpMCLYMfW1rOEsVsYl7QBAWd0QyFO8a RAa0WpAOCDV8eK7X9EV_biPL9KpzNFzXIu6uAvvKzkOri4pBSRuGNXFWwTlRvilcDwYxr86iGhM4 Txa6Q443.4EgzUVtG7ilqIGlBtqZ_zLV3sG487DWBl4cPP2_IIoX3UqfaGzBrYy81JljOPIKH131 lCug5T9qfmy1O0wcP5isQAopt3XxdZHp1.ttcU66CGPWPHhurd3G3wqTWE2wdvpj9hRAQICD5cDX kEgNPNDS38jmNjWenm7kpMYxEw49voMyd9lFiHNDuWTOHza6w8mzNT.YPgmImfMXA3Yxfo7S0USu IxkiMkTGZWhYms59Gv9_NCFMdIu.jlk69y2KaJ1ITzaHmTjaH_Ihyzo9DrQ9B1tJQEOJIBht_KZJ sgty6UX8kyYgSRrd_m4lqsaPK.YHTqLcioJj8iyjBTMoMm73Hv19dBIqiSF.05SKvV6Mgcq9qtsg pNb3NSPZ5rpkcqHLlD6rWI7SkqVJtyDOJyzzkDpmFRjeQ2s7RI.AaYjyf6s2ka2l9Xu.8mcgU_HL OzBmz2bOS3j9qtcfGAzHVTSLTXo.n4Wv0vTeZ9AGCbWE3X4wDrZ6bQWKFErASLrgd3QH6MiPrQ8d zLSogHl8qx0qqHrSddAATQ.Qw0G5yT1bTL9LoY_L6CXwT32yxcMItKUSuQn3tFboFbFzWlBSAIqT 9OGzqNdgty3XuQr._OIqbLNTRmCLRs00pBOfO002Aw1WvmJyDgHmbv6boTWV2fGQ0G_RSuSHgjr1 ephbGgbLopMMcWcHf41.i3ZoqCUJjyKDnWShGaxqvicp4RMBiCivSosrYnUCxb8ehZFdKfcvAy3S SCe7.NUNJqpYv3RV5OmdUseo4Ghg.3FMKHdvhdtSHpf6SN10M9utuBpRNxybeGhTV.Q4BLs7USv0 wVct2w.fqyep99NeA9RsTrf2Vl2D0rGbRMsLNwWWLEytURaPeIVocgeIJvVEOQUJ6tlcrAQZqWNK 7NAGjwPaPkwjNQNVkJETqojrZfsmo2k4NG1tLoBDfaTpDozQflJ24miLbgVtC7uhWSxu2nID9x7L beulFCMlFH11AnhqtuCRdkRosiduu8c4Lig2hX.KbByqyrIYqYsQ2FwlNhguHdzViVXtYc2QKmzE itvClJRonD9BYhcci47ngMwrav2XJkJ9oDJZt2qRSiQQgIDZaQjLmzm.PNwkB5Gz7FW6mFhX5nxf UbbfN6tMr8tFzx9DmZe9Qh3R7W8fNi12a.eJE4q1EtjOKJBJEAKqfPn65mq7Xaw5_KZv7IEByRDO Nhz60koXbB7aoQIhEFyn6e3QejzPH7E5BD1OQKoFMUF74Qk3XGRAcKo1LEKM.xKr6K8iFV9603rS lDnIBK56FyIofyEzFc1qxe1HBduG5i1B1lZRrAR7i7crP06cJyHYUzRgumYVRykTCWP7I6gq6jug rKpC0PfOed3sfmzE48pHxXYkl8ZbDpJhhlLqQq9vhwyf21OxRcKchFilx882I1.HUcCc97o19CVv sUMZnb.q0rQ-- X-Sonic-MF: X-Sonic-ID: 8943c28e-9c3a-4d3b-a271-a12530d7bef4 Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Sat, 9 Sep 2023 01:19:23 +0000 Received: by hermes--production-gq1-6b7c87dcf5-m4lb7 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 25afddf1784b80f9a64ce82e4d6dbd5b; Sat, 09 Sep 2023 01:19:20 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics From: Mark Millard In-Reply-To: <05C47E15-640D-41AD-9C4C-73A1D5041CF4@yahoo.com> Date: Fri, 8 Sep 2023 18:19:09 -0700 Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek Content-Transfer-Encoding: quoted-printable Message-Id: References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> <2a25427c-5a61-3f72-4e31-b7666741d38d@FreeBSD.org> <63717d32-f340-1320-3335-85135d1b62bc@FreeBSD.org> <05C47E15-640D-41AD-9C4C-73A1D5041CF4@yahoo.com> To: Martin Matuska , Alexander Motin , Glen Barber X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.47 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.970]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.84:from]; BLOCKLISTDE_FAIL(0.00)[98.137.65.84:server fail]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.84:from]; TO_DN_ALL(0.00)[]; RCPT_COUNT_FIVE(0.00)[6]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RjFWK09NKz3c5n On Sep 8, 2023, at 17:03, Mark Millard wrote: > On Sep 8, 2023, at 15:30, Martin Matuska wrote: >=20 >> I can confirm that the patch fixes the panic caused by the provided = script on my test systems. >> Mark, would it be possible to try poudriere on your system with a = patched kernel? >=20 > . . . >=20 > On 9. 9. 2023 0:09, Alexander Motin wrote: >> On 08.09.2023 09:52, Martin Matuska wrote: >>> . . . >>=20 >> Thank you, Martin. I was able to reproduce the issue with your = script and found the cause. >>=20 >> I first though the issue is triggered by the `cp`, but it appeared to = be triggered by `cat`. It also got copy_file_range() support, but later = than `cp`. That is probably why it slipped through testing. This patch = fixes it for me: https://github.com/openzfs/zfs/pull/15251 . >>=20 >> Mark, could you please try the patch? >=20 > If all goes well, this will end up reporting that the > poudriere bulk -a is still running but has gotten past, > say, 320+ port->package builds finished (so: more than > double observed so far for the panic context). Later > would be a report with a larger figure. A normal run > I might let go for 6000+ ports and 10 hr or so. >=20 > Notes as I go . . . >=20 > Patch applied, built, and installed to the test media. > Also, booted: >=20 > # uname -apKU > FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #75 = main-n265228-c9315099f69e-dirty: Thu Sep 7 13:28:47 PDT 2023 = root@amd64-ZFS:/usr/obj/BUILDs/main-amd64-dbg-clang/usr/main-src/amd64.amd= 64/sys/GENERIC-DBG amd64 amd64 1500000 1500000 >=20 > Note that this is with a debug kernel (-dbg- in path and -DBG in > the GENERIC* name). Also, the vintage of what it is based on has: >=20 > git: 969071be938c - main - vfs: copy_file_range() between multiple = mountpoints of the same fs type >=20 > The usual sort of sequencing previously reported to get to this > point. Media update starts with the rewind to the checkpoint in > hopes of avoiding oddities from the later failure. >=20 > . . . : >=20 > [main-amd64-bulk_a-default] [2023-09-08_16h31m51s] [parallel_build:] = Queued: 34588 Built: 414 Failed: 0 Skipped: 39 Ignored: 335 = Fetched: 0 Tobuild: 33800 Time: 00:30:41 >=20 >=20 > So 414 and and still building. >=20 > More later. (It may be a while.) >=20 [main-amd64-bulk_a-default] [2023-09-08_16h31m51s] [parallel_build:] = Queued: 34588 Built: 2013 Failed: 2 Skipped: 179 Ignored: 335 = Fetched: 0 Tobuild: 32059 Time: 01:42:47 and still going. (FYI: The failures are expected.) After a while I might stop it and start over with a non-debug kernel installed instead. =3D=3D=3D Mark Millard marklmi at yahoo.com