From nobody Sun Apr 09 18:26:23 2023 X-Original-To: dev-commits-src-all@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PvgYz2qVRz444JH; Sun, 9 Apr 2023 18:27:19 +0000 (UTC) (envelope-from freebsd@walstatt-de.de) Received: from smtp052.goneo.de (smtp052.goneo.de [85.220.129.60]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PvgYz0Jkvz4Qlb; Sun, 9 Apr 2023 18:27:18 +0000 (UTC) (envelope-from freebsd@walstatt-de.de) Authentication-Results: mx1.freebsd.org; none Received: from hub2.goneo.de (hub2.goneo.de [IPv6:2001:1640:5::8:53]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (No client certificate requested) by smtp5.goneo.de (Postfix) with ESMTPS id 547DD101A7B2; Sun, 9 Apr 2023 20:27:11 +0200 (CEST) Received: from hub2.goneo.de (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (No client certificate requested) by hub2.goneo.de (Postfix) with ESMTPS id 47D6410A1EBE; Sun, 9 Apr 2023 20:27:07 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=walstatt-de.de; s=DKIM001; t=1681064827; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=RqbYmqdRU5lNeD/AphaztRfHhoXnW3+dooD2BLGWY+Y=; b=WjWDpzFx2Un+YomKvC8oSR/VQCR9iLRKJ6ZqHnNg4IHhy40ML+ILA4yV5p/51DIyvfTMCO dPfrufrjyWcIBqVJLVGdMGbZcxfPQoaAHGO6U0zHQgz2Uo2Gyt0rL4169apyM4nmUwf17B ayTIuUmbhkRc7irbLvNew7N6DTsttp38hLvRX1VaXacWnrpBaAhxw9LwN1Y7SBV+S+hLXI kbgCefBJn8P3tQYKRNkPS8hevXgU4roqlXcBd0c9isynoQ04sVwUcMi5pWfCOKZA43qcrG H8WD1ub8xiQOBavhKqgWv8oXJOKEF8drYw+VkVdp/Vqy2Oph/AaO8Eq1fxHkMA== Received: from thor.intern.walstatt.dynvpn.de (dynamic-078-054-235-039.78.54.pool.telefonica.de [78.54.235.39]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by hub2.goneo.de (Postfix) with ESMTPSA id AD28210A1EBB; Sun, 9 Apr 2023 20:27:06 +0200 (CEST) Date: Sun, 9 Apr 2023 20:26:23 +0200 From: FreeBSD User To: Charlie Li Cc: Mateusz Guzik , Cy Schubert , Rick Macklem , Martin Matuska , src-committers@freebsd.org, dev-commits-src-all@freebsd.org, dev-commits-src-main@freebsd.org Subject: Re: git: 2a58b312b62f - main - zfs: merge openzfs/zfs@431083f75 Message-ID: <20230409202650.49130b92@thor.intern.walstatt.dynvpn.de> In-Reply-To: References: <202304031513.333FD6qw014903@gitrepo.freebsd.org> <20230403231444.CF48911F@slippy.cwsent.com> <20230403232549.73E331A2@slippy.cwsent.com> <20230403235851.84C0467@slippy.cwsent.com> <20230404052811.DA2172C1@slippy.cwsent.com> <7c75b934-cb0a-b32e-bc19-b1e15e8cf3aa@freebsd.org> Organization: walstatt-de.de List-Id: Commit messages for all branches of the src repository List-Archive: https://lists.freebsd.org/archives/dev-commits-src-all List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-dev-commits-src-all@freebsd.org X-BeenThere: dev-commits-src-all@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_/NSO=6J2gRQWjQg+=NaQ_H9c"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Rspamd-UID: 3c9105 X-Rspamd-UID: 5c778e X-Rspamd-Queue-Id: 4PvgYz0Jkvz4Qlb X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_RCPT(0.00)[]; ASN(0.00)[asn:25394, ipnet:85.220.128.0/17, country:DE] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --Sig_/NSO=6J2gRQWjQg+=NaQ_H9c Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable Am Sun, 9 Apr 2023 13:23:05 -0400 Charlie Li schrieb: > Mateusz Guzik wrote: > > On 4/9/23, Charlie Li wrote: =20 > >> I've also started noticing random artefacts and malformed files whilst > >> building packages with poudriere, causing all sorts of "exec format > >> error"s, missing .so files due to corruption, data file corruption > >> causing unintended failure modes, etc. All without block_cloning; > >> enabling such causes a panic of its own when starting multiple builder > >> jails at once. > >> =20 > >=20 > > what's the panic? > > =20 > manually typed out: >=20 > panic: VERIFY(!zil_replaying(zilog, tx)) failed >=20 > cpuid =3D 7 > time =3D 1681060472 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame=20 > 0xfffffe02a05b28a0 > vpanic() at vpanic+0x152/frame 0xfffffe02a05b28f0 > spl_panic() at spl_panic+0x3a/frame 0xfffffe02a05b2950 > zfs_log_clone_range() at zfs_log_clone_range+0x1db/frame 0xfffffe02a05b29= e0 > zfs_clone_range() at zfs_clone_range+0xae2/frame 0xfffffe02a05b2bc0 > zfs_freebsd_copy_file_range() at zfs_freebsd_copy_file_range+0xff/frame=20 > 0xfffffe02a05b2c40 > vn_copy_file_range() at vn_copy_file_range+0x115/frame 0xfffffe02a05b2ce0 > kern_copy_file_range() at kern_copy_file_range+0x34e/frame=20 > 0xfffffe02a05b2db0 > sys_copy_file_range() at sys_copy_file_range+0x78/frame 0xfffffe02a05b2e00 > amd64_syscall() at amd64_syscall+0x148/frame 0xfffffe02a05b2f30 > fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe02a05b2f30 > --- syscall (569, FreeBSD ELF64, copy_file_range), rip =3D 0x908d2a, rsp = =3D=20 > 0x820c28e68, rbp =3D 0x820c292b0 --- > KDB: enter: panic > [ thread pid 1856 tid 102129 ] > Stopped at kdb_enter+0x32: movq $0,0x12760f3(%rip) > db> =20 >=20 I have the same issue (crash on access of several, but random datasets). It started with /usr/ports build failures when performing updates or rebuil= ding ports, poudriere host doesn't work anymore, as soon as started building ports, the= hosts (several of them, same OS revision, new ZFS option enabled) crash. Also when building binaries for an pkg OS distribution. That host also reports a ZFS RAIDZ pool as corrupted, out of the blue! Some= files from a poudriere build and /usr/ports build seem to have issues with some temporar= ily created files in work directory.=20 On another host /usr/ports is residing on ZFS and it crashes also when buil= ding/updating ports (/usr/ports residing on ZFS) - but on the same host /home is also residing = on ZFS, but even downloading large amounts of emails, the host seem to be stable. Have not f= ound out yet what kind of file access triggers the crash. Kind regards, oh --=20 O. Hartmann --Sig_/NSO=6J2gRQWjQg+=NaQ_H9c Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iHUEARYKAB0WIQRQheDybVktG5eW/1Kxzvs8OqokrwUCZDMDagAKCRCxzvs8Oqok r3AyAP9FON4zWPqVHNHc2cuI68fgm+kB7uJrJ3Q2pXgcBO+SrAEAkNpVEIlf0utS focxU1C3yUUUGwSsoITprL9yVOf5iwY= =7grH -----END PGP SIGNATURE----- --Sig_/NSO=6J2gRQWjQg+=NaQ_H9c--