From nobody Sat Oct 28 06:00:54 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SHTRm5S8Nz4ySmJ for ; Sat, 28 Oct 2023 06:01:08 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-20.consmr.mail.gq1.yahoo.com (sonic310-20.consmr.mail.gq1.yahoo.com [98.137.69.146]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4SHTRl4hv9z3Xxc for ; Sat, 28 Oct 2023 06:01:07 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=HZujWIIA; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.146 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1698472865; bh=YpDdjQk/B8EwwH5Mb1GrxK6M8SD/EpSv91H+tvh1MrU=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=HZujWIIA8/ENcaulRhoL7BOS5zI1eGXi97PNZUiAknsXTTh0M9CJZN8EjCYu396uGZMRc8I6WPjP8svHce6UHURTEWY/RDg9siTiFKgL23+5iHsjyFgPbAkNYXLQBeRr8/hNksbdA332abM1s/3humAtA7ao3sTYVMMi/Kz8HaIcafKltg4Go5vEyQ/rvJEf7oM7MkSSt+MBMMd5S23u4bZSx6KMPvIC11ZGudP2cuE/vDOLl2DM7Q6sbO5fPN0bhmZ3eQY2u4snhQOcC++CYzl6grKxmABHBLpVZvwoonMx8Y7qABg/aXxwxURrgd5ueb9gBteDvrCANqyz9YrDRg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1698472865; bh=DURwcYi0v5PRe/rcsK3pYPy9kv87aFz1eLW999Lei4K=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=Nr3Mfq8KYjvjFIXXMuFDxO0JBVmKHvp9MDML4Xe4GT2iB2ayUHuSdkrdK1z+NmrzupH/fyxcQynvg64UWfOpYXemkXAc09qjCf8f0wj1IK9ZIfMfTp/vzn2cfChz4+yh8TjHTRmBYcuHesaXxToxb+61pGsd8WQGjLtrnDItQ5mN66F8fRhIb0ALDGJkSzhxOcmq29t6/j/BvrpSTlf7gPdNA+oAx+YgMQilJHJUpuMSkwiHlytdquUqsmxyOJjVs8Ni/kx/ucy11bQNwqKPBTRSn1ltzz/qGykgNoZpnqopxDvAyhaeWZb1h4b44ce2xhxV7xflARtydWdC2T93XQ== X-YMail-OSG: ubmAF4IVM1lGwUioA6aUO95Use_7GfNHfUEF_xo_n5Jl4.DY2L8ayuKITOBYOAC zLSBAG0pTunNqY6ltG7WdOPLI9I_mTMcc8nlMyPtZ8ij2H_8mEFsfW_1bLVudIfKBTxlaJjmiBAy xsc2QC9JlRkYfrukftPKInU35pVhjHpIJm2CXHBqKxbvu0HwU8aC5t7IEUOAH3ponsB1Vnxusq.R ROkPhRd.VsVdiab24NFIJO1VuSSh.Ws6yln9HJph2dv3KHEaf3ok0YHUc3EAWbxKwmLLhw0.3DqC gEnrFkldxQb1_UNshTI2SPM7p2VVU7dpVibkYXXZt8fJO36dAWqdb3wGvymj70cGzBzAEIQs6gXn Mp074aBLE2.9yh7ELSIWPuKPcQNI0..bIcKCFYD.UcvHvddZDPNisfWkqJ0blBWHuXuv0Z6Lm0DC w0vyIw64aAwwyBTEv.rbxoTOwqIukJgmWhwdyJiO14snooi2r6x38YrskvPu7bOORIgvq3jlk.RS Nstvcnhznnj6IUTSEWNzF5MFpdNS1V.uA2AhnG8O_VW8uUEnVz07lcQTgo54MsDMwGYOD20Y5mTI KETnqxYXENB6O1shtxNrZspUXkpLspijM8a3UxshwWI1RxATaZXdFRV.XcHk1aVLMKp8Oq3PQvOE IrXkJ5uf81nBpcBn_FFFDcZcXDSmGl0TQn8GMj3lAJY3xai5vT_Uipg_UDQE24RYws.L27O0i1Xk ezA8j7M8s.D8OLeFtmenst2S73GUaODknSd6KHIQwselMmnXjtzacqTT2lSMXVpW0RVLDfJAFihv _XYF1yyV8U1BSgCWNhkvN876jm4_zf5gg5tcHB6buvXsNc8ZN9_WVZPRQl2pW9PvswipO9Le.xqB 31SjJpepA7Uqd3_iy7gbUHYLY7a553o95BzC282Itd_n1xOGH37JwVf5tTjGdwr35dsRlyBRukl0 96FQDK_HjpU8WST7qJhu32ihDyqMebwUpRaODcTbe.B2bEOq1Yvu7AWXSkEmqP9Ul2UHXoMTAasw lUtDKslxj_5E2vq8VB2.7tEErXmZyKV8L2zHJbypkyeXShx3pXHJ2fQd8Ka.jkovmo.bDHa4HhbD HICntMxzihnz0yVYibnmTYA7S5pKSi5lMm3cIgDZAaMMkJ4IYG.FbyalwukO2ocRiceoklHyNbun mTecU0azZpEgTlTUvUS2Sgzj2r_XWSeC83f3.b50ud50n_j5YNY3yLJ1ZLmbQHFlqfN1SRKo7oq3 Xr7DpfVG2G.EVj0xhdaZfmur6B6JNHQZRJCOCIOKDEmOVvRHs1ksoCrlYJt3KYPYGGdCJSQ_yMqv QM9tV51dXBoiqgwmSWlgFBRlhx_iHVvBqy7wEgc3IUl1UpglRxIV1grwePlcT1rR5VzhqL4Hk91W ODBBfTOaQnqvQ30ukqoGGAN5buAHrFa3x2K2TrvMR8Kp37EPgeEiMKwbvRtGKTrMMqmRQ1tEFP.w R67BpqFfm5440Hy7t14IXa.o0._RVj3WIaV9JLRjDaNxs2dvAVibOfhS9AMAsXHL.ZlMPCHf_vGc GLQmK3Lym4Kz6mfJJjMsys1f3wlhexL.rLAvs44uRQiDV2pywSZu4Pf7VPtXYGo1hvFza8DdOMhi xxThMiH50_mXcK3lSZkpiJA66ERdUY6TfzeJNUcpzfJTa9vAa0y8ZJcnHlLGONXG1H13OZ3XosZ0 oY4UVivBjPrNirxuTDj_aLKvikU4zAdBRc4PgwL0BC8zf4hP7o4rvo8Z_2UFU7uw1AnLEXQb1Uq6 BzyHWjGFyKDlGx5Dvmk50pIoOGZDJ5XCriVrdJg7qsnmeFFArRlK69QPMxavlXfnSj0y194FJGGP N1KJK0Htj3J63DQEy68D1Uzt0SEAG43GV7dTIGozLqX.SxN87JS.dzGddh6hQ.IJRXwgnSeza2hM aA9jATzEnS8snLiJQ52hSjfdxDYRRxCk4QT55HSdvw7bwf3oDJuob0M7ldko_AuvIjZp3h46HJip W8QJPKnYD7jXKY676YPfteZ0tNHd.GwFHyY5fj5F.7h_JNI7aXx7S0wuEF3WEcRkcHeO88Pgm5Hn GwDdSI_x2mJwfpJILkVm0Gneh3yRFEVfu34yTljuth3apRA._7N9HVEy5VOOHcvXA.db9lz9CuQ_ l84Vwkm.GDuZd1pDUoSDHjQwNL_AfFwaExux8xOcKQ6dCxWn48vk.B0S8BPl1xU90UhEwIv7q834 ip4Zno4PPkIOA3EZ2FVzZbQ4jZPYDjR1VTthlzCARoaO4_84NhaJ9EG4wLWBfxhpbP0D8Ei6UREt A X-Sonic-MF: X-Sonic-ID: ff26ae1d-44fd-4cd2-8036-e0ed118b9f28 Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Sat, 28 Oct 2023 06:01:05 +0000 Received: by hermes--production-gq1-59b5df67b6-tg9nw (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 725fbcffdb8fe9838dbb019749349bf9; Sat, 28 Oct 2023 06:01:05 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.200.91.1.1\)) Subject: Re: 15-aarch64-RPI-snap From: Mark Millard In-Reply-To: <13B64416-4334-4070-8588-71F7D938350B@yahoo.com> Date: Fri, 27 Oct 2023 23:00:54 -0700 Cc: Colin Percival , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <3B40F89C-7E5E-427F-A7A1-2D37CCC06A6F@yahoo.com> References: <0100018b6a9d257c-b35e4157-ba97-4aa7-988c-aba797c6d2ca-000000@email.amazonses.com> <13B64416-4334-4070-8588-71F7D938350B@yahoo.com> To: Glen Barber X-Mailer: Apple Mail (2.3774.200.91.1.1) X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.146:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.146:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4SHTRl4hv9z3Xxc X-Spamd-Bar: --- On Oct 27, 2023, at 22:24, Mark Millard wrote: > On Oct 27, 2023, at 21:34, Glen Barber wrote: >=20 >> Relevant output from the failure follows. >>=20 >> Glen >> Sent from my phone. >> Please excuse my brevity and/or typos. >>=20 >>> On Oct 26, 2023, at 2:12 AM, Colin Percival = wrote: >>>=20 >>> =EF=BB=BFErr... that's an interesting failure... >>>=20 >>> Disk corruption? >>>=20 >>> Colin Percival >>>=20 >>>> On 10/25/23 23:05, root@FreeBSD.org wrote: >>>> = ^ >>>> ./offset.inc:16:15: error: null character ignored = [-Werror,-Wnull-character] >>>> = = = = >>> 00>#undef _SA >>>> = ^ >>>> ./offset.inc:16:16: error: null character ignored = [-Werror,-Wnull-character] >>>> = = = = >>> 00>#undef _SA >>>> = ^ >>>> ./offset.inc:16:17: error: null character ignored = [-Werror,-Wnull-character] >>>> = = = = >>> 00>#undef _SA >>>> = ^ >>>> ./offset.inc:16:18: error: null character ignored = [-Werror,-Wnull-character] >>>> = = = = >>> 00>#undef _SA >>>> = ^ >>>> ./offset.inc:16:19: error: null character ignored = [-Werror,-Wnull-character] >>>> = = = = >>> 00>#undef _SA >>>> = = ^ >=20 > Are the above from a ZFS file system? UFS? Something else? >=20 > Back in 2021-Nov (15..21) I had problems where ZFS was leading > to blocks of such on aarch64, not specifically RPi*'s, various > files but not the same ones from test to test. When I updated > past some zfs updates on the 23rd the problem stopped. >=20 > I also have notes from 2022-Mar (19..22) about replicating > another example problem someone was having with files ending > up with such blocks of bytes but the testing was on the > ThreadRipper 1950X. (The replication showed that ccache did > not need to be involved since I've never used it.) Again > ZFS was part of the environment that got the replication. > Mark Johnson fixed sys/contrib/openzfs/module/zfs/dnode.c > during this and my ability to replicate the issue then > stopped when I tested the patch. >=20 > Which ever file system it is that holds the bad bytes, some > attempted testing for repeatability of the problem could > be of interest, some of that being on aarch64 but not on > RPi*'s, some of it not on aarch64 at all. But it might take > information about the context to know better what/how to > test. That could include information about both the host and > the jail OS versions if such is involved. Those last notes are likely too generic, in that normally official buildworld buildkernel activity is done on amd64 for all target platforms (last I knew). (Not that running such builds on other platforms would be a bad problem-scope isolation test.) Any notes that help delimit what sort of test context would be a reasonable partial replication of the original context could prove useful. >>>> fatal error: too many errors emitted, stopping now [-ferror-limit=3D]= >>>> 20 errors generated. >>>> *** Error code 1 >>>> Stop. >>>> make[5]: stopped in /usr/src/sys/modules/cxgbe/if_cxgbe >>>> *** Error code 1 >>>> Stop. >>>> make[4]: stopped in /usr/src/sys/modules/cxgbe >>>> *** Error code 1 >>>> Stop. >>>> make[3]: stopped in /usr/src/sys/modules >>>> *** Error code 1 >>>> Stop. >>>> make[2]: stopped in /usr/obj/usr/src/arm64.aarch64/sys/GENERIC >>>> 1115.66 real 961.57 user 60.54 sys >>>> *** Error code 1 >>>> Stop. >>>> make[1]: stopped in /usr/src >>>> *** Error code 1 >>>> Stop. >>>> make: stopped in /usr/src >>>> rm -rf /R/ftp-stage >>>> sending incremental file list >>>> rsync: [sender] change_dir = "/releng/15-aarch64-RPI-snap/R/ftp-stage/snapshots" failed: No such file = or directory (2) >>>> sent 19 bytes received 12 bytes 62.00 bytes/sec >>>> total size is 0 speedup is 0.00 >>>> rsync error: some files/attrs were not transferred (see previous = errors) (code 23) at main.c(1336) [sender=3D3.2.7] >>>=20 >>> --=20 >>> Colin Percival >>> FreeBSD Deputy Release Engineer & EC2 platform maintainer >>> Founder, Tarsnap | www.tarsnap.com | Online backups for the truly = paranoid >>=20 >=20 =3D=3D=3D Mark Millard marklmi at yahoo.com