From nobody Thu Jun 27 21:40:33 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4W9Bnx0R81z5QSrj for ; Thu, 27 Jun 2024 21:40:53 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-25.consmr.mail.gq1.yahoo.com (sonic304-25.consmr.mail.gq1.yahoo.com [98.137.68.206]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4W9Bnw55WWz50xJ for ; Thu, 27 Jun 2024 21:40:52 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1719524449; bh=5UfPXcypMwSvnwAGeVE/v3rmWl9I7RJFqkye6YvuAxw=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=f8ZCtiXGnEKxZE+XEkXinJaMGAyU2MTEwFXGRNkK/MnnXxXTFE+yniCBu+JmEXdeHJeTyXxPAgeEM+q1oO3z2K/XTXpswHkAup+ChNqRaIQyh0DZ1JYHejTApwAnV2fQq4l095RqBrFQ9a5I/3T0Wt1mWJxXutD8NnJswG0CbTd/CET8W4OcJjfYbIoAOVnzuE9VoLQJWq3BaEJ7N38JMuOn6Dhp9C5cAlCk9yrNcItv/jeAkTy6bHJpGDG9ffSXnOmD5hhpylTUus27tk+WXPa2CgsD2Go3uVt8T894Bw6STBTvqPB1LrTqXP4jT2cIo+nZhAFofvZOXGf1IDIBwg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1719524449; bh=w4diXHgyzkvKt/xrwFIE+RmmyMnErStCvkVD6USLxUo=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=WFUK0miLQvIwc3s0bB68b5O/NZbi0pXEJwyBmyMBkYI3YBUaGG0ZPmc8LE/gYBkjcD8zSnHypxYOwG0aI3KmBliDMrv8eYJOpJ2HTbTjLPHrp4gqW1cTviFgAf7h/2sMmQj9w0BjRKNGiUInfHPB4KFmcTlcTfOG79+ue38oAgpPtke+YmZxhyy6COe34w1H1BWC/Z6Ddw5qzpzYlrQIry4itAFuSHnfjw4Iq9V8T6MLoPhifTsTRTPkh4mn8aUn1Cv1JKmwRmA4hLEvYjn7yM79JQDMHcbaYtrV3fmfAHQfWERQ1YWMbHGleDSxJowsbs/mvh8eQ46NA/2844I/tQ== X-YMail-OSG: BAW8u74VM1nJRerMascjgl23qb3a9i5_zrycMnZyyjjfkuiu7q.rpXHSEKeM6Mz GTNlNULNy8jI3ygmxDIYW1nUy2s_FN2CYKqL67FhkOWO2YW9afnXctoLppXFsi5R9zOl7BWuUmsJ 4Mg4AEDSdOh_QTKJ9TB7FcimcfD_OMzxONqezqHeuya9sEQI68CphGXvspXfl1ytyDhVxLdFb.Li gjGqzshaG0PtaSJuZ4ngD.kUDdinaP26Lx.WlF2IENRSexwGIomYlB6m2oDDyPoPd3u436ExMPkV JSu1Zr4BC.T1GaAZg.huZYH2k9ZkobabyN3rwviUhhx4JVgNwcnobEIggkobZUsTBQR._djTCiNf 8K.1fDoaudATsPlpPugcGvsR4RfbUhA.SSz.V4f87kh1EHqJn89UxuzlHuYKzffrSyBzXugythye ck5sqL8_sf_iknL0S0HgmqHYSexFLUV4sm5ZRLlRmUHuLmbghhqYhmxOVn4jWhACn8qUCwR9YQvE mnTkJhZ7NpfGPD.fmsoRVDt8K9tPqnqgsEknVEzwlbco2Eg4SlHVZ15o99HGlTc.9.t9SxW7b8jx UI3wcjguWo3jS7vshworO_C_2nFbeucuxSeCVlXzUi.EEnDxfRBPTpK9Fkpml2tdsxRYsE6.QSK7 rjzR4DwJCgbT322tSPvtNHEKoLNJ7VR..s1HIS2PRhoL12nDVN9C0pET.3wqL0qQDwburlBwppSZ 7VYceKXNn8iYENnEY2E.6oaq2yVtBuNQalUHrfAVtxclO8lbOTTS4cOHUUVpkVOsQ2dQQ49Sm8X0 fazly5JZZXbspSpUeCNO1seAMAvtHcNHurdmA7ofcZHs_01nRVSIm6HFRsqzsqj7ihsK4eV3Ulrj 3AaevRZWzaOhUpfh5eUow77WdS8fYID92nM20fN41qGXvJAIgo8kE79qNwzWsVIzBRsWND12wXt6 nu_NIUTmHq6E4YteQfE5lq12VJf3_1zAohQcxtA_KlOTEzBCqD6jiKZ8EtwxE3wJW_ORCxDECnzD XLEUwcLWLxj5B75bk9s1Q4wttRX3E7kFxFqbMD4hnfRYZiJ2L4FbszuVNhWd6VpWkJ7fMYFZIi8a evnv2uCum.NkD6MvV4ZdSxbN.i29AOzEfkzeAG.v8xF5b6kSfnaRFoz5VVi.VStvlvam5JBBjbkU HhyFW3DATz40KtcMOEGpCCjoHpyaaKA_OwAO00zAWFuSrnwZJQU9IaS7jVOms32Cg7MYq5P6tpjV pu9fDn4TItRbCN0pVu5Z3.o8s9fXVr.2k2uakh5UTilKp72v_2WKDKxVFfq.Adx9o8vwv59dm3PM Su9wB6TCVwNenjQRFvfm8jNHywDIwo8vPV.zHnw1eAeaC4xXeokuKu6pQ1iSo8nh6wJ8bavUGEGS cFSLLuS3.Ym.T7BiaDxeXyfdM3nZQ9RL.Ek2PvCgcfTBe0iG94.SUolXfStSHRYO8zJjnFBhld6i v5uDn3KBO5yU.YcRX1hKxQ7K9WATwCpQ7sq4_oyZNB5yxnjYai87LePvDgAW0YehXZHXFNzIAF.D m6jKFPv6aAH3LpVIFDbG23erDzBxEBfgr1OWLvuzuoL7Cpd1Huve6q9cYMfvk71DCH8nPSEWVRAK ncAXuX9HZ1fsuTu5YNkzm4Oe_25_2Vwf.sU3uDrXn5yywXltE5nrz1y8zl5yp4mzTOo5RhHq0rZ7 lNvH4cGFRmwZDsLSyQuhTBu6p.2K71aw7qEYdZs_mPQYnxAS6y6.b2rZxAgkoTGGrErbjbQqOmzq mQB5wJauG2dVpAOKWu1jc1FT2CxbOK40GrFGOPhfND_1Wn3btSC9yTeoDJM8Im9_oE4NNBjXuCzQ qJS4IA9hy9xJ0DacDw5AqVbZ8pPxQ25hCUFS68344LnfF01t_ZjhUkMwUa8UtTTgeMsaZJ1EP_KD LnuZevHQe6l2LbftfVRZRPYlVl4NjtqUCIRh.5SoM1jY3aR_2ahdUs1kopQHK434mjGbOfcN_Mi. tzJCT7JlBXtdA54Ee0MXZbqCyb5V77KfvbWpchYUqgBVcmat0QvMUHy881pall8E6wYQND35k5Ux QGAt3Pu9AN9V_lLJgWffkY4EGUdl447NjAYFf6DX6PMsVNT9JPe9yWpFyeE_9kywbtVLx7LkkzD1 HWMzHYF.HkezrISieF7A.oNREM8wdUSIqRwrQ2snqlfwXDfcN0O84T_ZCrRKrF4QoGLSMXPF.15b Np_yXLnYzkbery2xe63BbOSnD9Q2hFEIZeKytZanGgukRrr3pYqQQZvDjEuxowcxU2lyiqIf6hhs jvg-- X-Sonic-MF: X-Sonic-ID: 1d393369-3122-4718-b0a0-009fbd0386eb Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Thu, 27 Jun 2024 21:40:49 +0000 Received: by hermes--production-gq1-5b4c49485c-4vd8h (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 278fffce284b690b9966534fa45a01c9; Thu, 27 Jun 2024 21:40:44 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.600.62\)) Subject: Re: Git clone failures on armv7, was Re: Git core dump checking out main on armv7 From: Mark Millard In-Reply-To: Date: Thu, 27 Jun 2024 14:40:33 -0700 Cc: bob prohaska , FreeBSD ARM List Content-Transfer-Encoding: quoted-printable Message-Id: References: <5D5B6739-1685-43F5-80CC-E55603181D09@yahoo.com> <8F4F4B49-5ED3-4ACA-B0D3-356D8459BE95@yahoo.com> <5DC2D33F-A8DB-4542-B8B3-A131F660A395@yahoo.com> To: Warner Losh X-Mailer: Apple Mail (2.3774.600.62) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4W9Bnw55WWz50xJ On Jun 27, 2024, at 12:15, Warner Losh wrote: On Thu, Jun 27, 2024 at 10:24=E2=80=AFAM bob prohaska = wrote: > On Wed, Jun 26, 2024 at 06:24:59PM -0700, Mark Millard wrote: > >=20 > > Does using the chroot setup using --depth=3D1 on the > > RPi2B consistently work when tried repeatedly? Or > > was this just an example of a rare success? > > > Apparently it was a rare success. Five back-to-back retries > all failed in an orderly way, though with different messages; > invalid fetch-pack and missing blob object. > The transcript is at > = http://www.zefox.net/~fbsd/rpi2/git_problems/readme_shallow_armv7_chroot_g= ittests >=20 > Is it worthwhile to repeat with different --depth=3D values? I'm not = sure > what the sensible range might be, maybe a 1, 2, 5 sequence? It would > be convenient to avoid a panic, as that slows repetition. >=20 > What happens if you start limiting the memory resources inside a armv7 = jail > on a aarch64 machine? >=20 > Sometimes it works, sometimes it doesn't triggers a "memory shortage" = or > "marginal amounts of memory available" bug hunting memories for me. As I reported in a earlier submittal to the list, I've replicated the problem on an armv7 system running main [15] with RAM+SWAP being: 2048 MiBytes RAM + 3685 MiBytes SWAP =3D=3D 5733 MiBytes OVERALL This was on a Orange Pi+ 2ed. A top variation monitoring and reporting various maximum observed figures did not show any large memory use compared to even 1024 MiBytes. Any limitation would appear to have to be local to some more specific kind of constraint rather than overall system RAM or RAM+SWAP. > Warner > Thanks for reading, >=20 > bob prohaska >=20 >=20 > > > A second try without chroot resulted in failure but no panic: > >=20 > > > : Should own extent_mutex_pool(17) > >=20 > > That looks like it would be interesting to someone > > appropriately knowledgeable. If jemalloc can see bad > > mutex ownerships, that seems like such could lead to > > all sorts of later problems: Garbage-in/garbage-out. > >=20 > > I do not know if the message means that various > > corruptions might be in place afterwards so that > > various later problems might be consequences that > > are not surprising possibilities. > >=20 > > > 47.25 MiB | 1.35 MiB/s =20 > > > error: index-pack died of signal 6 > > >=20 > > > A repeat session produced an oft-seen failure: > > >=20 > > > root@www:/mnt # mkdir 3rdarmv7gittest > > > root@www:/mnt # cd 3rdarmv7gittest > > > root@www:/mnt/3rdarmv7gittest # git clone -o freebsd = ssh://anongit@192.158.248.9/src.git . > > > Cloning into '.'... > > > remote: Enumerating objects: 4511481, done. > > > remote: Counting objects: 100% (383480/383480), done. > > > remote: Compressing objects: 100% (28955/28955), done. > >=20 > > > : Should own extent_mutex_pool(17) > >=20 > > That is the same error notice as above that looked > > to be interesting. > >=20 > > Note that it happens before the later message > > "error: index-pack died of signal 6". So that > > last may just be a later consequence of the > > earlier error(s). > >=20 > > > 47.25 MiB | 1.35 MiB/s =20 > > > error: index-pack died of signal 6 > > > fatal: index-pack failed > > > root@www:/mnt/3rdarmv7gittest # ls > > > root@www:/mnt/3rdarmv7gittest # cd .. > > > root@www:/mnt # mkdir 4tharmv7gittest > > > root@www:/mnt # cd 4tharmv7gittest > > > root@www:/mnt/4tharmv7gittest # git clone -o freebsd = ssh://anongit@192.158.248.9/src.git . > > > Cloning into '.'... > > > remote: Enumerating objects: 4511481, done. > > > remote: Counting objects: 100% (383480/383480), done. > > > remote: Compressing objects: 100% (28955/28955), done. > > > Receiving objects: 43% (1966916/4511481), 926.00 MiB | 626.00 = KiB/s=20 > > > remote: Total 4511481 (delta 377747), reused 354525 (delta = 354525), pack-reused 4128001 (from 1) > > > Receiving objects: 100% (4511481/4511481), 1.64 GiB | 705.00 = KiB/s, done. > > > fatal: pack is corrupted (SHA1 mismatch) > > > fatal: index-pack failed > >=20 > > Note the lack of a local message: > >=20 > > : Should own extent_mutex_pool > >=20 > > But the prior jemalloc message(s) may be sufficient > > context to not be surprised about this. > >=20 > > > root@www:/mnt/4tharmv7gittest #=20 > > >=20 > > > No panic, however, and it seems reproducible: > > > root@www:/mnt # mkdir 5tharmv7gittest > > > root@www:/mnt # cd 5tharmv7gittest > > > root@www:/mnt/5tharmv7gittest # git clone -o freebsd = ssh://anongit@192.158.248.9/src.git . > > > Cloning into '.'... > > > remote: Enumerating objects: 4511513, done. > > > remote: Counting objects: 100% (383480/383480), done. > > > remote: Compressing objects: 100% (28955/28955), done. > > > remote: Total 4511513 (delta 377756), reused 354525 (delta = 354525), pack-reused 4128033 (from 1) > > > Receiving objects: 100% (4511513/4511513), 1.64 GiB | 1.28 MiB/s, = done. > > > fatal: pack is corrupted (SHA1 mismatch) > > > fatal: index-pack failed > >=20 > > Note the lack of a local message: > >=20 > > : Should own extent_mutex_pool > >=20 > > But the prior jemalloc message(s) may be sufficient > > context to not be surprised about this (again). > >=20 > > > root@www:/mnt/5tharmv7gittest=20 > > >=20 > > > Not sure what to try next, thanks for reading this far!=20 > > >=20 > > > bob prohaska > > >=20 > > >=20 > > > Archived at=20 > > > http://www.zefox.net/~fbsd/rpi2/git_problems/readme_armv7 > >=20 > >=20 > >=20 > > =3D=3D=3D > > Mark Millard > > marklmi at yahoo.com > >=20 > >=20 >=20 =3D=3D=3D Mark Millard marklmi at yahoo.com