From nobody Sat Sep 23 21:00:47 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RtM4K6tZ9z4vF7x for ; Sat, 23 Sep 2023 21:01:05 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-25.consmr.mail.gq1.yahoo.com (sonic304-25.consmr.mail.gq1.yahoo.com [98.137.68.206]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RtM4J3LFbz3Rdb for ; Sat, 23 Sep 2023 21:01:04 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=HwAa9fBK; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.206 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1695502861; bh=fNEWeRCRaiDsAIGKtcJhjSCz38qW6QdHxFpLWXeIopQ=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=HwAa9fBKAKqyWn/RIyU1crW7exPywJSJI1hilxoCZ5ByLNQlSjp5GZzJj2Qii9mP+zfUj5MfMjnagPg9LkVfy/cgi0EJIpweiAPF7ZuQiGtIuLLytVPRl2f8hjtD+pUmsO2q2s0do6ILQj6jQvzRd8nWt55kWojSkHxcZBD4SAQk+DKzioZpYVdDAF5Y9+grweI4Lx5w3izMoV+P2Dk4J080UwBQpWZOMWquqYlxvjFTVcXimgAo3xcibue1qKyuhoiDBN1G+S2LEM422Yg40RalL0ncT8TQGzgWNShGGdE7s6bIrNdycwOI3G1JBJMqd5mZIxAUJgRWlwZyvf5M8g== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1695502861; bh=mRCHEk7rFOks59kiR3PAZV4j9nrUMcxThkP4GwamRhR=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=h+FU0CKQU53enXDWt8J+IHi5txNGpeqkDfV69OZFydTc15Bu1yWqKSZSOsCwjsJ84lMSlagr9ehtUsnN2rWZ+vn0Ce3XAwEOKGLMcLrovHtSHXcHNAR7Ju0WV5bUQlMSt+mPe6ck+97PS0PZtKin2lVCBRUqvldVNNg7B3UgLT+IgEGm77RoYTnmEV0lo/XkPI0qNQoisNI/GczuYuEqdjfea5X80Gpz5zUAXMo/SH7vdEUyqeKFQrFboMYtJ+sEhQ8Wb6z3x/vaGVfUtcOLncQ5JGUQSZ4k2F/Bj88dvyiq6zJfXEkZq4ZHQVoqVxFR0Qq9k+Y+rw0Wz+yKuw+PTg== X-YMail-OSG: ZEXCyRQVM1noqujkJM4S04.whi_3Y1_srIsR5LQTZ3hfeiNasRUQIGiyrAXn_IE Y6RJPXb5I_5nX8qHaymLqpuqBDhMu..TZ_Wyy.iD6cdMG8XeY.Gyx3SlmQgWjAM1FI39r6eXvMAZ 7PUr64hfdRQVMJMumpd_br.2N5prRRNayaH4ZTrmcUoblpPLiI.zilLsbgIgwOQP3m2RYLqIa9kn ohGMxvbXx_J0gBhuS2NMl46faW0Y5DJpFOH15DXinV8bB.pQHo5Lrz.NlKyHQcXYhBi29LdX3byK XXSP4ZXOYhjW2YkFUaIGwNq_iitfhkrwkMKbcV1mZg_ImObV_y0UdqJRyroFWg3wMHnHXLLdtcee NY1v9fn3zWNaecfeShSSmHEp5mxc6cCVA5WSUD3SnlqgS4d5XhUt37r4abQ437mbhKZ6DAvCe6vW _GW_xRy22dWhxyeq0BoYcDuoZ6JtUmO4PaR5FSDB0KxG_xqp41BE4l_J69Wuc8_Lr4yQbFaW8eyC 2214YuTzPnxEl7F__BW4AatY1LawLa4TseqBZtaiUWOLnJujcrOHlvn7b.nKan_DuHZDiVUe5oqF 4Pg9DCxMH7zn0_qnjquzQonaH7vfPh8o9ojJFXSUJpSC3FhWAhsKSLMUsE.uZH7xru.MNC7ya1do DwNGxMEKuMWgMkaIiTQVP90U5ECIzwHbZoFYSUBB7umxb1ox2CsoVqCSMopSLCGItBCdRHnconZh EhL8S9uo.oDl4NplGHOI7HL4qQbXg3HoR..iHe5KfcdFIgUVqfj.UYpCgvHj9FH1PDXRfkUSPm0d C1wSx.aVagC3lJLzRbFERw_iViNcSBVB6Rd74cYKtKgrB9m0xWEIbrUT7qqOU4vtn7q7zHS7VqrF .IyqS7RGH43brx4ijbDG5QEHydxMeOC_bLBQlhth.Agxs3Oer2RhJmdIpMBC_IYDl1vtWsfxD2Wn H5Tjs7CyZTVfmXOKkatz.KsdygdCtlV_1bDoHmKUlW8QXugAfOAWTU94I2cZvQEOxRhPpGa5vWq4 WGPQ7Q_n1cEmbpCaH4RWZlC5Jp.3BuRSARFHkR9iiep4yjASl8Ik7EAsJZZPRgHTZt5vtNFP_cPg om2iqtmKHb0R7V1xPlym3tHv42KMdFOavVtckDMWGdYZGkygBwbPLJEkFYWdWeV_J.EEZSY..pD1 8RV6gQAq2_lw61hLnhVBIj0js4Oa4JLWWXZ3qTUGlIHlaf9Fz6sllqGB..pp6eOcmfNFCs3I8vPa TqQ7HUIEkbfOpcjWMSFH3KT1.TGRd9qxLE6H7ETKT95nPDORbnOPhefEu7knFr6jAZn1Yv69lran vW2s7zeRwQdTSfFSnkbQ.D6BBCVWvE7uDdUwt53rwU4mVPIu5rMnzvpoIu87kHfqmz6MUTsUr8K2 inJj9QPoJEdom3oKv02ccKpKl0CbGgVZLUmiCGHckPWAXBlonmE4jId_vrnZm5O9MP2ex2YJf1Lw ITbKndgK10NU4QuL9nYYz.xheFOoBIilIRpnCwnvPrRDSKwhdxjwCfiuohmBEKcszyOFB_7gKyOF EjK7ZvLwrP_hOs.Tq6jbBzrkVQtXIkdd8C8QNYWFFwJSAcFEJf3DlvGa8trvL58Osu8VJ63sadHK SmahOClh29uDjogLmLVvXj96Jo1tV3Q1mSWaKSMAnMzhZhXoePA1_nBva6xBr6md_DzDcqi0WpDr prIXZx0S31N141CXcjwbJCVJTiYRLhgm3q6ATXlN7YuLEaTehRY14qIJy_CQfA9f2.eH6cLecscU OH1fYQw20X7T.UrnRT6g.3zXtlmDicsW..DLV.Fcp4N6gjG1zmsYOCgmJEjQQr9ELpdKpxDjHyNV nYJ0.tw0I5uOTPtfpPXixQT16Cec4tB7uI5FGJZ36Kuzzkd9A80B3hRZrr.KmgDgLrxB6xaXJO.T Ectj_nuq23Ia7H5puM_LpKJpTU_Us9pu9dhIOBA4CJSR2ANuLUrtKuXQXY.SnkALzzYH0N6uTEte DSPPtVDF4fBfVy0BrcLOvW4NtH6x0EUxnUEvcP3E68ssZ2kkXsLc4gKiFp8f4n_inRvwhKJH6sQ6 Nd55lTPGyzB1tL4qon84YT8OngsTQIzVTm4o8VPG_gA3fVdMVM5PCSJxgwmunPjuT1I6DoG_yo_5 hVjFug2bL8wrtWfYYRLPMyobfzUai1q5uAboRJkTmPZUjwhqyOycc6ZyqaX5HkSBYLF4Jiw8m7Pr nUSTEfVPbLAplpGaoqjIM_oXP_Utj7we8UeJPL_.BAY_s1MKoOPSC_q.G9dJHYNuF4R3rX30Zw9Q lsA-- X-Sonic-MF: X-Sonic-ID: a1858092-1332-4f1e-b542-18df9e853c83 Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Sat, 23 Sep 2023 21:01:01 +0000 Received: by hermes--production-gq1-77657878bb-zxf8b (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID a7ae52163fc262a1a7db5f5c501df073; Sat, 23 Sep 2023 21:00:57 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Shutdown -r under -current hangs on RPi3 From: Mark Millard In-Reply-To: Date: Sat, 23 Sep 2023 14:00:47 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <0AADDACB-ABA3-47FF-B3A7-05B313F5326C@yahoo.com> <9D29DD48-1572-4C04-AD88-8436AC8DDDCC@yahoo.com> To: bob prohaska X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.206:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.206:from]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RtM4J3LFbz3Rdb On Sep 23, 2023, at 12:41, Mark Millard wrote: > On Sep 23, 2023, at 12:16, bob prohaska wrote: >=20 >> On Sat, Sep 23, 2023 at 11:34:41AM -0700, Mark Millard wrote: >>> On Sep 23, 2023, at 11:26, Mark Millard wrote: >>>=20 >>>> On Sep 23, 2023, at 08:52, bob prohaska wrote: >>>>=20 >>>>> =46rom time to time, but seemingly more often lately, a Pi3 >>>>> get stuck during shutdown -r. The machine is running -current >>>>> from a mechanical usb hard disk through a powered hub. No micro >>>>> SD card is used. Once up it's quite stable. >>>>>=20 >>>>> The console reports >>>>>=20 >>>>> login: Sep 23 08:20:37 pelorus shutdown[224]: reboot by bob: >>>>> Stopping sshd. >>>>> Waiting for PIDS: 1063. >>>>> Stopping cron. >>>>> Waiting for PIDS: 1073. >>>>> Stopping powerd. >>>>> Waiting for PIDS: 1002. >>>>> Stopping devd. >>>>> Waiting for PIDS: 752. >>>>> Writing entropy file: . >>>>> Writing early boot entropy file: . >>>>> . >>>>> Terminated >>>>> Sep 23 08:20:43 pelorus syslogd: exiting on signal 15 >>>>> Waiting (max 60 seconds) for system process `vnlru' to stop... = done >>>>>=20 >>>>> Waiting (max 60 seconds) for system process `syncer' to stop... = Syncing disks, vnodes remaining... 4 0 0 0 done >>>>> All buffers synced. >>>>> Uptime: 23h31m45s >>>>> Khelp module "ertt" can't unload until its refcount drops from 1 = to 0. >>>>=20 >>>> I've gotten the above message on rare occasions over the years on >>>> the amd64 system (ThreadRipper 1950X). (But reboots and shutdowns >>>> are not frequent for this system normally.) >>>>=20 >>>> There is a recent: = https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D271677 >>>>=20 >>>> It is not just your context with the issue. >>>>=20 >>>>> Resetting system ... >>>>>=20 >>>>> At that point all activity ceases. The only clue I can recognize = is that >>>>> the red power LED remains off, as if FreeBSD never relinquishes = control >>>>> to the Pi firmware, which turns the LED back on at powerup. = Power-cycling >>>>> results in a normal reboot. >>>>=20 >>>=20 >>> The system might produce more messages about the >>> shutdown activity if it has been booted via: >>>=20 >>> boot -v >>>=20 >>> This might narrow down the context some for someone >>> familiar with the messages --if oyu are lucky enough >>> to eventually get an example from a boot -v context. >>=20 >> I'm confused here. Boot is normal, and it doesn't >> seem to even reach the boot stage during reboot. Can >> boot -v affect the _next_ boot? >=20 > boot -v can add messages both to boot-time and to the > later reboot/shutdown-time. >=20 > You would have to keep booting with "boot -v", hoping > that the later reboot/shutdown would report extra > messages but would also include the 'help module "ertt" > can't unload' message in the sequence. Once you had > such a boot, you would report the text around the > 'help module "ertt" can't unload' message to show the > extra context. Actually, the extra messages before the hangup may be useful even if no 'help module "ertt" can't unload' message occurs: it still gives a better idea of the staging. >> It isn't clear to me that the bug report is related. It >> seems to focus on the ertt message, while my problems >> wait until the system claims to be resetting and then >> gets stuck. >=20 > I've had to force poweroff after some of the messages. >=20 > The "can't unload until its refcount drops from 1 to 0" > suggests that it is waiting to unload. (But I've no > low level detail establishing that is actually what > was going on.) >=20 > Have you recently had it get stuck without first having > the 'Khelp module "ertt" can't unload' message? (I've > not had other reboot hangups except for other known > problems that were later fixed. I've not had other > reboot/shutdown hangups in a very long time.) >=20 >> Maybe the ertt error is related, but the >> association isn't consistent=20 >=20 > Are you saying that in recent times you have had hangups > that did not first show the 'Khelp module "ertt" can't > unload' message? >=20 > The message suggests that the refcount decreasing would > lead to it not waiting any longer. (But I've no low > level detail establishing that is actually what was > going on when I did not have to force power off.) >=20 >> Unfortunately the hang does not seem easily reproducible. >=20 > Consistent with my "rare". >=20 >> Several consecutive shutdown -r reboots were successful. >=20 > To my knowledge/memory, I've never gotten the message after > being booted for only a short time (little activity). >=20 >> The hangs seen so far have all followed OS build/install >> sessions. >=20 > So a "boot -v" before such sessions might, eventually, prove > useful. >=20 =3D=3D=3D Mark Millard marklmi at yahoo.com