From nobody Mon Jun 26 00:16:09 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Qq7gM0FGJz4hxsK for ; Mon, 26 Jun 2023 00:16:31 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-22.consmr.mail.gq1.yahoo.com (sonic309-22.consmr.mail.gq1.yahoo.com [98.137.65.148]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Qq7gK4gtNz460Z for ; Mon, 26 Jun 2023 00:16:29 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=pS+pm3+Q; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.148 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687738587; bh=xtui23EsTEl2m1SoZXyjv1JoKKw2VISGhLDJC8RK2h0=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=pS+pm3+QfGO8XFM2g3tK0QX1LJEG+ZcwRZ9Shg3eXYF19ampcwnbG9MpJfcHhPQHlscU9dFBpj0zxa+tUVgNm3MTiMTS0g9Oq/m/KYON5ueZSy9OVjm3bjFxzD4UL7bMqPBrONCZC3iLdmqnqy15c+pA7QOEQvUX6fqbj9cTu7WndWZ1ZQk+BxQbR+VvNPdRAqpLhxkWCQ1RhPtE+CQ9WZOP+dH00B5ZcTO0quVRx4tIRraELdbQdbLRe56xEebaBl74vXepGBnTnrHa5RMq+foNPLhyHcF2wbhvxtQzqXtRsdlZiH9+nAqJHte+w/pWtTShvvP/Yv8jZal4V/d2rw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687738587; bh=jeZjNfioAz/6CN2eB/OIw6Y7CDuz+72ExyYAtlotNFX=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=Z+sMMJsuTb/I1RMES6TLEf6IK8JgQdlAfqMpePqx2D+ojVbCW3JPtr7ynHpF3pYuMFo2mHwhhJDnKGTMjvpqs88k00YIz79ZbpqO8NBQF+nVAzA+pn7w9VPL0fkZCLm1M7WIiGaCaKqUFYrqYFgwdiIDy5UVRPzcuGemR0hJi6QlWPF3wMZEd+RGNLxaCzARBfEhVS5avN5ADhjB7FDaVVy9GhrDVW3IjRoJV9WUIYnES9jcxsoUJx7zRxQftsp2O6fKri9EQYdgwnhsNc3ZpF66McIUyqvEGvvBGjQc6Jy0SE02CVkwB7zKHVQaq5YTQgsAKRWYdQ/jL7j8Z4bN0g== X-YMail-OSG: 3FRuPPEVM1mzC8vKArT89_gQQIxV3EjP6bnaVfmSlWNeJIaAhlsDN2fRRGEgBeP uC7u35ACA93bx2k45mXFl6JkO9utvpKRvd4s7_rtEobTjOheE6m_QwBRO4dBc9W66BU3wtH7zbTl fejIo.eixAzZ1miOgCwzKe4SqPJgNWdcem0SBZF.mL.OwcILSoOzYPbiNASoat_4X5zy4.7DyLKt PJ5Jp.3YyYQtvOXJVBk7b4qAfQRDKo7fAs2xGNuYa07TtrO7nCJG2B4l0qCOU.N8jeipglIicj.U _oSsjsHzXhgJXewGwLAjOLkK839_qYdBxQSx70lMhiuQ0_mXjAx.DIWI2SsoK5zvRfOVmPztmCAQ 8mWiDDzn6ef736f1xdITe9DNdH.BN6.nd.6grpp9a4Ds3Kh5G_ArBvg2d0h70bppe8s.qGW0.gT4 zKoXCSa0.kK.mMKTm9zlNVtfIvtGNuXoGn1rBRYAQw8dt2L120tUtpYt0ATr_xwM_c5mnEjMpC7K Vo.CWnqP0Vm4DUCk8bfJg7OZnDcPH9p_v..0CZhEMYV5tEJZAJq3a4tIzZZ5aNoNR_m4yZY46ZDu 0lToANHUupqE03GgSDAkvr1qsVDNDyk0Zx6IhTRe7zsQ2GGxvoqQ3yVO1.j62QrRyR_bcP4qC2mW D2OuXNxO0kZfSuuYJ.1C5sCnVgUuDdivw_WLEz1QottBQyna0T8XgyKZL9bADd4zWftwiRLgK3C7 2ACcYhUgRQ70kLTWn3zm_ioRASD1X5jSehunQ8jj.B4um9W0XbbaNWZs3acb6gddDjKpQFKc_QSA uJJUDh4gAwmhyyTp8BEqm_Ypx7oudRgTKuW3fYawZDQr9Qgzk8CUJG4Pf3Nj19R_1gy6U0KLG_4w IZvS8VlSXB42OGZ.fAwViL2hgolgTFIG2ZTiB2ptMETsa.oo2km.xoBOaMWjg6rKGE2AgaqDRPXH Ci6YYyAnni76XhGzWQa90fqz7zrKIaIM2456Ay54_yOgTEGNPsYIwYR8V_JuqeHYH9pnCPVzTU49 cjDj6JQcntqvdT0RVej_wh009fCIlic1jqbHERnx_ElL1GQBMBtxp_qHoeeTrJ_7jrBk2H4ppULZ MG7xpx1MmKnGEnWbh.pu5Aa0.mN4jqSXL4FYfn1BHJVGEuoYU1pWctcy.yKLCqeSioyWC66cqZmK InfOFTtWgDibML46G7tWKJ_Xa7QYVtMGTD_v3.4XUbmu.2mKO2U5yoRIZmvXyosZOU0IqaMsWjnQ 3JDPT0PO7YzDW9zDb1nPEjhzoayJ2ju8NVz.gEtpsbPD04jajzWXRCt9PiItse2BtN3LGRC0yK1I EjoGoKABvl8O8fdkJbXwrQDApIWPnwd4cyEA3n0CYQO6V4yp71vl9oOqoPVjnCeW5hNZ8bWWhZdE noW_wE_mDX.V0MRvcl4mtmhSjm0vW78YXvz5o2OptVo12Pi7mCNFd9zvq9coSd_SYOsyVoHmhmol 5ZN.R0OxlLwzfBAIdc0VVFDf5gaCL6c2_EeXnOhC0cNTR3XHozTH5_RyUo.jGZsiSwJ5INastg7J UVWS3v3BAfz1GcV2WEbO2bG.M4d0sekePxpDTo__HVF.kIqghP47zbPwYzDzr.cboO1pxmDPo1ny ZGMXgBNP5iFeUUnPSEEdyZLB2bqhFU_9bLkbISv5mUQINvjnDQYJLtb.7P7vQPWXInWmuPYenpS7 Fr34LQYHuWcHgNT5ACdXJ92rGcM.G9cMxrJT0AbBjJqkRzZOZdUe7cVR2BxTWuXVNh55CECRw5HU aB7sN9G6UtfJ0XIBG2bctyN0yQzJ6q.Wz9aYf6LOLwBbGsTaijIoQRTpsHKW_MJ.dgutcB6wNuRj 78P1CG3BjiU_OqP_ifFNooXrfhXv_tx72WpPn5Zu8uN_v_Yqp3b0bRfY2NZiRe0ft.NH4X0ByHPj CrkvjBLDFhegc0kJ94lEBcsX6Hb_CVlqQ0ERDt0eYkBvFHAzoVsu9Q2QH0vZO6p7P.fSvSP7tiEy rCFSkMi1yZ0lgLjLuAx4pfVhJO_YTMmHG6IIoeMW9glVevP5y5Mr1x8z00GeluGbbc5AZt.JFz1S gC.duKLX5CEm5b3XOIESGtxJlXpJ7o_gCM5M88nyYYnCrHl2pej_fFmw8.UXJsuyqMkmdKKQdz.M jRBTpRb6uK0CwooI7k.T.l6golCYaKv2.UmPRkx2O7R6.pqnfsPDvjOUvusngwyppQ3eJ3LzPfvb .wqgygF5_eotV3HSCP1OdGFKgUT.C1rDJjqcXNTC8WaKWx_cXcy1qZkCafGN_ASqzM2q77D1MjDb zxg-- X-Sonic-MF: X-Sonic-ID: 3b1454df-8019-4a08-a510-c1aaad7b0863 Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Mon, 26 Jun 2023 00:16:27 +0000 Received: by hermes--production-ne1-574d4b7954-bq277 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 6055e03e7599a8ccf2626d81bf317192; Mon, 26 Jun 2023 00:16:21 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: For snapshot builds: armv7 chroot on aarch64 has kyua test -k /usr/tests/Kyuafile sys/kern/kern_copyin hung up [in getpid?], unkillable, prevents reboot Message-Id: <7A41DED4-876F-4270-A980-549A4832B39A@yahoo.com> Date: Sun, 25 Jun 2023 17:16:09 -0700 To: Current FreeBSD , freebsd-arm X-Mailer: Apple Mail (2.3731.600.7) References: <7A41DED4-876F-4270-A980-549A4832B39A.ref@yahoo.com> X-Spamd-Result: default: False [-3.20 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-0.98)[-0.984]; NEURAL_HAM_LONG(-0.72)[-0.717]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.148:from]; SUBJECT_HAS_QUESTION(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.148:from] X-Rspamd-Queue-Id: 4Qq7gK4gtNz460Z X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N Using the likes of: = FreeBSD-14.0-CURRENT-arm64-aarch64-ROCK64-20230622-b95d2237af40-263748.img= and: = FreeBSD-14.0-CURRENT-arm-armv7-GENERICSD-20230622-b95d2237af40-263748.img I have shown the following behavior after setting up storage media based on them. (This was a test that my builds were not odd for the issue.) Boot the aarch64 media and log in. (Note: I logged in as root.) mount the armv7 media (-noatime is just my habit) and then put it to use: # mount -onoatime /dev/da1s2a /mnt # chroot /mnt/ # kyua test -k /usr/tests/Kyuafile sys/kern/kern_copyin sys/kern/kern_copyin:kern_copyin -> =20 On the serial console: # ps -xu USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 11 1498.4 0.0 0 256 - RNL 23:24 542:52.92 [idle] root 1174 100.0 0.0 0 16 - Rs 23:37 0:00.00 = /usr/tests/sys/kern/kern_copyin -vunprivileged-user=3Dtests = -r/tmp/kyua.9YUttj/2/result.atf kern_copyin root 0 0.0 0.0 0 1616 - DLs 23:24 0:00.50 [kernel] root 1 0.0 0.0 11704 1288 - ILs 23:24 0:00.02 /sbin/init root 2 0.0 0.0 0 256 - WL 23:24 0:00.26 [clock] root 3 0.0 0.0 0 272 - DL 23:24 0:00.00 [crypto] root 4 0.0 0.0 0 80 - DL 23:24 0:00.95 [cam] root 5 0.0 0.0 0 16 - DL 23:24 0:00.00 [busdma] root 6 0.0 0.0 0 16 - DL 23:24 0:00.03 = [rand_harvestq] root 7 0.0 0.0 0 48 - DL 23:24 0:00.06 [pagedaemon] root 8 0.0 0.0 0 16 - DL 23:24 0:00.00 [vmdaemon] root 9 0.0 0.0 0 160 - DL 23:24 0:00.38 [bufdaemon] root 10 0.0 0.0 0 16 - DL 23:24 0:00.00 [audit] root 12 0.0 0.0 0 880 - WL 23:24 0:11.81 [intr] root 13 0.0 0.0 0 48 - DL 23:24 0:00.04 [geom] root 14 0.0 0.0 0 16 - DL 23:24 0:00.00 [sequencer = 00] root 15 0.0 0.0 0 160 - DL 23:24 0:06.42 [usb] root 16 0.0 0.0 0 16 - DL 23:24 0:00.10 = [acpi_thermal] root 17 0.0 0.0 0 16 - DL 23:24 0:00.00 = [acpi_cooling0] root 18 0.0 0.0 0 16 - DL 23:24 0:00.04 [syncer] root 19 0.0 0.0 0 16 - DL 23:24 0:00.00 [vnlru] root 671 0.0 0.0 13260 2600 - Is 23:25 0:00.00 dhclient: = system.syslog (dhclient) root 674 0.0 0.0 13260 2752 - Is 23:25 0:00.00 dhclient: = dpni0 [priv] (dhclient) root 761 0.0 0.0 14572 3972 - Ss 23:25 0:00.02 /sbin/devd root 964 0.0 0.0 12832 2764 - Is 23:25 0:00.02 = /usr/sbin/syslogd -s root 1033 0.0 0.0 13012 2604 - Ss 23:25 0:00.01 = /usr/sbin/cron -s root 1058 0.0 0.0 21052 8308 - Is 23:25 0:00.01 sshd: = /usr/sbin/sshd [listener] 0 of 10-100 startups (sshd) root 1078 0.0 0.0 21288 9304 - Is 23:26 0:00.09 sshd: = root@pts/0 (sshd) root 1175 0.0 0.0 21288 9496 - Is 23:37 0:00.04 sshd: = root@pts/1 (sshd) root 1074 0.0 0.0 13380 3008 u0 Is 23:25 0:00.01 login [pam] = (login) root 1075 0.0 0.0 13460 3292 u0 S 23:25 0:00.02 -sh (sh) root 1233 0.0 0.0 13588 3016 u0 R+ 00:00 0:00.00 ps -xu root 1081 0.0 0.0 13460 3328 0 Is 23:26 0:00.02 -sh (sh) root 1170 0.0 0.0 5788 2884 0 I 23:36 0:00.02 /bin/sh -i root 1172 0.0 0.0 10408 7192 0 I+ 23:37 0:00.30 kyua test -k = /usr/tests/Kyuafile sys/kern/kern_copyin root 1178 0.0 0.0 13460 3320 1 Is+ 23:38 0:00.01 -sh (sh) 1174 is stuck, even if one waits for 30min+. kill and kill -9 will not kill 1174. "shutdown -r now" hangs before the reboot happens and reports: "some processes would not die". An interesting property is that ps and top disagree about 1174 CPU usage: ps 100%, top 0%. But top also indicates 1174 always has CPU0 "STATE". (Across tests CPUn varies but within a test it has a fixed n.) I have also seen ps "STAT" being RXs. The following is from my earlier activity with my own builds involved, here 1119, not the 1174 from above. truss reports as the last thing for the stuck process as "getpid()". . . . 1119: 0.588983953 fstatat(AT_FDCWD,"/usr/tests/sys/kern/kern_copyin",{ = mode=3D-r-xr-xr-x ,inode=3D111756,size=3D9776,blksize=3D10240 = },AT_SYMLINK_NOFOLLOW) =3D 0 (0x0) 1119: 0.589065030 = mmap(0x0,20480,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON|MAP_ALIGNED(12),-= 1,0x0) =3D 1074188288 (0x4006d000) 1119: 0.589227544 = openat(AT_FDCWD,"/tmp/kyua.aBQv6E/2/result.atf",O_WRONLY|O_CREAT|O_TRUNC,0= 644) =3D 3 (0x3) 1119: 0.589276503 getpid() =3D 1119 (0x45f) For reference, from inside an armv7 chroot session before doing such a test: # uname -apKU FreeBSD generic 14.0-CURRENT FreeBSD 14.0-CURRENT #0 = main-n263748-b95d2237af40: Thu Jun 22 11:10:50 UTC 2023 = root@releng1.nyi.freebsd.org:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC = arm armv7 1400090 1400090 =3D=3D=3D Mark Millard marklmi at yahoo.com