From nobody Thu Nov 16 04:01:56 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SW5vq2MKyz516h1 for ; Thu, 16 Nov 2023 04:02:15 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-8.consmr.mail.gq1.yahoo.com (sonic316-8.consmr.mail.gq1.yahoo.com [98.137.69.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4SW5vp0xhsz4XtZ for ; Thu, 16 Nov 2023 04:02:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=rdr44bze; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.32 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1700107331; bh=owsnKU8MSAZGABLiz3ZpTnehUZ1AkdwjQwyO+O0hVaA=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=rdr44bzet59/2Zb2JN00xqwume37agiXguapUSMSvJCpgLFDC2bSd00zrE4veRlaavpqB0RHLoP2XLKWBIBo3y2QOgkv0nwXguqEowgTj4N83bJR01WJGVH8YiGbKDa2cTe/zmlguWFvXgtHJvRxklXIocjAHQHSULMDh/Vum6khS+O81O75fvVVSnQIHbHgPrpof47f3FGdxqjqXQxPPUxx/2WQylBF5G5CLnDlVJNbQdrhHsk/A+YAj4uQsDh4q++LLfTAHIkPPe4OYEG3VmqUXQ7Y+GN4lAguPIhKgEPuJyXWIurrPUdtmsk5QiKccjtItB2W7T28cZQcWbDqGA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1700107331; bh=NTrE5+v+Pky56wPPO2lAixCmD3f+4lQ7Jv6bBdlTwyH=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=IfC9+Gv5Nv7w6czt36K8dOIFs/ieWR6HsePH+0B/8BRda85I4PIzTBS7GJnvl06ovhicWvaWwatzKizo5htqjWMY0FVGH2LaICIypCIDLzmMHReCQgw5VI4GoRvsw8QpbW1Uf3vomwF7Ke+Kd4EqGAhRNpTaMGYEnjKr9XlL5XfoGcFKQexLKLsBI6wyEoucXqqyOc/qKXT0GQhz+TmiMgKJ72rp+R8WIDNztZ4jFDBO6sRy2Drm4EKhhwwvq4AtVG58uuvs6Jm9WoGf0F3A2m4s3TpJ10rUaKfw9FyS/V8Uxw0BrxeMyAP9JBAGthw2ar1mV6yfaLRKXs/7BSBinw== X-YMail-OSG: 9zCa6tMVM1m5AJS8lTcm71OlW1lsZn_sKAZ3r8HTCME09L52YFi8T5yoUHAFKHb LiMRl3O8O_Ephd1XZKaXqr8EjuINIXYbjo9KKwrii6mz5NeCfgTnzpc2EfuQeIbenhzQ536FoJlZ sQ2XGOO8D.MkGGmY5Ds.jCgoiKNRBljFyHTUUN6EYjPgiQahWcI8V7WV8iI_f3ixQ7deRiPUXoHR 20c2Y_7ouB.AFe1_F5ljDzI0US9cIAUZH9JuY9aYSpKhuS8J35TuunY9t95RhB4PsApNpc7sZSc. kYKza1.1D37b0UEBfNUpMXNQbdjt7UDH84W6wn3nNhEvuhdgnt8YFFE8o5HQIsl9o.O.tpxQjdgo B5A7m7o6pKFxE3tHW_aiYaX39m0d8Hq8YxM8QJYest_cGe2wRGRClRKGK94uYxEpHhKTB1nvNhEy 2avhB0y6kaSsPbTEPyZoWIJVTGK_YmQs7nBsJcuFUAP4oHCVoHdyW4XdwT3qYIkbViWGOLzN4swT u1xE7EyNpR0Verp5foRWlVZYgSAGrOZHz9zP5m5DiqW_FpfMohGz..CD_Sg38QcnwwHqJckJsnxv Cu54cugT7RC8_8kEfDcFEEu_RUkf7Fi7d4mlje72NMbqBWqgpmczFJMq7qa5NauHOeti1b1iW_1V r8LPtwre3y0xDfY5ct.texW25clVVM2VoFlHQkuEuUL3zHtmQPPkmznPS1TpRRndPrFGVhpRg_eV vKmu32mKh0TBTQJwH0vtZjMnQNMwK.OpjUJEk1pxVqzWYjRyYAcrHmnZBpQ8vOnKB9mpEfWglosy ImhQ2HpqXtLO.DJIdfvgmDnnti3qJ9p0.ThhjMd3xsJFDMk9s6TYMJyiasR7v6_C09EBoUCbRo3Y SwSTaeZ5yzWsU9Q0WOl0SBXw4nGyENeII5vu5woA5bPGWYdgzMMV0QGApzrLoAwy8LKJNcJ5QbCA ktth5tpggstf2qkziT5fbStADIqvx3xkjkTM4JZUvMaE_vSEWwgInHDXRBwRehkNqDrAQAEvfADa NVXyCORrJi_KKjy7kvYQlt5s1TYrW1RJMTHosGK1VFMddylLZuiD2AdWxH9T_7F4L9BR8iyesrzQ _rJmqKGBY0.GJu60TOHd5IABsQsuWm7tWb7LHxb1qfEetnmf1dWya.EGfsTAkmP8XEdYl1kg0a7y yGa9762fYw5QuGX.GccXZMhaiW2C1O1Z64GhfGwTHLv1Zg98ZbwB9It7U3nwt88E20s8jUnd6T6j ATuynvJ1_r_Hh7jYdp_r.AA4J3T52KUJGjbeQpXL_rSn6oYLRD6MhocTMAkPziFKXkrmGQVOsKiz AtCCXXh9q9wjGufvknkdtiuiKvyitAZh.Vk4j9nvVpljEyu6Sm4PcoIqH4_Y_Yzy0mb2ubG.NNmY inruvFjt_uyP9om4OsMVRM6YSouKvchOnzJUXM.dBzsa_E7XVEmwzaq.XOSN16Mg34qipRdvxLhC Ti.Cg3VKItiwUJ7TJD3358JjjadBikKnLua3QdhyxJMvq3FiP72ShWlGmev.YbtjdMDrrJyQn8hM nDN.AWaJzizAE8.M3pCcyK99r_0D0BjhW8Bg5_IWQrNUx.G1iDRhxOu5QQL2LIzU0YSYUmokLikc Ayi_3gU8mDXSrQ7.KC0HIry0p1.FjfKD2ncxeEduD8q_I682_ji0yZgr_5EWQBZUQ3_l3eW2hqY1 EXuUI2WCC4cGIRAITWYLgSMXO7Tr0tMglLYaNZRi2Vq5hlUhcg_EIG9DJmODak0z8uMwj6HRV1OG dsezOmG5WpnVizfN.E3CmU4bqI__3.hoMlIcdjqCJSyPSwTcfzNNi7b4BYTpVSM6HQPy88ClZ_8r gOsz7t1mOqYNHoH7XUjvuWt4QmG7tVOm3JZAHFmf7VYb4_v4G9GWcRIakVaFoArhKKKr5DFmb43n yLL8Ic4L3gQ6L2hrdAZOHaaJx._YI0_5vLNcqdSw6V1XjxWndm8Tui2v9bsBcF7ckvBHPyJ.XfVf 5V0lBD7yvfEz7yRsU5_f6Jtp9HpiX3ldK0XEHMdet2nal1te8mDBTeheR_VaJuPuH_pq3OEnQuKD hropc.Wp_JC.uosryQGU3F9ZOlVJnElGXkPY_w1M7j53Q97cpBgR2ils1kD2SEHH3YaqtYvPtn0B ZckGexDmSv2nZx7L4.aTxrJl4nAocULnhKWcdkyMQPHV0PMNR7wOPl1Zjjd12gcYLHjz.S1yyzIz 0bQvk0aCU4u6DOaGSVMkvIdckGrb56GZ0.3cVerTze1H0EYU57EHy1mkhvIVrYc2QS.vjmh5C33I 5 X-Sonic-MF: X-Sonic-ID: 3a4d4e7a-1535-4141-81e1-b3f7da2025da Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Thu, 16 Nov 2023 04:02:11 +0000 Received: by hermes--production-gq1-59b5df67b6-srhh5 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 6a1e3410b172dda9bebc4be4ea26bb79; Thu, 16 Nov 2023 04:02:06 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.200.91.1.1\)) Subject: FYI: poudriere-devel builder got stuck in kqread during from scratch bulk -a Message-Id: <9BBA5DFF-50ED-4007-8C90-EC5099AB4C7C@yahoo.com> Date: Wed, 15 Nov 2023 20:01:56 -0800 To: FreeBSD Mailing List , Current FreeBSD X-Mailer: Apple Mail (2.3774.200.91.1.1) References: <9BBA5DFF-50ED-4007-8C90-EC5099AB4C7C.ref@yahoo.com> X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.32:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.32:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4SW5vp0xhsz4XtZ X-Spamd-Bar: --- Tail of the poudriere-devel Building and Finished notices just before = only the stuck builder was left "running": . . . [85:21:50] [27] [02:06:01] Finished databases/mongodb60 | = mongodb60-6.0.11: Success [85:34:00] [28] [03:23:06] Finished biology/ncbi-cxx-toolkit | = ncbi-cxx-toolkit-27.0.0_1: Success [85:46:31] [30] [08:19:30] Finished cad/kicad-library-packages3d | = kicad-library-packages3d-7.0.2_2: Success [87:07:02] [03] [13:00:45] Finished emulators/libretro-mame | = libretro-mame-20220124_1: Success # poudriere status -b [main-amd64-bulk_a-default] [2023-11-11_17h59m25s] [parallel_build:] = Queued: 34683 Built: 33807 Failed: 173 Skipped: 382 Ignored: 320 = Fetched: 0 Tobuild: 1 Time: 88:17:59 ID TOTAL ORIGIN PKGNAME PHASE PHASE TMPFS = CPU% MEM% [05] 17:27:25 ftp/curlie | curlie-1.6.7_15 check-sanity 17:27:15 1.28 = GiB =20 =3D>> Logs: = /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-11-11_1= 7h59m25s # ps -oetime -alxdww # but left vs. right part split out, left side = first (with 2 notes) . . . . . . 3-16:18:11 0 83812 1765 8 20 0 22128 6856 select I+ 0 = 4:33.84 | 17:27:35 0 48809 83812 26 68 0 22128 3044 kqread I 0 = 0:00.05 | (<<=3D=3Dbuild_pkg) 17:27:25 0 50788 48809 25 88 0 0 0 - Z 0 = 0:00.03 | (<<=3D=3Ddefunct) 3-16:16:40 0 76609 83812 19 34 0 18544 3608 piperd I+ 0 = 16:45.55 | 3-16:18:09 0 84173 83812 13 68 0 15472 2864 nanslp S+ 0 = 184:47.04 | . . . Then right side . . . . . . | `-- /usr/local/libexec/poudriere/sh -e = /usr/local/share/poudriere/bulk.sh -jmain-amd64-bulk_a -a | |-- sh: poudriere[main-amd64-bulk_a-default][05]: build_pkg = (curlie-1.6.7_15) (sh) | | `-- | |-- /usr/local/libexec/poudriere/sh -e = /usr/local/share/poudriere/bulk.sh -jmain-amd64-bulk_a -a | `-- /usr/local/libexec/poudriere/sh -e = /usr/local/share/poudriere/bulk.sh -jmain-amd64-bulk_a -a . . . Later forcing a failure of the builder that was stuck for curlie: . . . [main-amd64-bulk_a-default] [2023-11-11_17h59m25s] [committing:] Queued: = 34683 Built: 33807 Failed: 174 Skipped: 382 Ignored: 320 Fetched: = 0 Tobuild: 0 Time: 88:46:04 [88:46:05] Logs: = /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-11-11_1= 7h59m25s [88:46:07] Cleaning up [88:46:07] Unmounting file systems Context, for reference: # uname -apKU FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT #126 = main-n266130-d521abdff236-dirty: Tue Oct 24 18:17:40 PDT 2023 = root@amd64-ZFS:/usr/obj/BUILDs/main-amd64-nodbg-clang/usr/main-src/amd64.a= md64/sys/GENERIC-NODBG amd64 amd64 1500002 1500002 # ~/fbsd-based-on-what-commit.sh -C /usr/ports 6ec8e3450b29 (HEAD -> main, freebsd/main, freebsd/HEAD) devel/sdts++: = Mark DEPRECATED Author: Muhammad Moinur Rahman Commit: Muhammad Moinur Rahman CommitDate: 2023-10-21 19:01:38 +0000 branch: main merge-base: 6ec8e3450b29462a590d09fb0b07ed214d456bd5 merge-base: CommitDate: 2023-10-21 19:01:38 +0000 n637598 (--first-parent --count for merge-base) ThreadRipper 1950X system, 32 hardware threads, 128 GiBytes of RAM, ZFS. USE_TMPFS=3Dall in use. The style of bulk -a build has high load averages for much of the bulk -a compared to the hardware thread count. Largest swap space use observed was 123513 MiBytes, observed via a hacked top that tracks some "Maximum Observed" figures for some of top's monitoring data. For reference: 245564Mi MaxObs(Act+Wir+Lndry+SwapUsed) Note: max(A+B) <=3D max(A) + max(B) =3D=3D=3D Mark Millard marklmi at yahoo.com