From nobody Sun Apr 16 06:59:29 2023 X-Original-To: dev-commits-src-main@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PzgzN4D1yz44m0M for ; Sun, 16 Apr 2023 06:59:44 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic308-8.consmr.mail.gq1.yahoo.com (sonic308-8.consmr.mail.gq1.yahoo.com [98.137.68.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PzgzM2Z5wz45HY for ; Sun, 16 Apr 2023 06:59:43 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=VSOnYC6H; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.32 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1681628381; bh=aVtza9sJl6rMjwUxR2OG1rFhWxGp4ZNhIKao2LVUJbY=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=VSOnYC6He077y0WfWARbEj8f3E1Va2CtdfD1ESRRCG7+ZNMHh3/UY+FLtHrHWu4CSzZtHjcjFJWzFqLQNvAZltdJwCDeJIOy0kud4abmIlWrkNC/ik+NINugyQICGArtemwNEQxV5f/fyJ24k30ZKSnt4mNAr2CljMm3OO4NAAejOC16mpygg3bp0pGvD3OuB3S9XImu3UMWXZ9MIFPLbMcOXnZtPIoeIJc7lv4R4Uua6kWjKc4tjGKy1TyxKKUuCKgMd0VclXbHh7jec/g6yMzD/EAJCZ7Y+tUcatLjMeNnSnwg7o4bbxX1U5LnjbDnCTC4Q7yas49PlZogng5x7A== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1681628381; bh=14mJWYiIdtppQqW/Ed77SlUNa9lbWUjfHhS8mOfs2dj=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=mgeuiMxiu5bso3S40qj6dvJD5SRJZmJf9AoHRBDbLjCW9E/uF7437j8/1pEeytntX5jebSq7b5Q9nfFy60SN8G8LLp6rSKbPH44fSowbbp/akKPRGC39h7FtrNp+BqLIYwcNF5vI30DvgFTU31y8v+Mqjx67uX8ukBDwW0Ny2MruWIYKf+wuGpCrOkamta1pF2wjDD7geC6x7nZY/3VxuOlvLDB9bHVN7nMzFnebhaLMYr4q872fsCUQqGAmGeq/ldh7s2QDOsRET37f/X2Oemui991OZt0NrcQTtR6PvPgi9G/WAwAudniL/Zuf3Ca5MyzWaBQzgjnFvy51HauKEw== X-YMail-OSG: ARhJU8YVM1mUPoquyxTIzEKfx0EWqEiQP7fFO9eIQ6s2jOZWRqy5XuBAcfBauYc Mon4L8B6vviKRzRlHCmhu9vYqN0Q65E50TpbcuAE9B5aG6TIH08U1DsN5u0l8pLxW_E955277n4Y CC5.Fvu7PC4TURspbc14cgZbVHgm.kpXU9xlEB9CO7t61A_.8rdFbJpo8zcK6ALL54rrebsRm3cI u2_c9PPOl2Vp9Q9oyLtmTYy8y6uINmOTvS0muk62dLzYutKWI.8v5pNNm.lrUITfFDMsTdZ.QNu6 n0Y6TtAIw2YeuKose7nRaNyEVi27lIW6IC9PGfo0h8F_4oL4xG6G2UgRZ1VvrN2YZy9Z1YbUls.G r23_BTjKr_kauwfu4CQb5rXwN_almBTan2LyYeS8OhF7qqQTBcHkClnQrMHPYka0SAKkBlDLZRzx K2H8ZlJs20DqOXq6Uns0ezQrBowAJX6IJAMBYR0yssB1LWL8.5Fpq.sC93oUJm_XP_GZtknlQlYp UzvkPbe5tFM0Dfe.SfxVOKxnVgS42k5FVouiOVmhQn7Hy4BgbfjSFQK7n3TTRikfdzmPLGih2r7B MUXT0QnncOd6BAS7J1ctKfqNsHw9s67aVe8i7m0dZvS.rO_W7KXU.80sN54bRnNgSbS41gh3tve7 dBrIH.q5Y38y3v0ANQCtRhajsphe9W5ha2SgzSnfALAONnIdhmqobiMvSveW9BPOZCkDKgWLJ82R 1yAb2b_k8Q6BwpVnyVH_pppu2NCfoWXec2KbZDG8fQrtezLujk9vSUzY7BezVrBqvES1minzftH. xY2rLDK18nxUPHd292tSNlKl9wfCpOfnwslCc0vBDIvLIaivUN1U_uQLE4sl3fNUiEkB9V7AdhPK 9QiQV8yxHXDFLHwWFYLD8Nhh.cl_sPfESGMt.LvLuPis_gIAoWH4OfqyBpZJiMn4qlk.j6UNOmDv vLWlExNGCNDpB9N676W9KASGHykbeAT_Qbz1s9DzGaxpSScooiHbbxz8dXh2dM9uImfKthoWsxPq JWQP.oSBgON7eTcR_9h33.POzk6Hptbn_2KmJL8XNc5_ZD81zbTgoF6WdoGTKcac8OT2UO__SWTR r2pNW0CWMF4MvrgOxDj0b_UqJmgy9XnuqEDjFENQ0OiSMu3382WlpRuNY01cXEi5lKoHnr8ftCi2 XVolWSu4AuR1wY9tv1RiaKw4TZdm5YFO1OJn3HEtVRghWiCcm0OGiZewMKbfcNbLQ5OMi1VdBweS TaX7RoAozeLMYascfHXXijdPApGHoIWY.38_7xwTx1xvOxTKFVwMXT.06wmjKUb8sLG9EwFgl7u6 UptOe2Mi38iwl.knygYeybY63nsk8jHr3gt0KKDwpQIxPwItz.0jYmfXhonDxGTm.ypq_hDXE52q DgMlLYLVK.81uUdVkBL7nHqKPzM5_gfnEC_qkSghlw4Ln2c7zubqVKiUYDVDvWtKiKXG8T0FS8Rh old6HJs__ChA8MAjY5UviQYjWuZuaum5UwDUnes5nyaFkx1XTu6R8GAD3qADHV8aXWBJTev1cidw 0OtmtpUmygbPnB8eiXmV5mMZUO6hZwOpVrFswLmrovtA6CTdC6G9lEbuZvMDCqDruQFA_NXSVaiV CPnQ9bpJt1uE41CZAlmmZYqiGWDBGHTvcMLZKqBMm1dHidR81Ncsdy53PFVOr311.6i1r76jra2f twmLS8bGthbpqMudCcEYEUAzzPn8wZd8HwlS2WGPeKiIDupeyGQDwSQZhMakJofJwrXl2d8Gai8x tNEg4OaHeSeXK1BjDAhxrHlgRmCiZxGTHp6XR9aoZOZJQey6TizYNJG2O8_wmdRaxdimj4OUgPh5 KWRYe.Y.YD9oG5IVhyQHIX9JAIWrP1g4O_p0a93m08oR9eYsNxRDC75CAfVO5Ru14ARV5R7H8VOy LPnz7mRk9T4gBcbyCUUMCDZXaNgis5_bThh6N4Ef.vxx60BYuVeFXBhLOlfA1zwXOty94IIX5soz f1P7i27kOEEpWDRPr0hMQ4Eur83hKci1LuyaYgyr8ZT_atzPFVLLvUmSEz1ZbrdWO9mYN5WJTarc wUkH3tZ6nWUIoi7iknHx1evhBUrgFICg4_ISujJCAEhbGXmOS.M3szZLw7mI02Kk2aHiAhOx6tAu 27xz6lMiikHIYNDLvy5Dj_yJs__QlgW9Q_lYCJpe45CNK4QEVygqd2zDETco6eGv3XDZFduGDxTN sdaW.ZDdHHxpo_hSTsaJkEzbDVN5XckjK0fDcR1BRLk494xnm_HVCKcuJAvfN1ziCbW_dDwYEBRn r4ybkg1gl X-Sonic-MF: X-Sonic-ID: 880975c6-5ad1-463e-b46c-e6193b7c0aaa Received: from sonic.gate.mail.ne1.yahoo.com by sonic308.consmr.mail.gq1.yahoo.com with HTTP; Sun, 16 Apr 2023 06:59:41 +0000 Received: by hermes--production-gq1-546798879c-9kfxl (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID cddc7540fe2761f9834233afda650d2e; Sun, 16 Apr 2023 06:59:40 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Commit messages for the main branch of the src repository List-Archive: https://lists.freebsd.org/archives/dev-commits-src-main List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-dev-commits-src-main@freebsd.org X-BeenThere: dev-commits-src-main@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: git: 2a58b312b62f - main - zfs: merge openzfs/zfs@431083f75 From: Mark Millard In-Reply-To: <78E9D9C8-6679-4E2F-87DA-43B5B0224D9C@yahoo.com> Date: Sat, 15 Apr 2023 23:59:29 -0700 Cc: FreeBSD User , Cy Schubert , Charlie Li , Pawel Jakub Dawidek , dev-commits-src-main@freebsd.org, Current FreeBSD Content-Transfer-Encoding: quoted-printable Message-Id: <61A6CD66-2624-4A27-8F6A-0300D050F9AE@yahoo.com> References: <20230413071032.18BFF31F@slippy.cwsent.com> <20230413063321.60344b1f@cschubert.com> <20230413135635.6B62F354@slippy.cwsent.com> <319a267e-3f76-3647-954a-02178c260cea@dawidek.net> <441db213-2abb-b37e-e5b3-481ed3e00f96@dawidek.net> <5ce72375-90db-6d30-9f3b-a741c320b1bf@freebsd.org> <99382FF7-765C-455F-A082-C47DB4D5E2C1@yahoo.com> <32cad878-726c-4562-0971-20d5049c28ad@freebsd.org> <20230415115452.08911bb7@thor.intern.walstatt.dynvpn.de> <20230415143625.99388387@slippy.cwsent.com> <20230415175218.777d0a97@thor.intern.walstatt.dynvpn.de> <62F8DD62-8E09-4A07-926B-5DE3DB399609@yahoo.com> <0C286158-8F0D-45D0-8D85-B521278E9518@yahoo.com> <78E9D9C8-6679-4E2F-87DA-43B5B0224D9C@yahoo.com> To: Mateusz Guzik X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Spamd-Result: default: False [-3.44 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.94)[-0.939]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.32:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MLMMJ_DEST(0.00)[dev-commits-src-main@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_TO(0.00)[gmail.com]; RCPT_COUNT_SEVEN(0.00)[7]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.32:from] X-Rspamd-Queue-Id: 4PzgzM2Z5wz45HY X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N On Apr 15, 2023, at 21:31, Mark Millard wrote: > On Apr 15, 2023, at 17:27, Mark Millard wrote: >=20 >> On Apr 15, 2023, at 15:49, Mark Millard wrote: >>=20 >>> . . . >>>>=20 >>>>=20 >>>> (Mostly written as I progressed but some material later >>>> inserted into/around previously written material.) >>>>=20 >>>> Summary: >>>>=20 >>>> As stands, it looks like reverting the dnode_is_dirty >>>> code is what fixes the corruptions that my type of >>>> test context produced via poudriere bulk activity . >>>>=20 >>>>=20 >>>> The details that lead to that summary . . . >>>>=20 >>>> Using my my build environment for updating my temporary, >>>> experimental context, an environment running a world and >>>> and kernel that predate the import: >>>>=20 >>>> # uname -apKU >>>> FreeBSD CA72_4c8G_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #90 = main-n261544-cee09bda03c8-dirty: Wed Mar 15 20:25:49 PDT 2023 = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm6= 4.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1400082 1400082 >>>>=20 >>>> (Note the "nondbg": I normally run non-debug main builds, >>>> but with symbols not stripped.) >>>>=20 >>>> The kernel and world for this are what is in old-main-CA72: >>>>=20 >>>> # bectl list >>>> BE Active Mountpoint Space Created >>>> main-CA72 R - 3.98G 2023-04-12 20:29 >>>> old-main-CA72 N / 1.08M 2023-02-06 19:44 >>>>=20 >>>> (Most everything else is outside the BE's and so is shared >>>> across the BE's.) >>>>=20 >>>> I updated to also have (whitespace details likely >>>> not preserved in this note): >>>>=20 >>>> # git -C /usr/main-src/ diff = /usr/main-src/sys/contrib/openzfs/module/zfs/dnode.c >>>> diff --git a/sys/contrib/openzfs/module/zfs/dnode.c = b/sys/contrib/openzfs/module/zfs/dnode.c >>>> index 367bfaa80726..49a7f59c0da4 100644 >>>> --- a/sys/contrib/openzfs/module/zfs/dnode.c >>>> +++ b/sys/contrib/openzfs/module/zfs/dnode.c >>>> @@ -1772,17 +1772,7 @@ dnode_is_dirty(dnode_t *dn) >>>> { >>>> mutex_enter(&dn->dn_mtx); >>>> for (int i =3D 0; i < TXG_SIZE; i++) { >>>> - list_t *list =3D &dn->dn_dirty_records[i]; >>>> - for (dbuf_dirty_record_t *dr =3D list_head(list); >>>> - dr !=3D NULL; dr =3D list_next(list, dr)) { >>>> - if (dr->dr_dbuf =3D=3D NULL || >>>> - (dr->dr_dbuf->db_blkid !=3D = DMU_BONUS_BLKID && >>>> - dr->dr_dbuf->db_blkid !=3D = DMU_SPILL_BLKID)) { >>>> - mutex_exit(&dn->dn_mtx); >>>> - return (B_TRUE); >>>> - } >>>> - } >>>> - if (dn->dn_free_ranges[i] !=3D NULL) { >>>> + if (multilist_link_active(&dn->dn_dirty_link[i])) { >>>> mutex_exit(&dn->dn_mtx); >>>> return (B_TRUE); >>>> } >>>>=20 >>>>=20 >>>>=20 >>>>=20 >>>> I did my usual buildworld buildkernel sequence and then >>>> one of my normal install sequences into main-CA72 to >>>> update it to have the change, as well as the prior >>>> material involved in my first experiment that I'd >>>> reported on. >>>>=20 >>>> I cleared the content of the jail that I use for >>>> temporary experiments, such as the prior testing that >>>> got the 11 builder failures: >>>>=20 >>>> # poudriere pkgclean -jmain-CA72-bulk_a -A >>>>=20 >>>> I then rebooted using the updated main-CA72 BE. >>>>=20 >>>> Then I started the: >>>>=20 >>>> # poudriere bulk -jmain-CA72-bulk_a -w -f = ~/origins/CA72-origins.txt >>>> . . . >>>> [00:00:37] Building 476 packages using up to 16 builders >>>> [00:00:37] Hit CTRL+t at any time to see build progress and stats >>>> [00:00:38] [01] [00:00:00] Builder starting >>>> [00:00:40] [01] [00:00:02] Builder started >>>> [00:00:40] [01] [00:00:00] Building ports-mgmt/pkg | pkg-1.19.1_1 >>>>=20 >>>> In the prior experiment it got: >>>>=20 >>>> 476 =3D 252 success + 11 failed + 213 skipped >>>>=20 >>>> and it reported the time for that as: 00:37:52. >>>>=20 >>>> A normal from-scratch build takes many hours (multiple >>>> compiler toolchains and such) so my first report after >>>> this point will be for one of: >>>>=20 >>>> A) It got to, say, 00:40:00 or beyond with, or without >>>> failures. >>>> vs. >>>> B) It got failures and stopped before that. >>>>=20 >>>> . . . TIME GOES BY . . . >>>>=20 >>>> At about 00:40:00 the status was: >>>>=20 >>>> [00:40:00] [06] [00:00:00] Building x11/libXv | libXv-1.0.12,1 >>>> load: 30.73 cmd: sh 1508 [nanslp] 2400.88r 6.69u 11.90s 0% 3960k >>>> [main-CA72-bulk_a-default] [2023-04-15_14h47m19s] [parallel_build:] = Queued: 476 Built: 235 Failed: 0 Skipped: 0 Ignored: 0 Fetched: 0 = Tobuild: 241 Time: 00:40:01 >>>> ID TOTAL ORIGIN PKGNAME = PHASE PHASE TMPFS CPU% MEM% >>>> [15] 00:07:44 devel/py-lxml@py39 | py39-lxml-4.9.2 = stage 00:00:08 40.00 KiB 0% 0% >>>> [01] 00:00:34 x11/libXxf86vm | libXxf86vm-1.1.4_3 = build-depends 00:00:03 56.00 KiB 2.3% 0% >>>> [16] 00:01:59 x11-toolkits/libXt | libXt-1.2.1,1 = configure 00:00:52 40.00 KiB 0.3% 0% >>>> [02] 00:01:40 devel/dbus | dbus-1.14.6,1 = configure 00:00:05 36.00 KiB 0.5% 0% >>>> [03] 00:02:20 x11/libXrender | libXrender-0.9.10_2 = configure 00:01:27 40.00 KiB 0% 0% >>>> [04] 00:00:44 graphics/libglvnd | libglvnd-1.6.0 = build-depends 00:00:13 52.00 KiB 20.3% 0.1% >>>> [05] 00:01:39 x11/xprop | xprop-1.2.6 = configure 00:00:45 56.00 KiB 0.7% 0.2% >>>> [06] 00:00:14 x11/libXv | libXv-1.0.12,1 = pkg-depends 00:00:03 52.00 KiB 3.6% 0% >>>> [07] 00:01:57 x11/libXfixes | libXfixes-6.0.0 = configure 00:00:42 40.00 KiB 0.1% 0% >>>> [08] 00:03:01 devel/glib20 | glib-2.76.1,2 = configure 00:01:26 40.00 KiB 4.3% 0.1% >>>> [09] 00:01:21 shells/bash-completion | bash-completion-2.11_2,2 = configure 00:00:13 32.00 KiB 5.7% 0% >>>> [10] 00:06:26 devel/qt5-buildtools | qt5-buildtools-5.15.8p157 = package 00:01:57 44.00 KiB 76.1% 0.1% >>>> [11] 00:01:20 print/psutils | psutils-1.17_5 = stage 00:00:03 40.00 KiB 0.2% 0% >>>> [12] 00:02:09 x11/libxkbfile | libxkbfile-1.1.0 = configure 00:01:22 44.00 KiB 0.1% 0% >>>> [13] 00:08:54 devel/cmake-core | cmake-core-3.25.1 = build 00:01:43 36.00 KiB 694.9% 5.2% >>>> [14] 00:01:20 x11/xcb-util-image | xcb-util-image-0.4.0_1 = configure 00:00:14 48.00 KiB 0% 0% >>>> [00:40:14] Logs: = /usr/local/poudriere/data/logs/bulk/main-CA72-bulk_a-default/2023-04-15_14= h47m19s >>>> [00:40:22] [11] [00:01:28] Finished print/psutils | psutils-1.17_5: = Success >>>>=20 >>>> So no failures so far, 235 ports built and a bunch in process. >>>>=20 >>>> Note: maximum observed ("MaxObs") load averages so far >>>> as shown below (for there being only 16 cores, i.e., >>>> 16 Cortex-A72 threads, one per core): >>>>=20 >>>> load averages: 43.75, 34.32, 27.40 MaxObs: 45.03, 34.32, = 27.40 >>>>=20 >>>> I'll report again if it gets a corruption failure. >>>> Otherwise it will be many hours before it would >>>> complete without such failures (multiple compiler >>>> toolchain builds and such). >>>>=20 >>>=20 >>> To be explicit, since I've now seen your commit: My >>> test does not include the change (whitespace details >>> not preserved in this note) >>>=20 >>> @@ -2650,9 +2641,7 @@ dnode_next_offset(dnode_t *dn, int flags, = uint64_t *offset, >>> rw_enter(&dn->dn_struct_rwlock, RW_READER); >>>=20 >>> if (dn->dn_phys->dn_nlevels =3D=3D 0) { >>> - if (!(flags & DNODE_FIND_HOLE)) { >>> - error =3D SET_ERROR(ESRCH); >>> - } >>> + error =3D SET_ERROR(ESRCH); >>> goto out; >>> } >>>=20 >>>=20 >>> I make no claims about which way dnode_next_offset should be. >>> I was only providing some independent evidence that might >>> prove of some use to folks that understand the alternative >>> code sequences. >>>=20 >>>=20 >>> For reference, at about the 1 hr point for what I'm testing: >>>=20 >>> [00:57:49] [01] [00:00:51] Finished sysutils/u-boot-tools | = u-boot-tools-2022.10: Success >>> [main-CA72-bulk_a-default] [2023-04-15_14h47m19s] [parallel_build:] = Queued: 476 Built: 306 Failed: 0 Skipped: 0 Ignored: 0 Fetched: 0 = Tobuild: 170 Time: 00:59:49 >>> ID TOTAL ORIGIN PKGNAME PHASE PHASE = TMPFS CPU% MEM% >>> [06] 00:16:54 devel/binutils@native | binutils-2.40_2,1 package = 00:04:22 56.00 KiB 100% 0.2% >>> [09] 00:15:50 lang/ruby31 | ruby-3.1.3_2,1 package = 00:00:28 40.00 KiB 100% 0.2% >>> [13] 00:28:43 devel/cmake-core | cmake-core-3.25.1 package = 00:14:20 36.00 KiB 100% 0.2% >>> [01:00:03] Logs: = /usr/local/poudriere/data/logs/bulk/main-CA72-bulk_a-default/2023-04-15_14= h47m19s >>> [01:00:06] [06] [00:16:57] Finished devel/binutils@native | = binutils-2.40_2,1: Success >>=20 >> Just a status update as of lang/gcc12 finishing up: >>=20 >> [02:18:39] [03] [01:18:30] Finished lang/gcc12 | gcc12-12.2.0_5: = Success >> [02:19:11] [02] [00:12:27] Finished print/harfbuzz-icu | = harfbuzz-icu-7.1.0: Success >> load: 63.40 cmd: sh 59209 [runnable] 0.03r 0.00u 0.00s 0% 4012k >> [main-CA72-bulk_a-default] [2023-04-15_14h47m19s] [parallel_build:] = Queued: 476 Built: 404 Failed: 0 Skipped: 0 Ignored: 0 Fetched: 0 = Tobuild: 72 Time: 02:19:04 >> ID TOTAL ORIGIN PKGNAME = PHASE PHASE TMPFS CPU% MEM% >> [15] 01:15:01 devel/llvm16 | llvm16-16.0.0_1 = build 00:55:16 4.00 KiB 428.6% 4.4% >> [03] 01:19:09 lang/gcc12 | gcc12-12.2.0_5 = build_port_done 00:00:39 4.00 KiB 27.8% 0% >> [04] 00:51:27 lang/rust | rust-1.68.0 = build 00:41:24 8.00 KiB 480.6% 4.3% >> [06] 00:12:09 print/ghostscript9-agpl-base | = ghostscript9-agpl-base-9.56.1_8 build 00:07:19 36.00 KiB = 0.7% 0% >> [09] 01:15:01 devel/llvm15 | llvm15-15.0.7_1 = build 00:57:14 4.00 KiB 436.2% 5% >> [02:19:18] Logs: = /usr/local/poudriere/data/logs/bulk/main-CA72-bulk_a-default/2023-04-15_14= h47m19s >>=20 >> So 404 packages built and 0 failures to build. 5 builders active >> at the time. >>=20 >> FYI at about the same time: >> load averages: 64.31, 66.32, 66.68 MaxObs: 99.41, 83.15, 74.18=20= >>=20 >> I'll note that I use non-default options to avoid LTO based builds >> of compiler toolchains and such and this testing is of my normal >> style of builds, not of FreeBSD default options. >>=20 >> I'll also note that, unlike my normal builds on this machine, this >> is with USE_TMPFS=3Ddata ( instead of USE_TMPFS=3Dall ). This leads = to >> a lot more ZFS I/O, which seemed appropriate for the type of >> testing context involved. I've one other machine that I normally >> use USE_TMPFS=3Dall with but the rest normally use USE_TMPFS=3Ddata . >> This is because only the 2 machines have the RAM to make the >> USE_TMPFS=3Dall reasonable. The machine in use has 64 GiBytes >> of RAM and "Swap: 241664Mi Total" for the 16 hardware thread >> context, not that it has ever used much of the swap, except when >> some process turned into a massive-size file generator. (64-bit >> offset limited other than my noticing and killing such?) >>=20 >=20 > The bjam command used for stage for devel/boost-libs is a > long running, single process, single threaded context. So > far over 50 CPU minutes worth for stage. >=20 > [main-CA72-bulk_a-default] [2023-04-15_14h47m19s] [parallel_build:] = Queued: 476 Built: 463 Failed: 0 Skipped: 0 Ignored: 0 Fetched: 0 = Tobuild: 13 Time: 06:40:59 > ID TOTAL ORIGIN PKGNAME PHASE PHASE TMPFS = CPU% MEM% > [02] 01:06:33 devel/boost-libs | boost-libs-1.81.0 stage 00:55:57 = 16.00 KiB 100% 0.5% > [06:41:12] Logs: = /usr/local/poudriere/data/logs/bulk/main-CA72-bulk_a-default/2023-04-15_14= h47m19s >=20 > But, so far: 463 ports built, 0 failures. It may be > a while before the last 12 get a chance, as they > wait for devel/boost-libs to complete. No failures overall: [main-CA72-bulk_a-default] [2023-04-15_14h47m19s] [committing:] Queued: = 476 Built: 476 Failed: 0 Skipped: 0 Ignored: 0 Fetched: 0 = Tobuild: 0 Time: 09:08:52 (Several of the last builds were basically each a sequence of single threaded single processes that took notable time.) =3D=3D=3D Mark Millard marklmi at yahoo.com