From nobody Wed May 01 10:25:29 2024 X-Original-To: freebsd-ports@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VTtW836Thz5JcQK for ; Wed, 1 May 2024 10:25:40 +0000 (UTC) (envelope-from tatsuki_makino@hotmail.com) Received: from APC01-TYZ-obe.outbound.protection.outlook.com (mail-tyzapc01olkn20801.outbound.protection.outlook.com [IPv6:2a01:111:f403:280c::801]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VTtW66ZWqz4kDb for ; Wed, 1 May 2024 10:25:38 +0000 (UTC) (envelope-from tatsuki_makino@hotmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hotmail.com header.s=selector1 header.b=arQtXOQa; dmarc=pass (policy=none) header.from=hotmail.com; spf=pass (mx1.freebsd.org: domain of tatsuki_makino@hotmail.com designates 2a01:111:f403:280c::801 as permitted sender) smtp.mailfrom=tatsuki_makino@hotmail.com; arc=pass ("microsoft.com:s=arcselector9901:i=1") ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=W+Pe/mSRseJHFtyKs7yET9AU1SeDdeMjYKBMnsQyyz5Numn2Ph2UyjWjfxkWPWyPmCm68U180XHlPVIs1JBJjn1jFAnkPWmTD4C3LkO8OOzPhjE7cQASkN6agzrcH0bRwvS9ZdiVtIuABAOooNFSsp53jeJqFri1pWR3ltbu+b17rxjMlZktj2hhvAqU/i0xw98BKK5dUG+8XO2TlKiQiQrZF2X0QwuE35jmKhHZfMZQLZw0p59vg13rl+2n5xaY2BEfwT6B0jP2/YIOv26UxNOsq8kkW/Ph2qHMS2xmb7z5jKW2l4CR2hNHxHswcN2zTywszoc1tWoD3JBn47/mDg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=iVaIamSyxcVUTb0dDZrp8eA2p8q/ZMalzTGrCe1YZlk=; b=HNueMCVaz9/FP8+B85LgBVfJK5zZzOt2Ci8+ChVgOcECnpqKI0kbquqn49oDqP+KIu3VdYERjibz8g8I+AZwevhmFtCfrBWaOes3sITFdp84xISGB3AsIgyHQHjdMmiqIZAe/ft16uRnWIaACY49YYmBfIOh/rY6kbZxF83uNsJT7AGvPiFBPfSL1wj4SizGsP3r1L2B3vjh9qmVLle7nPkqigt82auMkz0+8MGz8g8L+8HszeXFXJ6ejMBaD35WXYewGCGax4Fs27rdxUe0eczOmyqwZPePdh/Rh2qg6sFKOo9jcMKD8PHl72ZQHIgKNg895D72nap+1e+pZBxpqg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=iVaIamSyxcVUTb0dDZrp8eA2p8q/ZMalzTGrCe1YZlk=; b=arQtXOQaG39PB7D70TuvtO9SjSYnmhs4og7c6+Sz4GI6RKQBTzNd7FvZ79AlsPqyDYjZZVsokkQlNCPpOidWM0/t0/23/67/s8qK1j4s2TE22e6DESKgvIaaajiqf1hI44gB06/0wA+e2sfZCXmQHfVVhnfNUCAIsIEH/CYrq4BUEJDt75mNUR+Nx+p14khY8SqWVuQHXXE1gqzulzKwtm7NcTfEcZovGVKby8IXT5Sh7A04hrh6sXaxOmwTHTWLrUkrg8OsGfVtLt4VAKYieWIJ2HodiPdn1HpZ11Xjx913OduIK3rLKwKwN29prxHJQz/+zBJ7MeB51VMTahFVow== Received: from SI2PR01MB5036.apcprd01.prod.exchangelabs.com (2603:1096:4:1f8::9) by PUZPR01MB5210.apcprd01.prod.exchangelabs.com (2603:1096:301:11b::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7472.37; Wed, 1 May 2024 10:25:32 +0000 Received: from SI2PR01MB5036.apcprd01.prod.exchangelabs.com ([fe80::1537:ef5d:9dab:474e]) by SI2PR01MB5036.apcprd01.prod.exchangelabs.com ([fe80::1537:ef5d:9dab:474e%5]) with mapi id 15.20.7519.035; Wed, 1 May 2024 10:25:32 +0000 Subject: Re: I've started collecting tmpfs usage figures from a poudriere-devel bulk -a for later publishing some of the top ones (handy for TMPFS_BLACKLIST judgments) To: Mark Millard , freebsd-ports@FreeBSD.org References: <97E1D1BA-CBA1-42C6-8202-B6D654941C28.ref@yahoo.com> <97E1D1BA-CBA1-42C6-8202-B6D654941C28@yahoo.com> From: Tatsuki Makino Message-ID: Date: Wed, 1 May 2024 19:25:29 +0900 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Firefox/52.0 SeaMonkey/2.49.4 In-Reply-To: <97E1D1BA-CBA1-42C6-8202-B6D654941C28@yahoo.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-TMN: [PTgpJRHG5LbSg5zML8gfNsS16fkdRNZg] X-ClientProxiedBy: TYWPR01CA0043.jpnprd01.prod.outlook.com (2603:1096:400:17f::17) To SI2PR01MB5036.apcprd01.prod.exchangelabs.com (2603:1096:4:1f8::9) X-Microsoft-Original-Message-ID: <14172e76-d511-5009-bfbd-e87a3b959fb6@hotmail.com> List-Id: Porting software to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-ports List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-ports@freebsd.org Sender: owner-freebsd-ports@FreeBSD.org MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SI2PR01MB5036:EE_|PUZPR01MB5210:EE_ X-MS-Office365-Filtering-Correlation-Id: 89d04232-ab55-4abe-56e2-08dc69c907eb X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: L0wgoTZd2GBwai+FnUWb0VBsbieyzWq3etk6+ay1q20ebLn+yv5qppvQgXgZjIfzks7SgnUwzifEe4D2da1O59vIOX0RB3YmVbu2RtE9Ike01CgxMo5uFlUC0Q8AlJCC2uNOr6vwCdByqFXcn6xkD8vKh4hjW110X/q2tOuS1SW8GroV/L0NHhYiX3kYXJj72aqR4MJVWDp4fJhgr03MNKf7/stmNgNorWdX1fEG8YO7fNlpXQD4jShPuwzn7kGWKGSuIQD+H5wlQ4KFfkkZ5IwLRXZLDRmm7ISgeXQV/PrLVSNFkjWW6bW4acCwPZJjYoMIvEKQzlG6k7tMtOISNH8/Tt/3vfZwPLEFf02ns9CWeK6aAv54Lo8L32CMxu1xhlcwS+Vdr2efE4jHEERXOTpu9ktBSY5S6ENyG9Yb7EYFhnhPUoochKs1NPtGV4z6UKawPOXd+aciDf5IrbXYKuV7fEYziCErA/LaA1l4J5q1Aytvn+GmG/O4Xjy8PsnrQFdU5RoV+sYIlszWafvxjoNu6Jyp6Vr2QWVEiVRElqD9fmImtvYUl3krSHh9eNjBWmdj0NvIUP4pBNIUKT44mis1ya3GlgizOPUtjnU+IrZRYaOrrIZW6uZZoWcpjTp2 X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?WExtUytzWnJYTjNOY2s4L3VkMDE4VXg4TzRPQkF4aksrQnNYZ3BFNzVEd3Fp?= =?utf-8?B?RE9iSU5HeU1lTVIzL0xaQ0NGMnRmZ3dUbjA3TlpCVHZ4eEdoK3ljZWJrK0FR?= =?utf-8?B?ck1zNDFqYnFjU1NDSGRoMDBwOGdhREUzYkhvN0VCdDZrSkpRc3NsUUN2WkJ6?= =?utf-8?B?c2FZVHZMUk9UWjM3d0FHVTNFL3RsMkhuNmp0VXVwUDRYMGMrUXBEWThQRlNT?= =?utf-8?B?d0VYb2NtNGRDM3ZLZkJ3OEFMOWdvTFlsb2VZb1hReitTckU1QkdRQ1VxdjhF?= =?utf-8?B?ejlYNlhHYStSYTljYUt2WmhDQk9obFowSWlBcHdpTEZmY1NkRzdmWXZsS2o4?= =?utf-8?B?ODRnalRGWE1kOTREMFBVZUhaRjZueFN2MFdxd1V6T05uNEtSRkZBN0I3cjNK?= =?utf-8?B?M0RoaXFmY0hpKy9BNlJla1RuVVhjY2JML2dmSGhIYzk5a3JTYXRQMVRWSjgz?= =?utf-8?B?aldHQVpXOXlWWXRMTlJDRUxVSFFaNU4rVGNNQmtoWHlNK1B2bExjRzYyN1Zm?= =?utf-8?B?Vitmc0t0NDNxMGh3SnQvMnMwMnFKU25QMmRJOUo1RlQ1UnIvcE1LVHY1Y2Ry?= =?utf-8?B?Sm1NQ1dPUVVscGtjdHZ2Nkdqdk0yM1dPTGRZdnF4Tk0xU3dZWitDYnBQWlVS?= =?utf-8?B?bVAyYUYrM0hZZS9ZbTdSQXN3aUcxNVhzQlhkbHl2djRTeXM4RGRJTENCVkFK?= =?utf-8?B?Q1F6TU1oNDkvUTdXczZKSlFBQXhNTkZYcld3UVZHRlpUSXE2Skk4TzZWeVlZ?= =?utf-8?B?SVJQV2dLYW9tNGVwVFNlMnVZMDcwTm0rSFRCWjlzQ080U3B5VHlIWVlRNi9u?= =?utf-8?B?TXl1TStYSzNJcTdZaWk2RHUvclVBTnU1S1QrUDlXbzlqdEpEdkpFd2NmcnYy?= =?utf-8?B?ajNJNFJ4ZWl2VWdTVWlYSm5Lc2diei9lbU1hMHFGTnJtT0UwNmZSa2E1eTBw?= =?utf-8?B?MFEzS09mbTIxME5CNXo4QncyaGdpSDJvYnJLUmh4YWEyaCs5N0p2amtlbVo5?= =?utf-8?B?cWJNRGFWdTVzVHZxUzNaMFk2YVhwR2FKRnRnMVRuMWM1ZkRtcUVHRHRuSkZi?= =?utf-8?B?TGtPeUNSRFNmZ2JBWUVvTEVPVWIwdlVHNHBmNFYxVWkzaDB6TzgyYldqYzMy?= =?utf-8?B?bGI1Q1BITlhWK0VERk1pVCtQeUJhbVZVZHNycnc3dGd1UXdsUFdwSXppZ1Mr?= =?utf-8?B?aUh4UXZBQW9DamtsbmtrQ2xqZW9IUHF3TXJVU21ubFRRSWo2cVA5QnRKUmFB?= =?utf-8?B?ek9ua3kwQnAxZDRTcTZLV3lqclZ3amUrc3hCVEMzdFJ1YWVtZ1FjSVlaR2ww?= =?utf-8?B?OFVJU0lJOXRQVHA0bC9ieUppWE52QjhPaDFqOXFhclZ5Y2g1UjVYZzl6YkJw?= =?utf-8?B?OHovTTViWHZaSjNQSHB5Vm5KeTcvbjVQNXArcGxaVkVPbWhZQlFzVDNYNzlS?= =?utf-8?B?eGtXcXoxOWJPdlBRWVp4UllMRW5FN2ZQR0M5SVBWZndYbFQxNENnT1AvSzNq?= =?utf-8?B?OGpXanZtbzJTZ0RKcWJpRUp2czlDRVZERXl5M2hNRnljMkFjTlAvanF3UE9v?= =?utf-8?B?M3ZUbmh5UnJ2WW5mYVpBWmdSOG94a3Bua1hqZlhzN3B2bVFNQy83RS9EWUQv?= =?utf-8?B?aVRHcmN5bFdwTWZIRWxJUVgxeEdjbEQxYWp2WDNlOTNzWTF5NlFqWHY3TzZL?= =?utf-8?Q?PdB6XLPueqww0A96wwPG?= X-OriginatorOrg: sct-15-20-4755-11-msonline-outlook-d8e84.templateTenant X-MS-Exchange-CrossTenant-Network-Message-Id: 89d04232-ab55-4abe-56e2-08dc69c907eb X-MS-Exchange-CrossTenant-AuthSource: SI2PR01MB5036.apcprd01.prod.exchangelabs.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 May 2024 10:25:32.4869 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: PUZPR01MB5210 X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.50 / 15.00]; FORGED_MUA_SEAMONKEY_MSGID_UNKNOWN(2.50)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[hotmail.com,none]; R_DKIM_ALLOW(-0.20)[hotmail.com:s=selector1]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f403::/49]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_TO(0.00)[yahoo.com,FreeBSD.org]; FREEMAIL_FROM(0.00)[hotmail.com]; MIME_TRACE(0.00)[0:+]; TO_DN_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[hotmail.com]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[hotmail.com:+]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; MLMMJ_DEST(0.00)[freebsd-ports@FreeBSD.org]; DWL_DNSWL_NONE(0.00)[hotmail.com:dkim] X-Rspamd-Queue-Id: 4VTtW66ZWqz4kDb Hello. Mark Millard wrote on 2024/04/29 10:48: > I've modified my local poudriere-devel to have Success and Failure lines also > report the tmpfs size at that point. Using, say, script to log the output to I am a bit curious because I am using tmpfs to reduce HDD IO from stage phase to package phase to speed up the process. So I will try to integrate that as well... > "<" below is what is new, ">" is what was original, in > /usr/local/share/poudriere/common.sh : > > 5928,5934d5927 > < tmpfs_at_end="$(env BLOCKSIZE=512 df -t tmpfs \ > < ${MASTERMNTROOT}/${MY_JOBID}/ \ > < ${MASTERMNTROOT}/${MY_JOBID}/.p/ \ > < ${MASTERMNTROOT}/${MY_JOBID}/usr/local/ \ > < 2>/dev/null | tail -3 \ > < | awk '{ tmpfs_use += $3; } END { printf "%s %.2f %s", "TMPFS:", tmpfs_use*512/(1024**3), "GiB" }')" > < > 5942c5935 > < "Success${COLOR_RESET} ending ${tmpfs_at_end}" > --- >> "Success" > 5968c5961 > < "Failed: ${COLOR_PHASE}${failed_phase}${COLOR_RESET} ${tmpfs_at_end}" > --- >> "Failed: ${COLOR_PHASE}${failed_phase}" > If we wanted to integrate it here, we could have used a hook script. Simply append the following script fragment to /usr/local/etc/poudriere.d/hooks/pkgbuild.sh or install the file in /usr/local/etc/poudriere.d/hooks/plugins/somedirectory/pkgbuild.sh. Well, but hook scripts are a pain to create because of the quirks in the variables and resources that can be used :) The following is the script. You are free to modify and use the rest as you wish :) Regards. #!/bin/sh case "${0##*/}" in pkgbuild.sh) case "${1}" in # ( success|failed) if [ ${MY_JOBID:+1} ] ; then tmpfs_at_end="$(env BLOCKSIZE=512 df -t tmpfs \ ${MASTERMNT}/../${MY_JOBID}/ \ ${MASTERMNT}/../${MY_JOBID}/.p/ \ ${MASTERMNT}/../${MY_JOBID}/usr/local/ \ 2>/dev/null | tail -3 \ | awk '{ tmpfs_use += $3; } END { printf "%s %.2f %s", "TMPFS:", tmpfs_use*512/(1024**3), "GiB" }')" if true ; then # output to stdout echo "${2} | ${3}: ${tmpfs_at_end}" >&${OUTPUT_REDIRECTED_STDOUT:-1} fi if false ; then # output to stderr echo "${2} | ${3}: ${tmpfs_at_end}" >&${OUTPUT_REDIRECTED_STDERR:-2} fi if false && [ ${OUTPUT_REDIRECTED:-0} -eq 1 ] ; then # output to ${LOG}/logs/${3}.log file echo "${2} | ${3}: ${tmpfs_at_end}" >&2 fi if false ; then # append to file echo "${2} | ${3}: ${tmpfs_at_end}" >>/tmp/poudriere-tmpfs.log fi fi ;; # ( *) esac ;; # ( *) esac # end of script