From nobody Mon Jul 10 21:44:49 2023 X-Original-To: ports@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4R0Hbf1sVpz4h2hX for ; Mon, 10 Jul 2023 21:45:02 +0000 (UTC) (envelope-from tatsuki_makino@hotmail.com) Received: from APC01-PSA-obe.outbound.protection.outlook.com (mail-psaapc01olkn2087.outbound.protection.outlook.com [40.92.52.87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4R0Hbd5Pjhz3KMl; Mon, 10 Jul 2023 21:45:01 +0000 (UTC) (envelope-from tatsuki_makino@hotmail.com) Authentication-Results: mx1.freebsd.org; none ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=NCn7bUMHw9mC8YTbqpzJQMVdc4eQOAZTtlfENYa5BbHzT1reKF8upVRQ6PchAjDL/T7P98R1fCzrZNb2FuVnbbKUNApoQC9hhmwnH41FNby1b58wFJ9lUPewSPXQC3UDd9tcqjhWl1/FpMdk+r4zYyS5Qeyrdhz2liO3M5d6K93ljnSRFTmgeRxKYRNwNhjj1yrWH/H8s1b7IO3JRaB9tV00yon0h2jvUs7Y2T5p0+a8S5ZU0FN57VoGRdojqs6WCY5F7pR+3lNe1RmaQmrAki0+Vra46NihZQGoQlY9aiGh32T2qXR+bmsbs9CxFFtHJJmK2y+ZV5/ltQPoeANp0w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=M7+isMBzobi8QhMbf3YmgK3fd3qxVrzsZMrgiyed1BA=; b=WkOmYyjq5UzOnOWiXBuohaywgf3Ve/8qxENk3Z0nikTbTLKke3tk4n8OYQM8RoWqGFbY7bANEQF4W/EjuQ3n5eWolF6RjIr5hdO4haeiH1azJ67xZ0pO8HTNXg3vbmkUrVrEz+BFCCsWCJI39dOJOhJu5pqfX73HqZhe+Qu9jrctqOIdDK1cIbM8juAiW2VsyOF9yYi3MefyCdcFdUh8wX23RQiAJhBOcc+Vg1jfr0I+fJUJcEEP7oOzVcwr1K/m2HGwCl3CLQODavZ7gjrmwAhTdRUNH3WQ5mL5fw5wgPkMX2UeVIytnbW9+3x64tS6gbYEzCYneLBoYXh2fh9HWg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=M7+isMBzobi8QhMbf3YmgK3fd3qxVrzsZMrgiyed1BA=; b=D0tIlnhToBl13fCw8pQXjLpSzfbjV2GGLRWWCIEN1245rH/mgQjSO7eLRoAWTENAVYMktuQ3YW7+SL5Wzu1BeA4c+/LPvHBhU8YzKO/vzZIwwxH8FxY+HWp8VUemuNrmVXAetTkXi5gvGmn2+iJCg5kHecWvxF8GVNqVaIT92oEbtz2QOXHP06kgRt8P+kATHP4xIH3uRX+svwqU3MEhmbA+XPJnWXi6kAdi9Q31sTUO1ynDTo2GvSKW1SlJhCdSDsjcxnQ5LqYpNLo22sqfHe42pLekBmanKl9fmdxw8z+FeDXnh39/L8j0UWrtSIDTKCzAlhPYxm5fnj2v2PgCRg== Received: from SI2PR01MB5036.apcprd01.prod.exchangelabs.com (2603:1096:4:1f8::9) by TYZPR01MB3854.apcprd01.prod.exchangelabs.com (2603:1096:400:32::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6565.30; Mon, 10 Jul 2023 21:44:57 +0000 Received: from SI2PR01MB5036.apcprd01.prod.exchangelabs.com ([fe80::da60:e0b5:573a:6259]) by SI2PR01MB5036.apcprd01.prod.exchangelabs.com ([fe80::da60:e0b5:573a:6259%2]) with mapi id 15.20.6565.028; Mon, 10 Jul 2023 21:44:56 +0000 Subject: Re: Problem with the package builds To: Charlie Li , Guido Falsi Cc: "ports@FreeBSD.org" References: <9427bead-362b-29e9-d7ce-5a038280a8ea@freebsd.org> From: Tatsuki Makino Message-ID: Date: Tue, 11 Jul 2023 06:44:49 +0900 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Firefox/52.0 SeaMonkey/2.49.4 In-Reply-To: <9427bead-362b-29e9-d7ce-5a038280a8ea@freebsd.org> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-TMN: [0gxG5VR34fRh/a5k7TiVJPLtsraPUHbH] X-ClientProxiedBy: SI1PR02CA0001.apcprd02.prod.outlook.com (2603:1096:4:1f7::15) To SI2PR01MB5036.apcprd01.prod.exchangelabs.com (2603:1096:4:1f8::9) X-Microsoft-Original-Message-ID: <307b3c7d-1926-7695-a8e2-16529fa5e716@hotmail.com> List-Id: Porting software to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-ports List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-ports@freebsd.org X-BeenThere: freebsd-ports@freebsd.org MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SI2PR01MB5036:EE_|TYZPR01MB3854:EE_ X-MS-Office365-Filtering-Correlation-Id: a3ea06b9-40a4-49d0-935c-08db818ee61a X-MS-Exchange-SLBlob-MailProps: EgT5Wr3QDKxeiTRb7kjM8Tu66R1uvfOGNSkD/2l3+yFw02//J8JGTYBSBWEIpeIcqF/BHAneExXW9EyY3y+B5XFcCJcXo/pcBOSNv7hb9x77DrI/FHoIauY0CXwXsJzEWaUzYWANHsb4utOXUrm3Z1SZ6pSXmUOI6wfzEpi4ZIFfVnapC9xwwIFhVyOKT7gOnfDhfbHsL/pMpS3MXGEI/xTObnDdFDW4GkAqZSA+ZBrPM4sWAu+wZV2Ws9Y/3/jFUhHECdc04+CcBcsblZtOLYProHfy8Dq4Mbc3+IE/KTc2NEXLzkKd8xDRKFFcqtpy6cDivczFXPg6CqiFaUv7ZDfNLfr/gQ3QfI17lBOWPekjS0WPypInbajDegfRAR7xUAjb3g901w1W+1SRVy/2rAqVuQDx96mZUZULTjBPd6VHPUFkUGUVH2Ss9hahTHEGfAmZGtuUTEiLQxd663NTEcVEUKvFRRV7Kj3P5z7W+Wff51lSqzjHw3PjOf5CRJJkieSemvLgLqmDPI+LxdQ6YqlmJTICBeeA4HL/MDBPIkD9pfrZ4StoejXB+YFZPZFHPZ0YRjETvemgzAWqMd6Bnl6O+6/tOnxhd+F6ATCzZetkplvAPwdt6YArDh+W06mGKmhMp21sbxRc2jHsr7lJIHZHvwkrQJduos3qpflGD/dhliO0H3UAT+EBB77qWSZ6ueNArBjHvpJknoiXOfMQjQwsTYBFeKRgZzjcZiQfnkM= X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: PILhn6EQ1gbOTYC8uBdjJlVtX4AWwXs4gs2hk2cLYSp82nDZAfNZWNZ+cmZqa/4zVx7A8RTZjqLKCIDBSGj90K2boIN2MwiUDBq9jwuFP7adlWOX43osHQZhRSDHB1VX+iSD/6FrLIy7QhemTmKZhHZbDvLkVgQdLdHf2EY4YhtsWaWKSoRuWxUF3XwF0yTlQEbCcvGObuM5Dc/X5qxx8XStISBZmj90a7cF9aDtn547cUa/0I6revUrXbOPrdKbMSCwz+reAPoWX6tM4RK+Bu8gPRfSPfI/sfhLNh7+55TgLcR5sQ8IkZNM0UAPildHss5wC3TzeVQUpqThQg9BtjbbY1PD4lO4LgNqxMO0rylLu5WoCtYJ9PqUX2nZInYcJQrt/Li58jhM/9bRwuBA/8SJa+D9quW86GQLWaskkafdZto2kiqgxbwi0owsz/pawBSnhVBtM8UfoLqVAmtW4SLo9KyUiW1CZ2Fo1UkMSuEeDdPOKWCZ2BVi2gMHlvHaXcENpK9NwsX786YSMvL0zp4b15W82Ha2AZXg3ca+1af2o9bcanMfeSFx7pTK8u8Uhp/7aZtJaHhBi7l6a4ifmd9ueZmAnvo9omqgA77z+Ak= X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?VEdpMDA5TGkzTk1HdjlWcUN1OHBYMTZvQStSam01bHphdFNCSHBYK1lCSGRB?= =?utf-8?B?OEV3WS9zN0U4NUNJRk5SMUFqZWc0TjZhN29HS0hHRS9Ra2VLU3VwZEVQOEMw?= =?utf-8?B?Zzk3K2VrbGRRb1BGMHUyeGEwc2NHOUtqeTZnVkR3WnQyZlFOOGdqbVpyWFRY?= =?utf-8?B?c0hVcXU0Q2k5RDB0dE9lQ3FJbGJsK04yNWszYkxsRGxYWTgrQ3ZSU3ZVWmh3?= =?utf-8?B?UzROWUMxR2pZUk56Q1piM0JubDNyclpjUGJiQk5DbEhJNHJYNitvTEFyYzI0?= =?utf-8?B?bFNEK0c4WkdJMWw4RGpZOWxEMk9zUHpqcHo3aURZaVMwZGJkM1RTVTVKWUk0?= =?utf-8?B?cVJlWVNyWG5OakJNbFJDTnhJVE9oc2ZRRlFuOVNldTBEMWlrdkJxblNLU21o?= =?utf-8?B?cTlQQkJxSzQ3bjBlY0QwUlNYT0VBVUZYZno3d0VhYlVEOG9HSmtFV1VGRVRG?= =?utf-8?B?eXNXVE40bk1ER1BaK0NpQlhpMm1GVXF2bm0zVHlpVzBPd2J1bkJ6bEd2ODll?= =?utf-8?B?M1lWTzNhbnl4VWdIL2tMWnMwbGVCaHVCTjExRDd4VVhrT0xrMlllSHN5YXM2?= =?utf-8?B?V041Ym1DczhjYWIzdEpjc2Nmd2tRWXJLVnJRZHEzWWxNekE1THJFTjJhd3d5?= =?utf-8?B?RkgwMFJLY0tHRkJMMVlZamFzMlZqZldGKytsQm9BdGhobys1azFMOE56N25J?= =?utf-8?B?L1NweTJYT1YxSDIycTBsYkR6NmQxK0JLcUFrdERPcGhNUXcyN0lzZ1gzQnNr?= =?utf-8?B?Ky9BQWdBUVRVdkUvdTN6ZE90VEw1NmxpdGtyd1pLTFZNVXR2dzgyTEJJSEYx?= =?utf-8?B?TVdGbEtxNE5CVEVSamtTaTFpb3ZNb1VPeGREZElVdGJkNXNCVXFyZEYzNUxE?= =?utf-8?B?bjU2R1EzaVdYcHdtOVk3bkdmckZ1TS9WTCsxbzI0OUJDSWs5dTJIWU5Ec3VV?= =?utf-8?B?UVBmUWRrZU5DSG5UcUxNRnRKdkI0T2IyTlhUTVM3WmRZVHhPd0hLT3NOVHZr?= =?utf-8?B?SXFUYW5ybnlhb1d3ZHh0VmlDVzRVNGtEVTU0b2pncFRvbzdzSW9DZXRZN1dS?= =?utf-8?B?QTd4c05jQlVUMGtZVHlpMWUrclkySmNVL01YMi80S0dXWXpkRlFZbTBxemV3?= =?utf-8?B?WHVQb1QxNTJ5RTEzNWpGVm1qUC9pQWd5ckJFUUlPOHNvcXBqT0FDZTZnNzBm?= =?utf-8?B?djh3N1lEeVJUcmZONm5ibjJBMWVtVC9qckhHWnZxMTA0UlJkQmxkL0dmdUE4?= =?utf-8?B?clczbWZXNkFwR1IybFBUQVZTN1BLSW9Ec2h0M2JtTTVwS0Z2QmoyUWtBZWhh?= =?utf-8?B?TVJiVXl1K2RUWkdqWHhxOWNRWU1qUEc1NGhwdXVLc3laWnlKb04wQTZmNWcv?= =?utf-8?B?T2VpZDdDRnNvWUgxN3haMDlvZFBhNEwxK05PdkVnYVAyNVBmdFpVbGc4NlIy?= =?utf-8?B?NG4vV29NTW9JeEh4RXFmam5oenhQODFyc1lUVEYveEdOQmpiRU5VdmI3U0NW?= =?utf-8?B?WHNSWGNKZ1pDMldkVkQ0U29VSk8zbVNxSUV0WXZHalQvdkZmVFJwNU9aZjVS?= =?utf-8?B?N3N6NWdCMjd4a1c3c2R0QUpzYWYzUTRkWGVkTFFReHZXbjRsSlJlZ1RnWFR1?= =?utf-8?Q?obrX/EBp/rUb/ucy+IY10TdD2k6jPZ5xi8qzXTWY6CdM=3D?= X-OriginatorOrg: sct-15-20-4755-11-msonline-outlook-d8e84.templateTenant X-MS-Exchange-CrossTenant-Network-Message-Id: a3ea06b9-40a4-49d0-935c-08db818ee61a X-MS-Exchange-CrossTenant-AuthSource: SI2PR01MB5036.apcprd01.prod.exchangelabs.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Jul 2023 21:44:56.7021 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: TYZPR01MB3854 X-Rspamd-Queue-Id: 4R0Hbd5Pjhz3KMl X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:8075, ipnet:40.80.0.0/12, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N Hello. Guido Falsi wrote on 2023/07/10 18:01: > This resonates with something I have observed from time to time on my build machine. > Especially when using a big ccache (32 GiB or more, is what I can testify about), but also when building ports with a big number of files like the teTeX, it sometimes runs out of vnodes and the everything grind to an halt. Raigin maxvnodes to very high numbers helps a lot. > > I now have this is sysctl.conf: > kern.maxvnodes=4194304 > > Maybe this is related, and anyway something worth looking into IMHO. > Maybe simply rising the default maxvnodes for machines with a lot of RAM (my machine has 48 GiB) could help. The current value of my machine is, # sysctl hw.physmem kern.maxvnodes hw.physmem: 34254241792 kern.maxvnodes: 620655 Default value. Probably. Charlie Li wrote on 2023/07/10 23:09: > This doesn't appear disk IO-related, since I've hardly seen any intensive disk activity while pkg-add(8) executes, but the CPU usage has shot up significantly for no apparent benefit. > > I filed https://github.com/freebsd/pkg/issues/2156 to track this. I think pkg-add uses libarchive, but the cause does not exist inside pkg, and libarchive in general may be the cause of the slowdown. For example, chromium seems to do small increments of disk access while browsing, but if I'm doing firefox source extraction on the side (make -C /usr/ports/www/firefox extract), chromium waits a long time. This occurs not only during source extraction, but also in the middle of some kind of find in periodic daily. So I'm thinking that libarchive is not the cause, but something closer to os or hardware, but I can't narrow down the conditions. Now a WD hard drive that poweronhours in smart returns 38423 may be bad :) Anyway, I know that there are people who feel the same way :) I'll consider increasing kern.maxvnodes a bit and seeing how it goes. Regards,