From nobody Fri Feb 24 01:42:19 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PNCNR2GQ9z3t43d for ; Fri, 24 Feb 2023 01:43:51 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from mx0b-00273201.pphosted.com (mx0b-00273201.pphosted.com [67.231.152.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PNCNQ6bKVz49qb; Fri, 24 Feb 2023 01:43:50 +0000 (UTC) (envelope-from sjg@juniper.net) Authentication-Results: mx1.freebsd.org; none Received: from pps.filterd (m0108162.ppops.net [127.0.0.1]) by mx0b-00273201.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 31O0P819022643; Thu, 23 Feb 2023 17:43:27 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=to : cc : subject : in-reply-to : references : from : mime-version : content-type : content-id : content-transfer-encoding : date : message-id; s=PPS1017; bh=tvMU0fL/SeS6+RUDUTkKq1SwHRb7bkT+t++QDl0A3rk=; b=xfx1hNm3NoyGizCp43XcJFMSx6T/yQp/4FGnyE/dS4NaRrJdZOW4+h2Qa18fjZRBAmA2 M0MShICPGUm3rtLGHRwLDvlXHCpuIBemBr/lzP09AIekx+ihfIum5/54I/ann7thao1l vqGmfS6pvDCDDHsHKuIgh5GvbW53mvdV1iNcZc7sYZn8DPCn25+G0uky0x+wf1ZnYMvv /b0zojc0tHG8HUhCI/yTTSfqJtwRhZn3MFj+t/1XO4K+wYFqoZh6ByAiMetVUi7cLMGt RCSpw2xWRDvBhXduTPEHthzzWB2B2s7Pmf1u4CvLau34XZBozGnybO3GPg2i3ldlUjJL JA== Received: from co1pr02cu001-vft-obe.outbound.protection.outlook.com (mail-westus2azlp17011011.outbound.protection.outlook.com [40.93.10.11]) by mx0b-00273201.pphosted.com (PPS) with ESMTPS id 3nxjp1r3xc-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 23 Feb 2023 17:43:27 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=eFc/IlF+eY6Eub1Jnt7mN3nRIDTKdNuhC1eePK6/ann6/eB1V55ALXC82UjrHCmnczVF1JRFbc69L/rhRD0RFvu2kWRBymXrlGh/jfhiATlQV50xQrzJ3/OpyZAuPfDkrdUm80ASZcVN3+k43hg9VxvV8k3KkApoZrxVCF9zvMZ+/cHIit8/JmWQYzXRSMTc0m2SR7RteVsRcGa5ZcAzjFwzdhdKM2Agtf3mfnGwaq5CqAsU8N/XNSabyDVReKTtNPYV16B8a5Z+SLVCpooIhVrK7Wwo2mNUlp2ov/vNxXahgVR5cgKh6oVWnICwuhtVy6gLeShM6SKCJ5JCGAxyag== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=tvMU0fL/SeS6+RUDUTkKq1SwHRb7bkT+t++QDl0A3rk=; b=LcbNHqpIPmf24bdxnx3CQaP92CYzjhUnxS4GVeub43hUdS+izjHPeBvBtFqNPcKh/6t6KpOU8ivQb/Dr8AKnFVvB2nl0HehtbWW0LFf9Z+5MxoMRl9eeH2hWi2qN23PZ+tV1BMUVeOqhkPcVnzkDY60WTtZVHxgzCfb1TftmnUDkJ4LnAo31tn0t4/I3nE3O32LUwoWxDPT+tZ2edFZCnlZUhlElpqwNrSamoytPtGbYwuny+AafU1/nD9MY/UMlSg/wi1L/x9r38JilxkPvEN6qyRBRzsB4+nalN9GZto/jXnd25N8xgtMe+qy9MUaSP4NV3v6eN3rmypTIxrL9Sg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=softfail (sender ip is 66.129.239.15) smtp.rcpttodomain=yahoo.com smtp.mailfrom=juniper.net; dmarc=fail (p=reject sp=reject pct=100) action=oreject header.from=juniper.net; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=tvMU0fL/SeS6+RUDUTkKq1SwHRb7bkT+t++QDl0A3rk=; b=CdecwAfBnC427dNXr0gJ8FD1fR4cxjJCjFFoSr+S8o4p9dPmKnJzfv4c7ogQDAAVnVqd+E4wTT5rvzfLuprUSpi1nmKHmFsWzsr9I7+gEmgx0RasSFcnSgjJDKq5wZcwzK+I4d68H4dWICHLBHWUEpQb9bx4LPMWtBQuZXu2aAw= Received: from MW3PR06CA0011.namprd06.prod.outlook.com (2603:10b6:303:2a::16) by BYAPR05MB6037.namprd05.prod.outlook.com (2603:10b6:a03:d9::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6134.21; Fri, 24 Feb 2023 01:43:21 +0000 Received: from MW2NAM12FT105.eop-nam12.prod.protection.outlook.com (2603:10b6:303:2a:cafe::3b) by MW3PR06CA0011.outlook.office365.com (2603:10b6:303:2a::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6134.24 via Frontend Transport; Fri, 24 Feb 2023 01:43:20 +0000 X-MS-Exchange-Authentication-Results: spf=softfail (sender IP is 66.129.239.15) smtp.mailfrom=juniper.net; dkim=none (message not signed) header.d=none;dmarc=fail action=oreject header.from=juniper.net; Received-SPF: SoftFail (protection.outlook.com: domain of transitioning juniper.net discourages use of 66.129.239.15 as permitted sender) Received: from p-exchfe-eqx-02.jnpr.net (66.129.239.15) by MW2NAM12FT105.mail.protection.outlook.com (10.13.181.69) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6156.7 via Frontend Transport; Fri, 24 Feb 2023 01:43:20 +0000 Received: from p-exchbe-eqx-02.jnpr.net (10.104.9.15) by p-exchfe-eqx-02.jnpr.net (10.104.9.17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.30; Thu, 23 Feb 2023 19:43:20 -0600 Received: from p-exchbe-eqx-01.jnpr.net (10.104.9.14) by p-exchbe-eqx-02.jnpr.net (10.104.9.15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.30; Thu, 23 Feb 2023 19:43:19 -0600 Received: from p-mailhub01.juniper.net (10.104.20.6) by p-exchbe-eqx-01.jnpr.net (10.104.9.14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.30 via Frontend Transport; Thu, 23 Feb 2023 19:43:19 -0600 Received: from kaos.jnpr.net (kaos.jnpr.net [172.23.255.201]) by p-mailhub01.juniper.net (8.14.4/8.11.3) with ESMTP id 31O1hImm027968; Thu, 23 Feb 2023 17:43:19 -0800 (envelope-from sjg@juniper.net) Received: by kaos.jnpr.net (Postfix, from userid 1377) id 675E02112C; Thu, 23 Feb 2023 17:42:19 -0800 (PST) Received: from kaos.jnpr.net (localhost [127.0.0.1]) by kaos.jnpr.net (Postfix) with ESMTP id 6434D21289; Thu, 23 Feb 2023 17:42:19 -0800 (PST) To: Mark Millard CC: Bryan Drewery , Current FreeBSD , Peter , Subject: Re: FYI: Why META_MODE rebuilds so much for building again after installworld (no source changes) In-Reply-To: <1B5FCF8A-0DFD-4246-8464-65A44A40529F@yahoo.com> References: <3345EBA5-A09C-4E3F-B94D-39F57F56BDBB@yahoo.com> <73088.1611797582@kaos.jnpr.net> <10819.1677108389@kaos.jnpr.net> <76FA98EF-6184-4D7E-A01F-0EE8117D0D10@yahoo.com> <29887.1677115125@kaos.jnpr.net> <27790339-240F-4C97-97C7-38AFD8DE03D5@yahoo.com> <7FB6F619-6E71-4075-8A6C-573564371DD5@yahoo.com> <2655.1677134606@kaos.jnpr.net> <242BB478-B2FE-4BCC-A56E-098F3FEB3EE1@yahoo.com> <42586.1677183334@kaos.jnpr.net> <30.1677189836@kaos.jnpr.net> <1B5FCF8A-0DFD-4246-8464-65A44A40529F@yahoo.com> Comments: In-reply-to: Mark Millard message dated "Thu, 23 Feb 2023 16:41:34 -0800." From: "Simon J. Gerraty" X-Mailer: MH-E 8.6+git; nmh 1.7.1; GNU Emacs 28.1 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <89701.1677202939.1@kaos.jnpr.net> Content-Transfer-Encoding: quoted-printable Date: Thu, 23 Feb 2023 17:42:19 -0800 Message-ID: <93460.1677202939@kaos.jnpr.net> X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: MW2NAM12FT105:EE_|BYAPR05MB6037:EE_ X-MS-Office365-Filtering-Correlation-Id: bbbdab11-72a4-4b05-e79d-08db16088268 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: Ng+xvV/TVK3vTF9yf89djf+MwmHbxYY+fcvPkt/bNnGyi2pwvbyRdYYDcQIhBoJCyHUxX73qgbCPlM5WikL4CW3c7FoXtu244POdSuMHAKyt34RWJfCC+W7R7vnBFjgKsZbVyxp9+VFJ7A26Thejoz7cwfy9kUOJ1ujT/ATyXP2tq5RrsQKErxlaWu2a8XUArVHGIQ11HjdiKxnLz2wiNbSgclLbP66qFRQhVAzdQAjQYLyYEavNZzBKhp6g/crKg1UMv95ko2bbio2UB4Dtyl8q0pxrVJaqJULLRAxLlVQdEiSk5XROC2D8vnkXdwJl4aOh1r6FRFM1InGu/hvymqMy+ICx1HQIcu95i3CDwLujlLJso8hHnqqnXj0hrelbZudmEmU1+mAUkYRmERcQGTwFZkCAm82bSItqjt5en/5HtuOWntYb06oQl/UnmcldBuuX26zaahzoDjLFUlRJ6OZpi/QZ/oti5c4xDVm+GWfAuRnVLZ4e/K3bPW67lSTTgv0iV4W+JZ2vHGYyZC3Id+3/1dbpSCkvZv2vsLumMGXLHB+9w1DodP0JMCHjvYfjYSNuYnAKSD90BCdfSDG0IvGnnR5jEnZqBY9wnNfgPge4XrcBbx86ZS1IdxCoGzymykt1wcOCVKg60HFms/1xbIM2k0Un1d2u90qAG4ahAbR4LsDkHlA28LGA0Ee5N2sR4I6D0e4kOUo5imZorFveLT5hJzcOrEiytV3lKx4em3E= X-Forefront-Antispam-Report: CIP:66.129.239.15;CTRY:US;LANG:en;SCL:1;SRV:;IPV:CAL;SFV:NSPM;H:p-exchfe-eqx-02.jnpr.net;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230025)(4636009)(136003)(376002)(346002)(39860400002)(396003)(451199018)(40470700004)(46966006)(36840700001)(40460700003)(70586007)(54906003)(70206006)(83380400001)(8676002)(41300700001)(8936002)(316002)(5660300002)(4326008)(6916009)(107886003)(7126003)(9686003)(186003)(6266002)(47076005)(26005)(478600001)(336012)(356005)(55016003)(82310400005)(40480700001)(2906002)(82740400003)(36860700001)(81166007)(7696005)(86362001)(36900700001);DIR:OUT;SFP:1102; X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 24 Feb 2023 01:43:20.6050 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: bbbdab11-72a4-4b05-e79d-08db16088268 X-MS-Exchange-CrossTenant-Id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=bea78b3c-4cdb-4130-854a-1d193232e5f4;Ip=[66.129.239.15];Helo=[p-exchfe-eqx-02.jnpr.net] X-MS-Exchange-CrossTenant-AuthSource: MW2NAM12FT105.eop-nam12.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR05MB6037 X-Proofpoint-GUID: x5ip88nUAgVnKMPiZnlLCZlrcahXWyFH X-Proofpoint-ORIG-GUID: x5ip88nUAgVnKMPiZnlLCZlrcahXWyFH X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.170.22 definitions=2023-02-23_15,2023-02-23_01,2023-02-09_01 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 bulkscore=0 suspectscore=0 impostorscore=0 mlxscore=0 malwarescore=0 spamscore=0 phishscore=0 mlxlogscore=999 clxscore=1015 adultscore=0 priorityscore=1501 lowpriorityscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2212070000 definitions=main-2302240010 X-Rspamd-Queue-Id: 4PNCNQ6bKVz49qb X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:22843, ipnet:67.231.152.0/24, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N Mark Millard wrote: > Simplifying context . . . > . . . > > As I mentioned previously, there is no variablity of OBJTOP within the > > context of a single make instance - at least not once it starts runnin= g > > targets. > > > >> . . . > > > > .MAKE.META.IGNORE_PATHS +=3D ${OBJTOP}/tmp/legacy/usr > = > I'll use that definition line for the below. Ok. > > should result in nothing under ${OBJTOP}/tmp/legacy/usr causing a targ= et > > to be out of date - just because it is newer. > = > I'll ignore there that that is skipping too much > and just show what happens for the 2nd buildkernel > of 2 in a row when I use that exact line for both > make runs. > = > First counts of the "is newer than" lines, counting > separate program names separately: > = > # cat /usr/obj/BUILDs/main-amd64-nodbg-clang/sys-typescripts/typescript-= make-amd64-nodbg-clang-amd64-host-2023-02-23:16:15:18 | grep "is newer tha= n the target" | sed - > e "s@^.*: file '@file '@" | sort | uniq -c | sort -rn | more > 2553 file '/usr/obj/BUILDs/main-amd64-nodbg-clang/usr/main-src/amd64.amd= 64/tmp/legacy/usr/sbin/realpath' is newer than the target... > 1001 file '/usr/obj/BUILDs/main-amd64-nodbg-clang/usr/main-src/amd64.amd= 64/tmp/legacy/usr/sbin/ln' is newer than the target... > = It is of course critical to know what OBJDIR is at this point. also can you show me the line in the meta file that is matching. If you add the .info line I suggested in kern.mk or kmod.mk you should get some useful info. > Thousands of rebuilt things based on: > = > . . ./tmp/legacy/usr/sbin/realpath > . . ./tmp/legacy/usr/sbin/ln > = > It appears that buildkernel does not use an OBJTOP definition > that references: It is possible it does not have a "normal" value for it. Kernel builds start in the objdir so .CURDIR is actually under OBJTOP, so unless the makefiles have appropriate logic for that case, and depending on how OBJTOP is derrived, you may have a bogus value. The fix in that case would be the makefile setting OBJTOP. > = > /usr/obj/BUILDs/main-amd64-nodbg-clang/usr/main-src/amd64.amd64 > = > in my context. > = > For reference of Build lines paired with a few of those "is newer > than" lines: > = > = > I've still no clue of a notation that avoids this for > my choice to use personal MAKEOBJDIRPREFIX paths: That should work, looking at share/mk/src.sys.obj.mk though looks like you might get OBJROOT?=3D ${_default_makeobjdirprefix}${SRCTOP}/ which may not be valid for a kernel build. At least ${.OBJDIR} will not have that ${OBJROOT} as a prefix and some of the settings for OBJTOP look just wrong to me: OBJTOP:=3D ${OBJROOT:H} is the opposite of what the relationship b/w OBJROOT and OBJTOP are in DIRDEPS_BUILD but it looks like OBJTOP:=3D ${OBJROOT}${MACHINE}.${MACHINE_ARCH} is more likely to be used, but given the above default for OBJROOT that is unlikely to work for a kernel build. Looks like share/mk/src.sys.obj.mk grok's SB (the setup I/we use) so you can take control by setting SB and SB_OBJROOT to anything you like and it should be used for OBJROOT and presumably hence OBJTOP even for a kernel build. Though I normally use MAKEOBJDIR (similar to the way it is set in _default_makeobjdir), I don't know how well that works with legacy targets though - there's a lot of baked in assumptions about using MAKEOBJDIRPREFIX. Again that .info line I gave you would provide some useful clues. --sjg