From nobody Sat Oct 09 15:35:23 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2D57717E3860 for ; Sat, 9 Oct 2021 15:35:37 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-eopbgr660070.outbound.protection.outlook.com [40.107.66.70]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HRTfJ74Wnz3LBY for ; Sat, 9 Oct 2021 15:35:36 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=P3g/i8q8PGZUZ2MW97NvnwZx79e/XyEhPtDo8Wk4ipuHvfl7bG9sPTo9GjDVuF0kN6aMemMCd1C9O7m7KfyvNu/rV81g8Zxcfv0Ood3xpkErc5vUEquayK+z3z0/wnCeg/KXXaN1lKi/3vJ4pl+cVsbTBScJxfb/+E6Pi01bPbjq+x0+HjD2dA4TU07W+aCUzWUnXuoln7dw5n5AjtmjmzCWvuZP/8MU8J+ZiRRrtO4k/FVx4y+zXzkeI7CNh5L1n7GyJVzwd+F6bDj9/ZGjrx+bI3VIZCyPvAMSdqD4E+EMJu+2wyyWpwGvFzurFQtwFmb70GpfplnsXlxYb8i2lA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=rL0rMKXrirhDTXjaKhi3iD9l5vdtRhyTR8zpr/+rv8w=; b=iEc8JuXm4QlcWbDM7VO7KGBOaF6pRHura7CBO+Kk0tiGL3n/IlEmjatlgIR2G5PwqHdXccibstqdXVhajEDb9nwY3DHP+IGKqNkTmgGph99CTjmfwj1rp+FNBhD87nXDrsXQBvcVn/oLTJGmN/IHLXsaXZg0Haovqe+z7Thclf1Gnsh6PubIanxw+cKI3Xvom3nO3tw3/C5I4MGLpXAcg1oAMnlkZIXUtWe735j6a8YVpU3uW4s56+A8fHll5GSQJW8xZiK2c8QDGRMXe4vkMqsK3vf1ykzvRwJ+HwQqswWPDk2Pv70toLMUpy5GirDmtwDFy0LDIpF8cl9KcUmH2g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=rL0rMKXrirhDTXjaKhi3iD9l5vdtRhyTR8zpr/+rv8w=; b=YKT7gRfKIUk/8i+VKrfKD9u38dAlDXF/a/94DJfn0f3P9HLePGOpVRtTKJ11gftQFZVkEvIj+Q+kN9MeKP8IIpoRhT6rOO7OklLxapOFrlF/xW7eaTDzex5EfbaUnvwnPW52ujaMH21ecFVU1LXDF9cZ6FKgLDUeCGcPyIKR55VQsu35oYAdWfPba6EDc6XEffn6y05db/OMjirJHtxnDUYK8zFe17BtkklTy0KGmLzqphElc8N2TTyrS0ErORI02TO3abbpo73LGG86QPyATVAgpRtLor5jvkfnSMbOzDOuOi/u6AFi1tbQalmu+snspNWWsWyrCO314uOtPc7bTQ== Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:19::29) by YQXPR01MB4406.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:6::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4587.18; Sat, 9 Oct 2021 15:35:29 +0000 Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::7091:13ac:171f:1c12]) by YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::7091:13ac:171f:1c12%5]) with mapi id 15.20.4587.024; Sat, 9 Oct 2021 15:35:24 +0000 From: Rick Macklem To: Felix Palmen , "freebsd-current@freebsd.org" Subject: Re: Writing large build logs to NFS extremely slow? Thread-Topic: Writing large build logs to NFS extremely slow? Thread-Index: AQHXvRjIhXhFzFqRLESM9Us/FueWtqvKyjub Date: Sat, 9 Oct 2021 15:35:23 +0000 Message-ID: References: <20211007021643.bwglyvrswk2nm3fl@nexus.home.palmen-it.de> <20211009141852.3cmjh7tysnehum7b@nexus.home.palmen-it.de> In-Reply-To: <20211009141852.3cmjh7tysnehum7b@nexus.home.palmen-it.de> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: fd4650d1-4b20-c4e2-4ddf-13392dd1399e x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 357a0951-e537-4974-833e-08d98b3a6948 x-ms-traffictypediagnostic: YQXPR01MB4406: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:7219; x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: eDYobs5D5k1Q4ogSnBGR2eJziNBCU638XxIZpddtFWZy4+Pcle/SHl8FET5cNsi7u0+bVqNmC6iYsZebZGdD9LbnwbG6CnN+fVWckt5XDvm+n2ZM9QPzru7KnEB6E7b4ox+v+aki3in/BHbowM7S63S24ZB053ukJLl3s2x6xtmVIfcY6/TbD/cq8tFs0xyi9hiJXZJNpZoljgsyt9EC7rZghfoQE5JUtRHEtdeudkGLKqoGxQdx/m2wxuZWexem4ySjKhA0MrsHH7gucrrjawn17GkDWUHDfg6WClZlLVWXkoFAKLWVMYuoEZG0Pwn6wPU/GUxJ6YS5qGh1ENNYdMI2/T7awBcfLRVpvkHvISfoq58Mr/zUdOp/XZbzWSRTD1MnxtIFgmkGzmQOynEg3taQlY92jWccombwW4tePPr00sU3U3S2CTsh4UaFctPotlIMeVm1r/126yFo0XskVILpXgnaquZElFqeW3V40zJdyt7uP0K9H8/q5aXl2Ci4ISbjMSVAaBkLiKBIJC1uFpdy5CQH403KONdQRsPAbPUZu1+NNnTYosiSLjj0PWZmomTJ8iDzW69fi4htz3PLOV+KzaEeu+nMsMjU0rKKsjzow0HdHFoYPhyccBDSsP4IkNd/kAqkQK5q9nTHtvw7KXQBFUi8owR4ALHMTUtn6syTOcco9B8jXXo2olW8d2nOBK84W1cpBggCoP71wZX3c7bAUOqrwZZ0stO4sDs4q/V9I9x8oVFXCpMp9sC1bJyQQeyqDT3UZtrQoY+7MzUVF6QMiCv263GovseD96l2rCo= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(366004)(33656002)(110136005)(8676002)(66476007)(38070700005)(91956017)(66556008)(76116006)(508600001)(66446008)(64756008)(2906002)(316002)(786003)(66946007)(83380400001)(52536014)(86362001)(6506007)(122000001)(38100700002)(7696005)(8936002)(9686003)(55016002)(5660300002)(186003)(71200400001);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?Windows-1252?Q?dbZobjl+Hse3iwWDSbEkmKXzWzL/x6haqbzPRaIZKRudy+9lEgdzowtz?= =?Windows-1252?Q?TQflZHTR/+5/La9ZoSMXKAzIN9FNGhASZ4hMPfQIxw2z/JcxSG0+WAuE?= =?Windows-1252?Q?EsBNMCx/HU5PhUVoh2eEQ5IUReh3HUBax9kHoE6mqxpEbj45Ow3VMdea?= =?Windows-1252?Q?G9amWoN/eG2sQiHMs5qZqyFI1MES1M3jebV4YmY5PcIUhObvNRd0RddT?= =?Windows-1252?Q?vuSUvMnuUMGJJEDIvvAcrGIlXqRDLW7Vgkzw1ERkVk2qvz+Edux1/+n7?= =?Windows-1252?Q?f7kxIA7d3zFd+Fkh4NJzjH+WWlBbW7+Ra1sI4c1QQT9LkaE4HjELs63V?= =?Windows-1252?Q?ixe5sGg9F4rjkJSfPkGp2PhoWH6j6zWlhJ7NSWkymo7IufBOlN7PIsL2?= =?Windows-1252?Q?qm/AzBacA1WEJ+aRGB6wtVILi3r0TlUjz7TV5rg4OPxSY/fh53Yse3Dg?= =?Windows-1252?Q?baPAboD/5NSGsXMUC5cOB7y5r7mEFP+/DbaA1NuHeX+/UV6AXmeBQmK9?= =?Windows-1252?Q?oyAqu6VRbzPh1O0Xg6eEeF96i7gFo/Vsb1zE677Ug/Qb9xicLKsTuQBJ?= =?Windows-1252?Q?FawMPiGMnSccdDLiP3LDhN2b9V6Z4FyQfbdlwclfBr5Tir5yiHbl368B?= =?Windows-1252?Q?qR7Xi17N2Cv7w4tbbypo1kSQfzV0yLvTqovoOYZVsdEGmr3/bsM/8D7x?= =?Windows-1252?Q?NCiEfEn/aax3ZGqxvZE4uLg2mDI8n5/QH/0w1U1Rfxc0i7S/zGFSji9R?= =?Windows-1252?Q?KbaF16EYnNTnwQuaoiaV24uP2KUfMMnJKgCO90NNyRfsJ39+Ag1v79gk?= =?Windows-1252?Q?zX0IRdqcgn2e8sutVzRLaYD3mxmz2KRhijJoVpD6OVDuwoAYOs++EmvH?= =?Windows-1252?Q?I+62n4pdgogLavTW8oDr7qn2WeA+tzp/F77tjzs0FVzQZDTMI9LHYpI8?= =?Windows-1252?Q?yhV9Gx7nzje7pnUZCe/IDZ7zmIwJDlujb28h+1vQc2D8T47wq4STq7p0?= =?Windows-1252?Q?603MW05Alcj92cAToPxN8LFkQJk9New7v3OJCRfdQzunMyEadkIlVBwr?= =?Windows-1252?Q?BV4NBEKM/6vTs/6WlscnizkExm/vV2kulQNpQYHexod0Lb4ViEutbsg4?= =?Windows-1252?Q?d1eviKRHCOELWzMQL8GPK0UlLQLwKXXneA09sNwlShPRO4nTQLqg7Mc3?= =?Windows-1252?Q?qGnXtpXP1+Op06y54zwZc9v4gBSOEyX9Z8eLrT9i0yKN6HFXKCJeNoBG?= =?Windows-1252?Q?WZGWfa0kqF5kF3N4TaBXZxtCUAv4HZsodE832bC25HsnZS69b76D9mC6?= =?Windows-1252?Q?C/0RSj7gPtOw8pMqKb4j9g94ebfkMAEY5d9hQ7y5aFYs19izo6uy++Aa?= =?Windows-1252?Q?f3qVKn/cS3RcGmZLOlGl+A1LGepzyewBbQkePyLYEhXqzqi2KDPyBv7H?= =?Windows-1252?Q?RKkB60hYF+J4JN/U3K9MXrqgPGaBNtfEJn6uPM/SEYXpOTE9qU4t5dvS?= =?Windows-1252?Q?9cKhFXQN?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 357a0951-e537-4974-833e-08d98b3a6948 X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Oct 2021 15:35:24.0059 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: UhWYhP+06bxd5OzJzxoHUW0NGpKwYImusrArO9AIfYWkWYKzQw56l/7OHA7l0INVV2315FW9AufG9u6+D6ABUw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQXPR01MB4406 X-Rspamd-Queue-Id: 4HRTfJ74Wnz3LBY X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N Felix Palmen wrote:=0A= >I use a -CURRENT bhyve vm for testing port builds with poudriere. As=0A= >this vm is only running when needed, but I want to always have access to= =0A= >the build logs, I use NFS to mount /usr/local/poudriere/data/logs from=0A= >the host.=0A= >=0A= >I noticed some few ports take ridiculously long to build while barely=0A= >using any CPU time at all. On a closer look, that's all ports producing=0A= >a lot of compiler (warning) output, e.g. gcc, gnutls, gtk2, =85=0A= >=0A= >So I assume appending to a large file via NFS gets slower and slower. Is= =0A= >there any mount option I could try to fix this? Right now I only have=0A= >`nolockd`, I also tried `noncontigwr` which didn't change anything.=0A= =0A= Assuming your NFS performance is acceptable for other things and it=0A= is only this log file that is a problem, then I doubt there is much you=0A= can do to improve it.=0A= --> Append (as in O_APPEND opens) are a poor case for NFS, since there=0A= is no append write in NFS. To approximate append write, it must flush= =0A= all dirty data to the server, do a Getattr to find out the file's cur= rent=0A= size and then do the write (over and over and over again).=0A= You can capture packets with tcpdump and then look at them in wireshark,=0A= to see what I mean.=0A= =0A= You could try the "nocto" mount option, which might help, if the log file= =0A= is being re-opened many times, but I doubt it will help.=0A= =0A= rick=0A= =0A= Thinking about alternatives to NFS, are there any news for client-side=0A= 9p virtfs? I found which=0A= still builds with a few minor adaptions, but trying to mount a 9p share=0A= freezes the machine.=0A=