From nobody Thu Nov 07 22:09:21 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xkx7V4yBzz5cjRT for ; Thu, 07 Nov 2024 22:09:26 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-io1-xd31.google.com (mail-io1-xd31.google.com [IPv6:2607:f8b0:4864:20::d31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xkx7V38q2z49jQ; Thu, 7 Nov 2024 22:09:26 +0000 (UTC) (envelope-from markjdb@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-io1-xd31.google.com with SMTP id ca18e2360f4ac-8323b555a6aso67630539f.3; Thu, 07 Nov 2024 14:09:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1731017365; x=1731622165; darn=freebsd.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:from:to:cc:subject:date:message-id :reply-to; bh=6xmnebECTrTopIePwSX9NVKXEpgyHpBE8cTrT1yFGCY=; b=C8GpEbV5ylVRr8zs8mk7jUYlgJpgv0gEmeKOOm78xEnoFF0WCzgbEnBSEekMq525Bv 0t5dKbsrXXfQIZtNUZocOXTrCUmn9aQ1Oc1y3hha+fXH1glaFkv5Ajl0yq/Ua5pgMA7L J3Xfs3em2BjgutoMLELgj5DUe9YX/EPCwZsI6J9tY3q3Q8ZNacBvL7xTAfNjqcAhmHgK VdS17cbfDtWSsKDmmhcknw8igmbtaK6oxFN7OpLQ6pkGPSEiTQRf7G9ibfgM2DAzBNSE RZyKCVrTGx+9LgZiUWNAo3u1pcl0UPHIlOLhHt9T8yg30wjaz0MOT/QUfhZTKUbACfnX L/Gg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1731017365; x=1731622165; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=6xmnebECTrTopIePwSX9NVKXEpgyHpBE8cTrT1yFGCY=; b=rwCXjpdpEXJ+C888MOwkR5bhNjT4xoHTLbGl14dTGR/upJBj1ROLyOH7ZFGlSwxIIR QnTlaWdc4CX6ekCzq4GKrOM3e+uX7JiTdDkMKL0d1UEw2msxxE25RnfIi/Pxwf6BGg1M GXBDSqA0Nf2msnpT5JuzocrbCtf/uBxdvPWH3WywCdvV7ssYIX1c3rfxTqGlRgAi0NMF jiU8Qm6irj1ys5JwhYD4+wkmc8szGDqr5qFmUxTTIgptR+KdaTKVG2GfHAd7//nNogXS LR+SLgpG1Ym70bRPdwHcc2N/UVPn/vrtVL7u55zzlLGBThuKIjHGHKL3ouCOrhGoS4Oo tASg== X-Gm-Message-State: AOJu0YxLeWn+GfDRj+ZN5daszdbCQRMSWNntdqnMKk6X3c68U1yFbfXj gDQ/VIJ5ANRxeBHn5cdS5qMvHDUE8P9Eorpvy4iIvtoByhewbQgLpA0u3A== X-Google-Smtp-Source: AGHT+IHCucnVBgtBqVXWxNvIhFCVaDEKja8iUlUVEwBOkjDHT2o/p/OjbQYLcV38Fey/p/FSufRI8A== X-Received: by 2002:a05:6602:1550:b0:834:f6d2:bfca with SMTP id ca18e2360f4ac-83e032fb757mr64049539f.9.1731017365170; Thu, 07 Nov 2024 14:09:25 -0800 (PST) Received: from nuc (192-0-220-237.cpe.teksavvy.com. [192.0.220.237]) by smtp.gmail.com with ESMTPSA id 8926c6da1cb9f-4de5f7e35b8sm513961173.24.2024.11.07.14.09.23 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 07 Nov 2024 14:09:24 -0800 (PST) Date: Thu, 7 Nov 2024 17:09:21 -0500 From: Mark Johnston To: Andriy Gapon Cc: freebsd-net@freebsd.org Subject: Re: An interesting anomaly in NFS client... Message-ID: References: <7FFE3D2B-4DD9-4657-ADC1-9C40CB54991F@neville-neil.com> <8187509e-c9fb-403f-8569-28ba58425cff@FreeBSD.org> List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <8187509e-c9fb-403f-8569-28ba58425cff@FreeBSD.org> X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Xkx7V38q2z49jQ X-Spamd-Bar: ---- On Thu, Nov 07, 2024 at 07:28:59AM +0200, Andriy Gapon wrote: > On 07/11/2024 02:43, George Neville-Neil wrote: > > Howdy, > > > > We've been digging into an interesting possible issue in the FreeBSD NFS > > client. Here is the scenario. I have a FreeBSD VM on my Mac, the Mac is > > the NFS server, the VM is the client. I then attempt to build an out of > > tree kernel module that I'm working on. The build looks like it's > > hanging for 1.5 seconds, and when we look at the packets (pcap file > > attached) we see a ton of GETATTRs over the first 1.5 seconds. I've put > > the pcap up here: oct_8_2024.pcapng > people.freebsd.org/~gnn/oct_8_2024.pcapng> > > > > I also note that an issue was raised on the forums that seems similar, > > way back between FreeBSD 10 and 11: > > > > https://forums.freebsd.org/threads/nfs-cache-misses-after-upgrading-to-11-1- > > from-10-3.65491/ > > > upgrading-to-11-1-from-10-3.65491/> > > > > I'm seeing this on 15 currentish (last few months). > > Could it be just make checking for stale targets? > I.e., stat-ing various files to check their timestamps. I suspect it is from this line in sys/conf/config.mk: __MPATH!=find ${SYSDIR:tA}/ -name \*_if.m This is running a find command over all of sys/, so it'll stat about 35000 files. I believe it's from https://cgit.freebsd.org/src/commit/?id=12f05b84463baacfada5a79eaed061a4899d98aa