From nobody Thu Nov 07 23:02:54 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XkyKR2k4Fz5cnnq for ; Thu, 07 Nov 2024 23:03:07 +0000 (UTC) (envelope-from bakul@iitbombay.org) Received: from mail-pg1-x532.google.com (mail-pg1-x532.google.com [IPv6:2607:f8b0:4864:20::532]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XkyKR0pr2z4Kp5 for ; Thu, 7 Nov 2024 23:03:07 +0000 (UTC) (envelope-from bakul@iitbombay.org) Authentication-Results: mx1.freebsd.org; none Received: by mail-pg1-x532.google.com with SMTP id 41be03b00d2f7-7ea6cbc90b7so84985a12.0 for ; Thu, 07 Nov 2024 15:03:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iitbombay.org; s=google; t=1731020586; x=1731625386; darn=freebsd.org; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=/UkwLedQTf/ueOcAqRoXiJIFCWF6Mf8olvbT/cM8I0Y=; b=Nv+0eldvyrLYEI2sEXlnoezF3yLn2jVz5xC8/u4ttRMi+Br58DB5dFMqMtrTR50R7M zk/OworeaWp9VZHwM8AfjZaO7058b+reK6giJgy4T/lDGWjGwUCNRVXhbARv3Yo1bAeK PoP1u4B8kK5uWoDlirbs+saFw7VoBmT0++Jfc= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1731020586; x=1731625386; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=/UkwLedQTf/ueOcAqRoXiJIFCWF6Mf8olvbT/cM8I0Y=; b=i/vXQMmPvLDVL/CjFZcyQXWuS51kGdxmg4bZxOSaU1uXr+PZmQxrsYrpSRZEfZgsQI sYbKOfG0mxlKGQNSuDuonWgslx9wyMEOSktH2b4/Hq7hcgQRFekNl+mPUBibhWjXVDSo Xson/LtJnoY9PpAuJw+UI4f/gdsWq+AiemMSmpO81s8BqUMUNVHP5BrHTVa6rphWhmFz NwctQ2BwB1j78ga/1BZ8vdOeseviLuRXyBIyG6WiEc8nTXs+Jff7vSBeni+KCrKHgS55 nlGTgz/K1/HyopZREejLJENLTmE2AldD+l41wWdnS8pVci7hzzAhTkbNz0zhgWNkTkmB uCxw== X-Forwarded-Encrypted: i=1; AJvYcCWFmsMXqHJsnhpCAlPNHzsBV4dyGlrglOaa0ncSvRZ+5YSdIB+n7wkPgPW0CDObeLguqdsoDH4sltGC+w==@freebsd.org X-Gm-Message-State: AOJu0YyHbwngyX91qKsiiuE8FzAo7T4gx3g+l8EsV6djhy7KZ7KdC5bf f5YMc8imbDqxy/BCS2l6PnnQbof1V+mCJYwoBw3mHm3gZ7FFp3tOXtjehttrFg== X-Google-Smtp-Source: AGHT+IEL5MfDbBGakZl/jSiLGj91kblwYc3gME97E+LAFbg0yQTLs4VvJi49aRAZvaHeXt5OuTq2og== X-Received: by 2002:a17:90b:3146:b0:2e2:de92:2d52 with SMTP id 98e67ed59e1d1-2e9b16a94c7mr562836a91.9.1731020585715; Thu, 07 Nov 2024 15:03:05 -0800 (PST) Received: from smtpclient.apple (107-215-223-229.lightspeed.sntcca.sbcglobal.net. [107.215.223.229]) by smtp.gmail.com with ESMTPSA id 98e67ed59e1d1-2e99a62bf50sm4150973a91.51.2024.11.07.15.03.04 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 07 Nov 2024 15:03:05 -0800 (PST) Content-Type: text/plain; charset=utf-8 List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.200.121\)) Subject: Re: An interesting anomaly in NFS client... From: Bakul Shah In-Reply-To: Date: Thu, 7 Nov 2024 15:02:54 -0800 Cc: Andriy Gapon , FreeBSD Net Content-Transfer-Encoding: quoted-printable Message-Id: <872F2EE1-29F3-40E7-954D-3FFACD7C72D7@iitbombay.org> References: <7FFE3D2B-4DD9-4657-ADC1-9C40CB54991F@neville-neil.com> <8187509e-c9fb-403f-8569-28ba58425cff@FreeBSD.org> To: Mark Johnston X-Mailer: Apple Mail (2.3826.200.121) X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4XkyKR0pr2z4Kp5 X-Spamd-Bar: ---- On Nov 7, 2024, at 2:09=E2=80=AFPM, Mark Johnston = wrote: >=20 > On Thu, Nov 07, 2024 at 07:28:59AM +0200, Andriy Gapon wrote: >> On 07/11/2024 02:43, George Neville-Neil wrote: >>> Howdy, >>>=20 >>> We've been digging into an interesting possible issue in the FreeBSD = NFS >>> client. Here is the scenario. I have a FreeBSD VM on my Mac, the Mac = is >>> the NFS server, the VM is the client. I then attempt to build an out = of >>> tree kernel module that I'm working on. The build looks like it's >>> hanging for 1.5 seconds, and when we look at the packets (pcap file >>> attached) we see a ton of GETATTRs over the first 1.5 seconds. I've = put >>> the pcap up here: oct_8_2024.pcapng >> people.freebsd.org/~gnn/oct_8_2024.pcapng> >>>=20 >>> I also note that an issue was raised on the forums that seems = similar, >>> way back between FreeBSD 10 and 11: >>>=20 >>> = https://forums.freebsd.org/threads/nfs-cache-misses-after-upgrading-to-11-= 1- >>> from-10-3.65491/ >>> >> upgrading-to-11-1-from-10-3.65491/> >>>=20 >>> I'm seeing this on 15 currentish (last few months). >>=20 >> Could it be just make checking for stale targets? >> I.e., stat-ing various files to check their timestamps. >=20 > I suspect it is from this line in sys/conf/config.mk: >=20 > __MPATH!=3Dfind ${SYSDIR:tA}/ -name \*_if.m >=20 > This is running a find command over all of sys/, so it'll stat about > 35000 files. I believe it's from > = https://cgit.freebsd.org/src/commit/?id=3D12f05b84463baacfada5a79eaed061a4= 899d98aa At least for this find, p9fs (in freebsd vm) is about 20 times faster! No idea how well qemu's 9pfs works but worth a try.=