From nobody Sat Jan 13 15:41:02 2024 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TC2gM5L76z57mLn for ; Sat, 13 Jan 2024 15:41:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TC2gM3nbLz4T5H for ; Sat, 13 Jan 2024 15:41:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1705160463; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=h9JADH3Wsirn6FBc+kBxbk1Gt621W4pg6VcU17hAFXg=; b=m7I2jay1SeLGu3ptRG3WHv7B6ulhQ97HYYgmk5cXUpvr6NUcMYyHDM4B9Hac2qGktBazG5 NiTDAF3q5O9yrirWXJ3cqFUsudcRRvNR/P+vthhPlIxSBwgrzng4d4bFz606TR1c/1/AO1 yBuq5/DIcvFD7TiWxSydRDUUTHBznA1pNKrhqBXhYOT5pJomVAC50wQdetfg85+ED9NTQA kPaKocZR62Nm03LajtNLrpMYReogyMo2Ay66lrIpyqA5H/nbYpNSjrXBUFcVLPsbTs4L8a gc6GNZf4ScjH47xi5JOYf+e/CkudvghI7SIkYgznC3Ld+wA+JdU3c0SqOzam5A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1705160463; a=rsa-sha256; cv=none; b=wg8+L+CGLARKbQvki8DHl2QmLgwsUzvdTxkHqiEiZtWd+CqQnssX/k/z8O0vSecM1gedtN Xh+0671gAfgBQiC7/zaas6icHd42GTu3pk710jHY+4xI8cTGDH8Obat5Fc25V6At9kI064 SARmBZcm3O8nQMoBK/CwyXnGUoXpsxMrufZjruH3O2ZBYjW3/yHOXP7i6ACKA5+k6Df/y1 B6QWWdTRvz1kWgI/8jcamVUIvc10974sl9FBWcjNs9LFxoU2dcIxTzb5kkq282EFWWiWlT BuJLn04jxTE2qqc7452sTPiS9TnG0rp2MDdK/18EWMmjXUKiY9ZCv3cjvx/NHQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4TC2gM2sM4zbxy for ; Sat, 13 Jan 2024 15:41:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 40DFf3fo086698 for ; Sat, 13 Jan 2024 15:41:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 40DFf3qR086697 for bugs@FreeBSD.org; Sat, 13 Jan 2024 15:41:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 276299] Write performance to NFS share is ~4x slower than on 13.2 Date: Sat, 13 Jan 2024 15:41:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dmilith@me.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D276299 Bug ID: 276299 Summary: Write performance to NFS share is ~4x slower than on 13.2 Product: Base System Version: 14.0-RELEASE Hardware: arm64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: dmilith@me.com I've upgraded my aarch64 box (RockPro64 with 4G RAM) which serves a ZFS pool over NFS. Before the upgrade (on FreeBSD 13.2) my upload speed to the share was like 50-70MiB/s. After the upgrade to FreeBSD 14.0, it struggles to get even 10M= iB/s write. I've tried switching from NFSd v3 to v4. It's even worse (6MiB/s write). The disk is WD Gold, 10TiB. So I'm quite sure it's not about the disk speed= or the network speed (my router has 1G ports). My /etc/rc.conf: # NFS hostid_enable=3D"YES" nfscbd_enable=3D"YES" rpcbind_enable=3D"YES" nfs_server_enable=3D"YES" nfsv4_server_only=3D"NO" nfsv4_server_enable=3D"YES" nfsuserd_enable=3D"YES" mountd_enable=3D"YES" mountd_flags=3D"-r" rpc_lockd_enable=3D"YES" rpc_statd_enable=3D"YES" I've bumped /etc/sysctl.conf settings to huge values: net.inet.raw.maxdgram=3D262144 net.inet.raw.recvspace=3D1048576 net.inet.tcp.sendspace=3D1048576 vfs.nfsd.srvmaxio=3D1048576 vfs.nfsd.maxthreads=3D128 net.inet.tcp.rfc1323=3D1 net.inet.tcp.sendbuf_max=3D16777216 net.inet.tcp.recvbuf_max=3D16777216 But this improved nothing. Maybe it's even worse=E2=80=A6 My NFS client (macOS 13+) uses these options: mount_nfs \ -o \ =20 rw,vers=3D4,deadtimeout=3D0,readahead=3D6,noatime,sync,async,hard,bg,intr,i= net,tcp,nfc,rsize=3D1048576,wsize=3D1048576,dsize=3D1048576 \ vks4.home:/Copies/VMs \ /Users/Shared/NFS/VMs My sequential read from NFS is as before (~50-70MiB/s). Which is "okay" for that HW. But what can I do to bring the write speed back to 50MiB/s? Did I = do something wrong? Thanks --=20 You are receiving this mail because: You are the assignee for the bug.=