[Bug 277197] NFS is much too slow at 10GbaseT

From: <bugzilla-noreply_at_freebsd.org>
Date: Thu, 21 Mar 2024 22:37:56 UTC
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=277197

Peter Eriksson <pen@lysator.liu.se> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |pen@lysator.liu.se

--- Comment #6 from Peter Eriksson <pen@lysator.liu.se> ---
(In reply to Rick Macklem from comment #1)

A quick test between two FreeBSD 13.2 servers with 10G Intel X710 ethernet:
(writing to a ZFS zpool with spinning disks/log on SSD/cache on SSD):

# mount -t nfs -o sec=sys,vers=4 dedur01:/test /mnt
# cd /mnt

# dd if=/dev/zero of=16G bs=1M count=16384 status=progress
  16982736896 bytes (17 GB, 16 GiB) transferred 61.065s, 278 MB/s   

# dd of=/dev/null if=16G bs=1M count=16384 status=progress
  17151557632 bytes (17 GB, 16 GiB) transferred 49.015s, 350 MB/s   


# cd /
# umount /mnt

# mount -t nfs -o sec=sys,vers=4,readahead=8 dedur01:/test /mnt
# cd /mnt

# dd of=/dev/null if=16G bs=1M count=16384 status=progress
  16490954752 bytes (16 GB, 15 GiB) transferred 16.019s, 1029 MB/s  

# nfsstat -m
dedur01:/test on /mnt
nfsv4,minorversion=2,tcp,resvport,nconnect=1,hard,cto,sec=sys,acdirmin=3,acdirmax=60,acregmin=5,acregmax=60,nametimeo=60,negnametimeo=60,rsize=65536,wsize=65536,readdirsize=65536,readahead=8,wcommitsize=16777216,timeout=120,retrans=2147483647

# ifconfig ixl0
ixl0: flags=8963<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu
1500
       
options=4e507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP>
        ether 3c:fd:fe:24:e7:e0
        media: Ethernet autoselect (10Gbase-Twinax <full-duplex>)
        status: active
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>


If I redo the read test without unmounting and remounting I get some silly
number like 4GB/s or so (cached locally in RAM I suppose :-)

-- 
You are receiving this mail because:
You are the assignee for the bug.