Re: NFS performance with 10GBase-T

On Sun, Feb 25, 2024 at 1:21 AM <tuexen@freebsd.org> wrote:
>
> CAUTION: This email originated from outside of the University of Guelph. Do not click links or open attachments unless you recognize the sender and know the content is safe. If in doubt, forward suspicious emails to IThelp@uoguelph.ca.
>
>
> > On Feb 25, 2024, at 01:18, Hannes Hauswedell <h2+lists2024@fsfe.org> wrote:
> >
> > Hi everyone,
> >
> > I am coming here from
> > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=2771971160
> I guess this should read:
> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=277197
Btw, what Hannes reported in the PR was that performance was
about the same for Linux and FreeBSD NFS clients when the link
was using a 1500byte ethernet frames.
However, Linux performs much better with 9K jumbo frames
whereas FreeBSD performance does not improve for 9K jumbo
frames. (Some mount options I suggested did help somewhat
for FreeBSD. Basically increasing rsize/wsize did help, but he
still sees performance below what Linux gets when 9K jumbo frames
are used. (I did note the potential problem of mbuf cluster pool
fragmentation when 9K jumbo frames are used, although I did not
intent to imply that this issue is involved, just that it is a known
deficiency that "might" be a factor.)

rick
>
> Best regards
> Michael
> >
> > TL;DR:
> >
> > * I have a FreeBSD14 Server and Client with an Intel X540 (ix) adaptor each.
> > * I am trying to improve the NFS throughput.
> > * I get 1160 MiB/s via nc, but only ~200 MiB/s via NFS.
> > * Increasing rsize and wsize to 1 MiB increases throughput to 395 MiB/s
> > * But a Linux client achieves 560-600 MiB/s with any rsize.
> > * The mtu is set to 9000 but this doesn't make a difference for the FreeBSD client (it does make a difference for Linux).
> >
> > I assume < 400 MiB/s is not the expected performance? Do you have any advice on debugging this?
> >
> > Thank you for your help,
> > Hannes
> >
>
>
>