Slow performance with Intel X540-T2 10Gb NIC

[Sami Halabi]

hi,
would you share what was wrong in the windows side and how you solved it?

Sami

בתאריך 22 ביולי 2016 12:33 AM,‏ "Chris Dunbar" <chris at dunbar.net> כתב:

> Hello again,
>
> I have good news and bad news:
>
> The bad news first: I am an idiot and I have wasted some of your time for
> which I apologize.
>
> The good news: Testing now between two FreeBSD 10.3 systems, I am
> achieving blistering speeds with iperf3. I apparently fell into the trap of
> assuming the new thing (FreeBSD is new to me) was broken. Now I see that I
> was assuming Windows was working fine and focusing all my attention on
> FreeBSD. Looking back over everything I have done to troubleshoot this
> situation I must conclude that the performance issue was on the Windows
> side and not the FreeBSD side. I am less concerned about that because my
> ultimate goal is to install my three X540s into one FreeBSD server and two
> VMware ESXi hosts. I am now fairly confident performance will be great.
>
> Many thanks for your collective attention and the suggestions I received
> from Eric and others.
>
> Regards,
> Chris
>
> ----- Original Message -----
> From: "chris" <chris at dunbar.net>
> To: "freebsd-net" <freebsd-net at freebsd.org>
> Sent: Thursday, July 21, 2016 4:53:40 PM
> Subject: Re: Slow performance with Intel X540-T2 10Gb NIC
>
> Eric, et al:
>
> I haven't tried netperf yet, but I do have some new information to share.
> I have two systems that I am using for testing: the new server and an older
> (not too old) desktop PC. I installed CentOS on the new server again
> because I know it can achieve >9 GB/s with the X540. I replaced Windows on
> the desktop PC with FreeBSD 10.3 (it also has an X540) and ran iperf3
> again. I was able to achieve >9 GB/s so I know the problem isn't the X540
> and I know the problem isn't anything with the default installation of
> FreeBSD 10.3. So, what in the world might be nutty in my BIOS settings (or
> elsewhere) that would cause the new server + FreeBSD 10.3 + X540 to equal
> slow performance?
>
> Regards,
> Chris
>
>
> From: "Eric Joyner" <erj at freebsd.org>
> To: "chris" <chris at dunbar.net>, "freebsd-net" <freebsd-net at freebsd.org>
> Sent: Thursday, July 21, 2016 1:27:10 PM
> Subject: Re: Slow performance with Intel X540-T2 10Gb NIC
>
> (Replying-all this time)
>
> Did you try to set these settings that ESnet recommends?
> https://fasterdata.es.net/host-tuning/freebsd/
>
> We don't use iperf3 here at Intel (we use netperf instead), so I'm not
> sure I can be much help diagnosing what's wrong.
>
> On Wed, Jul 20, 2016 at 5:39 PM Chris Dunbar < chris at dunbar.net > wrote:
>
>
> Hello,
>
> I am new to FreeBSD and recently built a file server out of new components
> running FreeBSD 10.3. I installed an Intel X540-T2 10 Gb NIC and am
> experiencing what I consider to be slow transfer speeds. I am using iperf3
> to measure the speed and test the results of modifications. So far nothing
> I have done has made a noticeable difference. If I run iperf3 -s on the
> FreeBSD server, I see transfer speeds of approximately 1.6 Gb/s. If I run
> iperf3 in client mode, the speed improves to ~2.75 Gb/s. However, if I
> replace FreeBSD with CentOS 7 on the same hardware, I see iperf3 speeds
> surpassing 8 GB/s. The other end of my iperf3 test is a Windows 10 box that
> also has an Intel X540-T2 installed.
>
> I did notice that FreeBSD 10.3 (and 11.0 alpha 6 for that matter) includes
> a slightly older Intel driver (v3.1.13-k). I managed to build a custom
> kernel that removed the Intel PRO/10GbE PCIE NIC drivers. That allowed me
> to manually load the latest 3.1.14 driver downloaded from Intel's web site.
> Unfortunately that did not produce any improvements. I am working my way
> through man tuning() and some other articles on network performance. So far
> nothing I tweak makes a noticeable difference. I'm increasingly skeptical
> that I am going to find a setting or two that more than doubles the speed I
> am currently experiencing.
>
> I am open to any and all suggestions at this point.
>
> Thank you!
> Chris
> _______________________________________________
> freebsd-net at freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to " freebsd-net-unsubscribe at freebsd.org "
>
>
>
>
> _______________________________________________
> freebsd-net at freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscribe at freebsd.org"
> _______________________________________________
> freebsd-net at freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscribe at freebsd.org"
>