Re: FreeBSD 14.0-RELEASE and Raspberry Pi CM4 4GB

From: Mike Karels <mike_at_karels.net>
Date: Fri, 22 Dec 2023 22:48:57 UTC
On 22 Dec 2023, at 16:14, Steve Bernacki wrote:

> Hi Mike,
>
> Indeed, I'm getting a lot of retransmits:
>
> [  5] local 172.16.200.2 port 55551 connected to 172.16.200.182 port 5201
> [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
> [  5]   0.00-1.00   sec  36.2 MBytes   304 Mbits/sec   60   9.98 KBytes
> [  5]   1.00-2.00   sec  35.7 MBytes   300 Mbits/sec  143    111 KBytes
> [  5]   2.00-3.00   sec  34.9 MBytes   293 Mbits/sec  141   7.13 KBytes
> [  5]   3.00-4.00   sec  33.9 MBytes   284 Mbits/sec  198   99.5 KBytes
> [  5]   4.00-5.00   sec  34.9 MBytes   292 Mbits/sec  167   1.43 KBytes
> [  5]   5.00-6.00   sec  34.2 MBytes   287 Mbits/sec  221   2.85 KBytes
> [  5]   6.00-7.00   sec  34.1 MBytes   286 Mbits/sec  169    100 KBytes
> [  5]   7.00-8.00   sec  35.2 MBytes   295 Mbits/sec  159   7.13 KBytes
> [  5]   8.00-9.00   sec  34.3 MBytes   287 Mbits/sec  138   4.28 KBytes
> [  5]   9.00-10.00  sec  33.3 MBytes   279 Mbits/sec  182   2.85 KBytes
> - - - - - - - - - - - - - - - - - - - - - - - - -
> [ ID] Interval           Transfer     Bitrate         Retr
> [  5]   0.00-10.00  sec   347 MBytes   291 Mbits/sec 1578             sender
> [  5]   0.00-10.00  sec   346 MBytes   291 Mbits/sec                  receiver
>
> Thanks,
> Steve

One other question: are you running powerd?  I booted without it, and my
throughput dropped to 600-640 Mb/s.  Repeating the test, retransmissions
went down but throughput was about the same.  Note, the RPi 4, and probably
the CM 4, boots at a lower clock frequency by default, and powerd raises it
under load.  I'm running powerd with -M 1800, overclocking a little.  IIRC
the standard clock is 1500 for the RPi 4.  But the throughput is about the
same using the standard clock with powerd.

		Mike

> On 12/22/2023 9:23 AM, Mike Karels wrote:
>> On 22 Dec 2023, at 6:20, Steve Bernacki wrote:
>>
>>> I recently purchased a RPI CM4 with 4GB and 32GB eMMC to replace my aging FreeBSD firewall. I managed to install FreeBSD 14.0-RELEASE-p3 on it, and both Ethernet devices (genet0 and ue0) were properly identified. However, network throughput on my gigabit network is pretty bad; iperf3 reports a maximum transfer speed of 291 Mbits/sec. Flashing OpenWRT on the same hardware using the same ethernet port, I'm able to achieve 923 Mbits/sec.
>>>
>>> Does anyone have any suggestions on how to improve throughput under FreeBSD?
>>>
>>> Thank you
>>> Steve
>> I just tested with an RPi4 (4 GB) and 14.0 using iperf3.  It looks like I'm getting
>> a rather variable number of retransmissions.  On my first run (client on RPi 4),
>> I got 460 Mb/s with a lot of retransmissions, but the next couple of runs, including
>> one receiving, I got about 940 Mb even with some retransmissions.  The peers were
>> fairly fast FreeBSD 13.2 and 15-current systems.  Are you seeing retransmissions?
>>
>> I'll try to look into this, but I'm not sure when I'll get to it.
>>
>> 		Mike
>>