Re: RFC: NFS trunking (multiple TCP connections for a mount

From: Lutz Donnerhacke <lutz_at_donnerhacke.de>
Date: Tue, 29 Jun 2021 06:28:41 UTC
On Tue, Jun 29, 2021 at 12:23:21AM +0000, Rick Macklem wrote:
> I don't understand how multiple TCP connections to the same
> server IP address will distribute the load across multiple network
> interfaces?

Sounds like a bandwith-latency-product issue. TCP is prone to stalling at
the end of a buffer window (in addition to reassembly and RPC waits).
Multiple TCP streams scale linear with the available bandwidth over them.
Single RPC messages should not split over multiple streams (causes reorder
of segments), but different messages can go in round robin fashion. There is
no need to ensure a symmetric path, so that the response comes back on the
same stream.