TSO and FreeBSD vs Linux

David Wolfskill david at catwhisker.org
Thu Sep 5 19:20:12 UTC 2013


On Wed, Sep 04, 2013 at 03:52:19PM -0700, Adrian Chadd wrote:
> .. can you use -z to clear the stats out just before you do a test?
> 
> 
> -adrian
> 
> 
> On 4 September 2013 15:35, David Wolfskill <david at catwhisker.org> wrote:
> 
> > On Wed, Sep 04, 2013 at 03:25:59PM -0700, Adrian Chadd wrote:
> > > What's netstat -sp tcp show before/after the test?
> > > ...
> ...

Attached; test was to demonstrate issue w/TSO.

Peace,
david
-- 
David H. Wolfskill				david at catwhisker.org
Taliban: Evil cowards with guns afraid of truth from a 14-year old girl.

See http://www.catwhisker.org/~david/publickey.gpg for my public key.
-------------- next part --------------
Script started on Wed Sep  4 16:03:56 2013
dwolf-fbsd(9.2-P)[15] sudo sysctl net.inet.tcp.tso=1

Password:
net.inet.tcp.tso: 0 -> 1
dwolf-fbsd(9.2-P)[16] sudo netstat -zsp tcp

tcp:
	2574837448 packets sent
		4990261 data packets (2921163576 bytes)
		2566108476 data packets (7552375270794 bytes) retransmitted
		13131 data packets unnecessarily retransmitted
		2565866462 resends initiated by MTU discovery
		3724751 ack-only packets (272449 delayed)
		0 URG only packets
		0 window probe packets
		2596 window update packets
		3615 control packets
	11197243 packets received
		4033650 acks (for 3053804276 bytes)
		33051 duplicate acks
		0 acks for unsent data
		9289364 packets (9789388088 bytes) received in-sequence
		617 completely duplicate packets (160537 bytes)
		2 old duplicate packets
		104 packets with some dup. data (4084 bytes duped)
		1633 out-of-order packets (2277306 bytes)
		833 packets (833 bytes) of data after window
		833 window probes
		27123 window update packets
		10 packets received after close
		0 discarded for bad checksums
		0 discarded for bad header offset fields
		0 discarded because packet too short
		0 discarded due to memory problems
	1809 connection requests
	319 connection accepts
	0 bad connection attempts
	0 listen queue overflows
	6 ignored RSTs in the windows
	1965 connections established (including accepts)
	2454 connections closed (including 90 drops)
		1483 connections updated cached RTT on close
		1485 connections updated cached RTT variance on close
		902 connections updated cached ssthresh on close
	36 embryonic connections dropped
	4033649 segments updated rtt (of 3015788 attempts)
	129116 retransmit timeouts
		2 connections dropped by rexmit timeout
	0 persist timeouts
		0 connections dropped by persist timeout
	0 Connections (fin_wait_2) dropped because of timeout
	167 keepalive timeouts
		157 keepalive probes sent
		10 connections dropped by keepalive
	560619 correct ACK header predictions
	7078166 correct data packet header predictions
	319 syncache entries added
		0 retransmitted
		0 dupsyn
		0 dropped
		319 completed
		0 bucket overflow
		0 cache overflow
		0 reset
		0 stale
		0 aborted
		0 badack
		0 unreach
		0 zone failures
	319 cookies sent
	0 cookies received
	200 hostcache entries added
		0 bucket overflow
	2132 SACK recovery episodes
	4792 segment rexmits in SACK recovery episodes
	6693920 byte rexmits in SACK recovery episodes
	60818 SACK options (SACK blocks) received
	1532 SACK options (SACK blocks) sent
	0 SACK scoreboard overflow
	0 packets with ECN CE bit set
	0 packets with ECN ECT(0) bit set
	0 packets with ECN ECT(1) bit set
	0 successful ECN handshakes
	0 times ECN reduced the congestion window
dwolf-fbsd(9.2-P)[17] ls -lT ~/Mail/sisyphus

-rw-------  1 dwolf  929  117842814 Sep  4 15:36:32 2013 /homes/dwolf/Mail/sisyphus
dwolf-fbsd(9.2-P)[18] cp ~/Mail/sisyphus ~/tmp

^C

dwolf-fbsd(9.2-P)[19] ls -lT !$/sisyphus

ls -lT ~/tmp/sisyphus
-rw-------  1 dwolf  929  2097152 Sep  4 16:06:14 2013 /homes/dwolf/tmp/sisyphus
dwolf-fbsd(9.2-P)[20] netstat -sp tcp

tcp:
	11721951 packets sent
		1648 data packets (2153234 bytes)
		11719344 data packets (40242113308 bytes) retransmitted
		336 data packets unnecessarily retransmitted
		11718480 resends initiated by MTU discovery
		869 ack-only packets (55 delayed)
		0 URG only packets
		0 window probe packets
		0 window update packets
		90 control packets
	4143 packets received
		1380 acks (for 2224279 bytes)
		564 duplicate acks
		0 acks for unsent data
		2085 packets (2193927 bytes) received in-sequence
		2 completely duplicate packets (328 bytes)
		0 old duplicate packets
		0 packets with some dup. data (0 bytes duped)
		0 out-of-order packets (0 bytes)
		0 packets (0 bytes) of data after window
		0 window probes
		227 window update packets
		1 packet received after close
		0 discarded for bad checksums
		0 discarded for bad header offset fields
		0 discarded because packet too short
		0 discarded due to memory problems
	89 connection requests
	0 connection accepts
	0 bad connection attempts
	0 listen queue overflows
	0 ignored RSTs in the windows
	2 connections established (including accepts)
	90 connections closed (including 0 drops)
		2 connections updated cached RTT on close
		2 connections updated cached RTT variance on close
		1 connection updated cached ssthresh on close
	0 embryonic connections dropped
	1380 segments updated rtt (of 1284 attempts)
	452 retransmit timeouts
		0 connections dropped by rexmit timeout
	0 persist timeouts
		0 connections dropped by persist timeout
	0 Connections (fin_wait_2) dropped because of timeout
	0 keepalive timeouts
		0 keepalive probes sent
		0 connections dropped by keepalive
	350 correct ACK header predictions
	1847 correct data packet header predictions
	0 syncache entries added
		0 retransmitted
		0 dupsyn
		0 dropped
		0 completed
		0 bucket overflow
		0 cache overflow
		0 reset
		0 stale
		0 aborted
		0 badack
		0 unreach
		0 zone failures
	0 cookies sent
	0 cookies received
	0 hostcache entries added
		0 bucket overflow
	164 SACK recovery episodes
	323 segment rexmits in SACK recovery episodes
	463828 byte rexmits in SACK recovery episodes
	824 SACK options (SACK blocks) received
	0 SACK options (SACK blocks) sent
	0 SACK scoreboard overflow
	0 packets with ECN CE bit set
	0 packets with ECN ECT(0) bit set
	0 packets with ECN ECT(1) bit set
	0 successful ECN handshakes
	0 times ECN reduced the congestion window
dwolf-fbsd(9.2-P)[21] sudo sysctl net.inet.tcp.tso=0

net.inet.tcp.tso: 1 -> 0
dwolf-fbsd(9.2-P)[22] sudo netstat -zsp tcp

tcp:
	11722179 packets sent
		1826 data packets (2173970 bytes)
		11719344 data packets (40242113308 bytes) retransmitted
		336 data packets unnecessarily retransmitted
		11718480 resends initiated by MTU discovery
		918 ack-only packets (65 delayed)
		0 URG only packets
		0 window probe packets
		0 window update packets
		91 control packets
	4375 packets received
		1500 acks (for 2245016 bytes)
		565 duplicate acks
		0 acks for unsent data
		2219 packets (2208633 bytes) received in-sequence
		2 completely duplicate packets (328 bytes)
		0 old duplicate packets
		0 packets with some dup. data (0 bytes duped)
		0 out-of-order packets (0 bytes)
		0 packets (0 bytes) of data after window
		0 window probes
		227 window update packets
		1 packet received after close
		0 discarded for bad checksums
		0 discarded for bad header offset fields
		0 discarded because packet too short
		0 discarded due to memory problems
	89 connection requests
	0 connection accepts
	0 bad connection attempts
	0 listen queue overflows
	0 ignored RSTs in the windows
	2 connections established (including accepts)
	90 connections closed (including 0 drops)
		3 connections updated cached RTT on close
		3 connections updated cached RTT variance on close
		1 connection updated cached ssthresh on close
	0 embryonic connections dropped
	1500 segments updated rtt (of 1397 attempts)
	452 retransmit timeouts
		0 connections dropped by rexmit timeout
	0 persist timeouts
		0 connections dropped by persist timeout
	0 Connections (fin_wait_2) dropped because of timeout
	0 keepalive timeouts
		0 keepalive probes sent
		0 connections dropped by keepalive
	412 correct ACK header predictions
	1945 correct data packet header predictions
	0 syncache entries added
		0 retransmitted
		0 dupsyn
		0 dropped
		0 completed
		0 bucket overflow
		0 cache overflow
		0 reset
		0 stale
		0 aborted
		0 badack
		0 unreach
		0 zone failures
	0 cookies sent
	0 cookies received
	0 hostcache entries added
		0 bucket overflow
	164 SACK recovery episodes
	323 segment rexmits in SACK recovery episodes
	463828 byte rexmits in SACK recovery episodes
	824 SACK options (SACK blocks) received
	0 SACK options (SACK blocks) sent
	0 SACK scoreboard overflow
	0 packets with ECN CE bit set
	0 packets with ECN ECT(0) bit set
	0 packets with ECN ECT(1) bit set
	0 successful ECN handshakes
	0 times ECN reduced the congestion window
dwolf-fbsd(9.2-P)[23] cp ~/Mail/sisyphus ~/tmp

dwolf-fbsd(9.2-P)[24] echo $?

0
dwolf-fbsd(9.2-P)[25] netstat -sp tcp

tcp:
	129165 packets sent
		87533 data packets (120483061 bytes)
		388 data packets (531932 bytes) retransmitted
		1 data packet unnecessarily retransmitted
		0 resends initiated by MTU discovery
		41244 ack-only packets (74 delayed)
		0 URG only packets
		0 window probe packets
		0 window update packets
		0 control packets
	137628 packets received
		47037 acks (for 120483061 bytes)
		2432 duplicate acks
		0 acks for unsent data
		96306 packets (119505191 bytes) received in-sequence
		8 completely duplicate packets (8816 bytes)
		0 old duplicate packets
		0 packets with some dup. data (0 bytes duped)
		834 out-of-order packets (1175280 bytes)
		0 packets (0 bytes) of data after window
		0 window probes
		413 window update packets
		0 packets received after close
		0 discarded for bad checksums
		0 discarded for bad header offset fields
		0 discarded because packet too short
		0 discarded due to memory problems
	0 connection requests
	0 connection accepts
	0 bad connection attempts
	0 listen queue overflows
	0 ignored RSTs in the windows
	0 connections established (including accepts)
	1 connection closed (including 0 drops)
		0 connections updated cached RTT on close
		0 connections updated cached RTT variance on close
		0 connections updated cached ssthresh on close
	0 embryonic connections dropped
	47037 segments updated rtt (of 45341 attempts)
	4 retransmit timeouts
		0 connections dropped by rexmit timeout
	0 persist timeouts
		0 connections dropped by persist timeout
	0 Connections (fin_wait_2) dropped because of timeout
	0 keepalive timeouts
		0 keepalive probes sent
		0 connections dropped by keepalive
	37227 correct ACK header predictions
	86833 correct data packet header predictions
	0 syncache entries added
		0 retransmitted
		0 dupsyn
		0 dropped
		0 completed
		0 bucket overflow
		0 cache overflow
		0 reset
		0 stale
		0 aborted
		0 badack
		0 unreach
		0 zone failures
	0 cookies sent
	0 cookies received
	0 hostcache entries added
		0 bucket overflow
	77 SACK recovery episodes
	384 segment rexmits in SACK recovery episodes
	526188 byte rexmits in SACK recovery episodes
	3190 SACK options (SACK blocks) received
	791 SACK options (SACK blocks) sent
	0 SACK scoreboard overflow
	0 packets with ECN CE bit set
	0 packets with ECN ECT(0) bit set
	0 packets with ECN ECT(1) bit set
	0 successful ECN handshakes
	0 times ECN reduced the congestion window
dwolf-fbsd(9.2-P)[26] ls -lT ~/tmp/sisyphus

-rw-------  1 dwolf  929  117842814 Sep  4 16:07:30 2013 /homes/dwolf/tmp/sisyphus
dwolf-fbsd(9.2-P)[27] rm !$

rm ~/tmp/sisyphus
dwolf-fbsd(9.2-P)[28] ^Dexit

Script done on Wed Sep  4 16:08:58 2013
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 196 bytes
Desc: not available
URL: <http://lists.freebsd.org/pipermail/freebsd-net/attachments/20130905/b4002533/attachment.sig>


More information about the freebsd-net mailing list