From nobody Sun Mar 17 09:18:16 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TyC8J4SqFz4qR07; Sun, 17 Mar 2024 09:18:24 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TyC8J0ycxz4B1B; Sun, 17 Mar 2024 09:18:24 +0000 (UTC) (envelope-from tuexen@freebsd.org) Authentication-Results: mx1.freebsd.org; none Received: from smtpclient.apple (unknown [IPv6:2a02:8109:1140:c3d:6562:c3d3:df66:1b2d]) (Authenticated sender: micmac) by drew.franken.de (Postfix) with ESMTPSA id 56448721E2806; Sun, 17 Mar 2024 10:18:19 +0100 (CET) Content-Type: text/plain; charset=us-ascii List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.500.171.1.1\)) Subject: Re: Request for Testing: TCP RACK From: tuexen@freebsd.org In-Reply-To: Date: Sun, 17 Mar 2024 10:18:16 +0100 Cc: garyj@gmx.de, current@freebsd.org, net@freebsd.org, Randall Stewart , gallatin@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <42C327BD-6CE4-43AA-A1AE-3BEC08D623DB@freebsd.org> <486915F0-456B-4B09-A8BC-93BBA79C4CA1@freebsd.org> <20240313080624.6c73908c@ernst.home> <508E3B47-8E1B-469F-97B1-2171A3098888@freebsd.org> <86a5n1i0xg.fsf@ltc.des.dev> <78D1FF09-71A3-4486-B934-D8332F54B237@freebsd.org> <20240316104053.20bef8c2@ernst.home> <20240316115128.33d11f7b@ernst.home> <7367F29A-D52B-4828-B79A-AA2667E81E7D@freebsd.org> <4FF534F6-B35D-4596-8D1E-226AD1347AC8@freebsd.org> To: Nuno Teixeira X-Mailer: Apple Mail (2.3774.500.171.1.1) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, T_SCC_BODY_TEXT_LINE autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:680, ipnet:2001:638::/32, country:DE] X-Rspamd-Queue-Id: 4TyC8J0ycxz4B1B > On 16. Mar 2024, at 21:29, Nuno Teixeira wrote: >=20 >> Just to double check: you only load the tcp_rack. You don't run >> sysctl net.inet.tcp.functions_default=3Drack >=20 > I'm not using sysctl, just loading module. And you also don't have net.inet.tcp.functions_default=3Drack in /etc/sysctl.conf This means that no TCP connection will actually use the RACK stack. >=20 >> What does "poudriere testport net/gitup" do? Only build stuff or does = is >> also download something? >>=20 >> What does bonnie++ do? >=20 > poudriere is for testing ports and it uses jails to build stuff. > It have restrict access to net to fetch distfiles (not the case as > distfile is present on disk) >=20 > bonnie++ is a disk benchmark Thanks for clarifying. >=20 >> Could you reboot the system, run the test, do kldload tcphpts, run >> the test again, do kldload tcp_rack, and run it again. >=20 > The previous test [2] was obtained by loading tcp_rack >=20 > Now I will post results for test [3] by loading (only) tcphpts module. Great. This makes sure that the degradation is related to TCPHPTS and not the RACK stack. >=20 > [3] kldload tcphpts: >=20 > =3D=3D> poudriere testport net/gitup: > 55.26s real 5.23s user 1m19.91s sys So this test goes up from 11 seconds to 55 seconds... >=20 > =3D=3D> bonnie++ > Version 1.98 ------Sequential Output------ --Sequential Input- = --Random- > -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- = --Seeks-- > Name:Size etc /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP = /sec %CP > leg.home 32G 12k 99 73.0m 99 51.1m 99 27k 99 128m 99 = 8038 2194 > Latency 1763ms 194ms 23979us 431ms 1267us = 2776us > Version 1.98 ------Sequential Create------ --------Random = Create-------- > leg.home -Create-- --Read--- -Delete-- -Create-- --Read--- = -Delete-- > files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP = /sec %CP > 16 7017.934752 98 21243.823180 100 7780.918458 99 > 9281.477778 98 21368.647657 100 7457.828733 99 > Latency 3015us 220us 2398us 1106us 386us = 2473us >=20 > Summary: >=20 > - I can't remember better tests to do as I can feel the entire OS is > being slow, without errors, just slow. This is interesting. It seems a consequence on loading TCPHPTS, not = actually using it. I have CCed Drew and Randall, who know much more about HPTS and might = have follow up questions. I'll bring the issue up in the FreeBSD transport = call next Thursday. What hardware are you using? Best regards Michael > - Approx. results as test [2] >=20 >=20 >=20 >=20 > Nuno Teixeira > FreeBSD Committer (ports)