From nobody Sun Oct 27 14:54:22 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xc0144m7Tz5b6hf for ; Sun, 27 Oct 2024 14:54:48 +0000 (UTC) (envelope-from void@f-m.fm) Received: from fout-b2-smtp.messagingengine.com (fout-b2-smtp.messagingengine.com [202.12.124.145]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xc0135wXNz4Fwc for ; Sun, 27 Oct 2024 14:54:47 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=ezBIC5r7; dkim=pass header.d=messagingengine.com header.s=fm3 header.b="E z4RAyX"; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 202.12.124.145 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from phl-compute-05.internal (phl-compute-05.phl.internal [10.202.2.45]) by mailfout.stl.internal (Postfix) with ESMTP id 3BE02114007D for ; Sun, 27 Oct 2024 10:54:46 -0400 (EDT) Received: from phl-imap-04 ([10.202.2.82]) by phl-compute-05.internal (MEProxy); Sun, 27 Oct 2024 10:54:46 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-transfer-encoding:content-type:content-type:date:date :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm3; t=1730040886; x=1730127286; bh=woPhh4vV9MsImy0X8DPfmued/LaUsnW5kcWnI/+gelM=; b= ezBIC5r7elIWL8yD0o4wKj5jIvY69GBxjfE5OxEXWV4J3KmBWzbcaEAaoD5+oCI/ o11jom/yW+sB4jZR90o3cfHJNQ992igVpAedACV54GkyzPc6/qGUptYuf0Kcxgwx cFC+bMFPN6fe7vG0IFZwqEGIfDBdTH+nEdxfinx67pEhnqMVbwJ6a6ddLdIvlkMb fEeqJ/pM2kgXg3eyC9ZOzT3/Ije8kAxFS4LT8fPAUK37mmO7aMM4dxF6N6jd86ab iiuBqHs188epxBLhSHO/v6pNft4LOeNpSdDWhgQ0DgdVuNJI1LQS1k3BdigeGsvR gYQlHx6d0QLp+HVbwMUlVg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t=1730040886; x= 1730127286; bh=woPhh4vV9MsImy0X8DPfmued/LaUsnW5kcWnI/+gelM=; b=E z4RAyXjNiXPEFlpuUgOK3xuoP1HeW8MLxnNSL8fcBwPtJ1RekYbdjA66hHETvvwW kyrXiV65+Oh+g1WkMlG5yrGdz2p8u0LXmtV2M1rmuvTcShQlvwyVOdxsQHuqGg8l CE3FUPfTkrUaGgESc4OMeDEvzZR6cGDLUABohGWbxKKMPxETv0oFNpLUNAEAF9B5 nwOoJ+oK+1kh8IuCMSePvJIfMzohl01cvjIdAe67kXwL6GnCMz0L/Tt0Y61ndQkU io8AAYTt2twGtBTmwjwS/1Ot3erJZHsDn823pio2nwc4h8taLRBDbDTUdlvEPFGz x6L5pLAHScUIw47R/8Cuw== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeeftddrvdejiedgjedtucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggvpdfu rfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpefoggffhf fvkfgjfhfutgfgsehtjeertdertddtnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdq mhdrfhhmqeenucggtffrrghtthgvrhhnpedvkefhgeekudfhlefhkeegvdfgieekledvve ethfelvedvfeffkeeftdeukeetvdenucffohhmrghinhepfhhrvggvsghsugdrohhrghen ucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehvohhiug esfhdqmhdrfhhmpdhnsggprhgtphhtthhopedupdhmohguvgepshhmthhpohhuthdprhgt phhtthhopehfrhgvvggsshguqdhnvghtsehfrhgvvggsshgurdhorhhg X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id CDCB32E60084; Sun, 27 Oct 2024 10:54:45 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 Date: Sun, 27 Oct 2024 14:54:22 +0000 From: void To: freebsd-net@freebsd.org Message-Id: <4a5dd205-6c8f-4964-b254-7092aa590602@app.fastmail.com> In-Reply-To: References: Subject: Re: Performance test for CUBIC in stable/14 Content-Type: text/plain Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-4.06 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.966]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; R_SPF_ALLOW(-0.20)[+ip4:202.12.124.128/27]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[202.12.124.145:from]; XM_UA_NO_VERSION(0.01)[]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; MIME_TRACE(0.00)[0:+]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+] X-Rspamd-Queue-Id: 4Xc0135wXNz4Fwc X-Spamd-Bar: ---- On Fri, 25 Oct 2024, at 13:13, Cheng Cui wrote: > Here is my example. I am using two 6-core/12-threads desktops for my > bhyve servers. > CPU: AMD Ryzen 5 5560U with Radeon Graphics (2295.75-MHz > K8-class CPU) > > You can find test results on VMs from my wiki: > https://wiki.freebsd.org/chengcui/testD46046 > > All the CPU utilization results are low, especially for these > throughput over 900 Mb/s. > > cc I have to tabulate my results better :D Those are some p impressive performance gains for your modified cc_cubic against % packet loss. This is a freebsd14-stable vm with your patches applied. iperf3 -B 192.168.1.13 -c 192.168.1.232 -l 1M -t 60 -i 1 -VC cubic Test Complete. Summary Results: [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-60.07 sec 5.92 GBytes 847 Mbits/sec 1 sender [ 5] 0.00-60.09 sec 5.92 GBytes 846 Mbits/sec receiver CPU Utilization: local/sender 90.6% (0.0%u/90.6%s), remote/receiver 23.8% (2.0%u/21.8%s) snd_tcp_congestion cubic rcv_tcp_congestion cubic here's the Alpine linux vm: vm7-alpine:~$ iperf3 -B 192.168.1.65 -c 192.168.1.232 -l 1M -t 60 -i 1 -VC cubic Test Complete. Summary Results: [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-60.02 sec 6.58 GBytes 941 Mbits/sec 24 sender [ 5] 0.00-60.03 sec 6.58 GBytes 941 Mbits/sec receiver CPU Utilization: local/sender 8.2% (0.1%u/8.2%s), remote/receiver 26.7% (2.1%u/24.5%s) snd_tcp_congestion cubic rcv_tcp_congestion cubic Load on the bhyve host was between 3.00 & 4.00 during the tests. It was running a poudriere build (PARALLEL_JOBS=1) Why the massive difference in load on the vms? I'm trying to look at something that's maybe related, but not in a congested environment context. I think it's deeper than that. I need to try 'options RSS' in the freebsd guests as well, (see https://lists.freebsd.org/archives/freebsd-net/2024-September/005531.html ) --