From nobody Wed Aug 30 08:22:36 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RbHNW0zq9z4rsNm for ; Wed, 30 Aug 2023 08:22:51 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-21.consmr.mail.gq1.yahoo.com (sonic301-21.consmr.mail.gq1.yahoo.com [98.137.64.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RbHNV3R5dz3Hwy for ; Wed, 30 Aug 2023 08:22:50 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b="Jc1UY/AX"; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.147 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693383769; bh=6LMK4eUS+A2WGKdWjW8NJrj3gjabpFeKme8yCYAxOU4=; h=From:Subject:Date:References:To:In-Reply-To:From:Subject:Reply-To; b=Jc1UY/AXN5ZrI5Dxw7JNdXDkQUouLZ8AYDybD13zUh0zajIC5WoCa3q5lUUaPTtqpcHJfAJvYeNSMKIrunH+chkcurqfhpI4AepTSxqnQ4+4preIQAzcg8j9dbYKkOShtuE/LrP3evQGcYiDBgNEmN0MgzQFjYMmsrl1/KWElzv1u22Frj0M1F0MghJE+R3AdrzhowhZp6Nd/wWOw/2nas6bkUzP0SdCVGh71CpbcYDoTytmXVmnoZrw10QYMoDdpn7EUCluGViccZ85mHZQeJ6eHDoBKglXt5G7ZZpfw7QXpBhWIF2AOZu2TmhyIEjHxcHYkKwXw4RB6h1wtB4Z3Q== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693383769; bh=7+H2apl/s7WMBGGG5bZX5m0VpQYosQkH2D/f+UuHeIV=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=nAFjCpIPMntmxdEDtq43sKorShQAimLo99X4rgoOrIe23h1mp61Demp1Kd3HFXh8X5HlQ2Il/lv7HJYv8iiZnVLcNQKWo2shdoNb5WYnESkUIM13WHjD8TIsGWiVxhfjBBe8imse73mL768SpgLYI9k6amwHelVoNvKxbUwTL8vy2HlL3w09XyIarCpRDMhKLskP1LRulfjH63SULXcXi53w8RYkOCTJbOKLDCBnCPTguuYG2VGvdFFp5WJGxjdGMLIdupiEFGT2Z4Snh/i5xoQHZ048kZ9MwAXOh8YVoYz8Cp4aGNvHav6niGMm3rDwgXCF0TvCbOoaYUkpTBrqbQ== X-YMail-OSG: AGItMBwVM1lw34wVd5a7GJ5mtZoczCZ_6BuFgiBTvy0PyN.2DT0kOaYdmS5QqqO yc9OJRH2AYQ6SGkg6KqKXPZL4bsFTVXzw.nZf8U5qaEJswHT4J5GpniWuzOoOnAR07zdRHOE5EFE GyCKkTUkX8mkzrX0hw4iLkMfx88AMl0EczHLj_scb03oxVDdT1RRiLFx16ooLfY8Fn_UmDDtuMaD TKYogXbhhssPcNDpRs1ivvmzE2rMG7C0NXcGjNXYPlTvgCdxLcpxsSVkdkyTs.7XcsSg1d3kJLqx jz_8F7ThF1DY6WxgCtYwQbFIOWec.7RoojgmVin0aoNvzSAthZefR7VybIg4R85coy3MzwW.Ov8j NXNigsBoym4TeKz1Are.ZcHYkNxE213RcNZbqk0xCL.Xc9q3iWWK.cQVvtHYPQ1enO1RZG9vpFqh aaNJP.FL_nI8SV9zSNJJ2Gfr7I3I8eeo21WJnSCP6oCtxCG.LsENe20tXL93aYaAgBPFyxhJfjXY z5N2QwOck8ZDnnaAzyKGHZyIm95ov5SAPg7memPguxGTjFD1mn9LFbQKvnbYVwQMafa2mPry2VvZ lpuneFnmQRbQbrwpmdZEyDxYgmJQrr_ANW3oCYt1LrNcYThAlWpFL1ucmM9suyoP3xxvPQxax82N 57uTq1jxmENU2IrX4BUkMm3gVugJwrT1iImEpgBND1HK_sheahTAYAXPzn6hh1h5RqOvSHeSmxpR 0Je4tME8QyOPm05aEqYKHPlRVexRNGeF.15gxti3_Rh.Oq7QAyc1f.z22Vk2i8PK34MOMP37dLY. _a.Ihz3orDjlYq8BYI.vvtOV1P3ogDNR1uk22hrYD2n85HSci5p7ICEFxH_c3q85i334LRWvgP8u VX6Lr4A4Rss8nDTn9c8D9qHVeO0MuOjPJq.823Wp5_VHljUvaoA40wRfLogjq.3LL52tjO53wd5m V9zMAA5rKyIMGrNYzFy6q59TuWd.zzHlQejGndhDTAfzlmRmAdI9bH9KcoeCd1958aAB_Ag2ZBso Tyky3fbEKzH2Z3C7kctn.tcWknnSPAqt89ujdktoVvX7rClFNbbh6cUZ7yTN34U_kkt2cdO_iDW3 .17iyERzg53IqVEsQdfO2Dz3ixuw3h97cpSfU3BkG8mPBY84UdH9mPfTP0wJg12e07zcP0TgpK9E 0_2Pb2zoHcMdJEy3Fjsrphvk5UU0aA9Df5rtUZuYo29q8zAqBE9RjZnoppAuqvM2YINXyo.8D_qh BcV0JX69BMl8dBy4AgiFqxccZzork5Ns3akO2XHl9N4CcYUCdcxAV891NoOaBkLFkLqPS1LcDINr KoQb3HQYVjuqtS1y8S4oXUW7ScWlINlQXr.9FX_FwBzwKfUWA5W2YFwxv31gO.iEhL9eFBq9Uz7S oCyENQHawNsfBeiLGACUK4.Q9g7h7cfL_9qD13tCnFxduURm1YojRwiy3vV1SVr5qvPFX79ZKaJo dx7kxHhSWKR5z_R7gQ_O8hS2HOzJDgyg6Rrpudz.VA02nt4d5SP9MtuG.VPAzocWBmTLuqpifeHx 0OV2JsDwTQpcVL6X07dGFUdhQH7bBh8p8nCizC8a7.3x0W5Ksy9pUTwkjC79crA4LP9Hk6RVjS7u wDCo.Wc5BeiKfHzv0kt1bvCQ7LeTMqj2HuYGjWX.RIdCt.KiHJJ8vrtLwNv68E.quuRQU3Rgscw5 nuyQZUgfrloDblQI3JT3EtYlEs2hOZS04nKbJ7SZsm6XLZDYghj1.YjcuLYZLTTsRQAqdwdCB63d .w8axkhlfOXe_PQhFStUXpKHiUDy1LS6PJTUt7b.eUQ07Bb_g.KMOJ.n4nUyhXA2XC91UJfxFmg6 aGA89JmlMTVrGZNTKuRumAkKWSJ6aFgOFPNRbczUVZWC9Nh68TcAPCrj8mwmlB6WuJPtCBkhiVWZ _G9D7nzBBIjjm5a1llg2KUWWs8y6rLhM1kpiPPf2._mH4YCaDfaNJRDevSa7pEx41ltBTd4YqmhS jsVzHxKddEwhz9qZnxUAIWq8VLRX9GkY7whA6UC_K8IQlhIqWRM8RjiOdXzLE4eVDhJ6e35fJwSC do6oj92X2KD2tjPQVEPKEvfwM7LBXmNhDEe45fce_kU1nDtyVlU8002tjDrxCbd6kBj00Od6f.ML rJNRTJuP0wiI7GbhVGBe1OlCv27ZZyNrlVIaUKsJhpF5a2ELxMApnakCAWoKWoeHWn9Tp3Je4W4s cASTcEOBu3aIDQe2.9qrGlc7fn6824BVPvgt69RRpy7XUaaIDjJsJHpS2Encv9EEKGsSZy.W0Kuk - X-Sonic-MF: X-Sonic-ID: c61a24ed-ac8c-487d-80af-5ff67c0eb7c5 Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.gq1.yahoo.com with HTTP; Wed, 30 Aug 2023 08:22:49 +0000 Received: by hermes--production-ne1-7b767b77cc-84nnk (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID d8aa92076a43b9c0b151057159f4f232; Wed, 30 Aug 2023 08:22:47 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Very slow scp performance comparing to Linux Date: Wed, 30 Aug 2023 01:22:36 -0700 References: <87B95CDA-1812-44B8-9356-46631DEA9428@yahoo.com> To: weh@microsoft.com, FreeBSD Hackers In-Reply-To: Message-Id: X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.49 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.993]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.147:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.147:from]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RbHNV3R5dz3Hwy On Aug 30, 2023, at 01:17, Mark Millard wrote: > On Aug 29, 2023, at 12:52, Mark Millard wrote: >=20 >> Wei Hu wrote on >> Date: Tue, 29 Aug 2023 12:55:35 UTC : >>=20 >>> Thanks for the update. Seems the numbers are the same on zfs and = ufs. That's=20 >>> good to know.=20 >>>=20 >>> Yes, your numbers on ARM64 are better than mine on Intel. However, = my original >>> intention was to find out why scp on Linux is performing much better = than FreeBSD >>> under the same hardware env.=20 >>>=20 >>> Is it possible to try Linux in your ARM64 setting? I am using Ubuntu = 22.04 on ext4=20 >>> file system. >>=20 >>=20 >> I tried to use the Hyper-V Quick Create on the Windows Dev Kit 2023 >> to install a Ubuntu 22.04 . (No clue if ext4 would result.) But the >> Hyper-V UEFI reports for the disk created: >>=20 >> 1. SCSI Disk 0,0 >> The boot loader did not load an operating system. >>=20 >> (It then reports the network adapter attempt found no >> boot image, but that is expected.) >>=20 >> That leaves me wondering if Hyper-V Quick Create >> established a VM file holding Intel/AMD material >> despite the aarch64 context. >>=20 >> Establishing a Ubuntu more directly is not familiar and >> will have to be a background activity and, so, likely >> will not be timely. If I did any experiments outside >> Hyper-V (native booting), they would be with slower >> USB3 SSD media than I use for FreeBSD. >>=20 >> I did notice that Hyper-V Quick Create did not create >> a fixed sized disk but a dynamic sized one. That is >> different than what I did for FreeBSD. >>=20 >> Also, it was not obvious if you were after aarch64 >> Hyper-V testing vs. native-boot testing vs. both. So >> I may have gone the wrong direction from the start. >> It is possible that I'd find establishing a native-boot >> easier and then be able to have a VM file created from >> the media, more like what I did with FreeBSD. >>=20 >> The Ubuntu activity likely would not be analogous to >> the FreeBSD builds having -mcpu=3D optimization used. >>=20 >> Back to $work. >>=20 >=20 > I found a sequence of UI operations that worked for > installing Ubuntu server 22.04.3 into Hyper-V in > Windows 11 Pro on the Windows Dev Kit 2023 via > use of a downloaded *.iso . >=20 > The kernel that results predates 6.0: >=20 > $ uname -ap > Linux ubwdk23s 5.15.0-82-generic #91-Ubuntu SMP Mon Aug 14 14:19:18 = UTC 2023 aarch64 aarch64 aarch64 GNU/Linux >=20 > Using my usual rule of rebooting before the first scp: >=20 > $ scp = FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = markmi@localhost:FreeBSD-14-TEST.img > . . . > = FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = = 100% 5120MB 431.3MB/s 00:11=20 >=20 > $ rm FreeBSD-14-TEST.img > $ scp = FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = markmi@localhost:FreeBSD-14-TEST.img > . . . > = FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = = 100% 5120MB 482.2MB/s 00:10 >=20 > Definitely faster than the FreeBSD results that I reported > earlier, including faster than the ThreadRipper 1950X with > Optane in a PCIe slot (more like 300 MiBytes/sec). >=20 > I again used 6 cores, 24576 MiBytes of RAM, a fixed sized virtual hard > disk under Hyper-V. >=20 > For reference: >=20 > $ lsblk -f > NAME FSTYPE FSVER LABEL UUID = FSAVAIL FSUSE% MOUNTPOINTS > loop0 squashfs 4.0 = 0 100% /snap/core20/1977 > loop1 squashfs 4.0 = 0 100% /snap/lxd/24326 > loop2 squashfs 4.0 = 0 100% /snap/snapd/19459 > sda = =E2=94=9C=E2=94=80sda1 vfat FAT32 F7E9-1344 = 1G 1% /boot/efi > =E2=94=94=E2=94=80sda2 ext4 1.0 = 48a0dbe6-5a99-4b6e-92dc-fe6d8efc6ffe 99.3G 14% / >=20 >=20 >=20 > An experiment would be to have a small amount if RAM relative > the file size. That would force it to actually write to media > for some part of the file copy. The wording was poor: "force it" here is just from the Ubuntu viewpoint. I make no claim to know if Hyper-V is actually writing the material out to media at the time vs. later. > So using 1024 MiByte of RAM assigned in Hyper-V: >=20 > $ scp = FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = markmi@localhost:FreeBSD-14-TEST.img > . . . > = FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = = 100% 5120MB 407.5MB/s 00:12 >=20 > $ rm FreeBSD-14-TEST.img > $ scp = FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = markmi@localhost:FreeBSD-14-TEST.img > . . . > = FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = = 100% 5120MB 404.7MB/s 00:12 >=20 > Still definitely faster than the FreeBSD results that I > reported earlier, including faster than the ThreadRipper > 1950X with Optane in a PCIe slot (more like 300 MiBytes/sec). =3D=3D=3D Mark Millard marklmi at yahoo.com