From nobody Thu Dec 21 21:03:41 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Sx2wc54MQz54Gp4 for ; Thu, 21 Dec 2023 21:04:00 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-55.consmr.mail.gq1.yahoo.com (sonic316-55.consmr.mail.gq1.yahoo.com [98.137.69.31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Sx2wZ6Fb3z4MPL for ; Thu, 21 Dec 2023 21:03:58 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=G6cpx04r; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.31 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1703192635; bh=3R0zBayWi3betHKi4g8lAtcnxgIFAkre4oAfFUF7gM4=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=G6cpx04rZvRm8CdtgED/ihzTzBe0q5XE6xV1JtEokpDsgS3AyS6EIY28kg7TqcbrF8qIhDaP6dYPKsRn2Jo7Q+2TlaJKrEYnKkFYuKbeFKwMIs58q4Sxn9Q6AKhCyF3+w5G+litLP8FbtUhUOP62OiQCk2750Ba9oJTZ3osNBN9ho1Fmmdv9eW8Ra3B8VUzRmNN0rubkzZpMsOPmxwnWRP0iOOJfhrKv9tGyyFdJ22PS5U1BOwYK6b8RTGzYDRy9OJDUWXVrctYYTQFOVIxItfg5dQWCCEzN4Zrm1WLoOL2cX6sK5Z0NPX99ipjkR8O0jKK4pTMAzdRCSgm9NJW/kQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1703192635; bh=LG56rLqrRjffnqELTb5b2Pz0O0CakDw92zERMdp5b+w=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=nubIsXRE73oxykbPccAsRSvivSnSJTmLsywAxPFR5jHOavB1ef/80WC9aEJJrci9XwdjrHCAUysA0jjUkDbvqw0n7m2SGzsft+JDcUHNsN0EuOTol1EYPCqqMbsiF7AVCH2WnRGMRpp0QaWbyBgXXsvvl79QzIyZIDa2wfLTjzy94cwaFvB994CtWapmy7hvCTBoDo9eUi3kxsFuNTCuL9oI8PtGQJ+scxkIVZU5ET0WGVqWiIF6X3HV+OfO0ESuu6iKkwdb8UTeuvqMXHc9AJP8H+b18bulIpyI+cuzwqWGjT4BWnHoKtY3hSC+j91Q+o6aYHGhx2QWwP6nY8HDnw== X-YMail-OSG: gkY4gjQVM1lwm4DsufZQgTHAT3ri2g4vGVtWzF_deESZOFH1vb0FobZXPkuYihE qR0yX5tfuhppvdNm0zejaeaoOxRmWAH1SI85s31cIa24RnPuoMWkSOr_1X2wSXwGBaEgpFGgUFgp Fs17zL6qS1NFVVV9zpk8IcVyyIx3aZkKBXguQFSVBJGaZoYCApnqZMbj_d9t4J9CUzlPr6OuIhmq DzxfJHayDeh5n6oDiAk7EgUyUo12J1DGdE5dcQBZXVu1lK__ANwNATRsNkXOmTJOEa3rCskj2pl. VYPEMEgAd7oZ5Toz3nJw2_5.x0DHNGrcaArTQrU1disPkoI6QhKzz2yldHdDvs3.1LMaHNrPEuB1 Bp0gywKKrsvrD8hxIvjtfYGJH5NWPxmrFtNE1kuHAxvf_74gjF4T_bnvFPcKvi2ZdmH51E9kCQnF iTIzfA7AmiSXpwuhYfIowc6ffEn2WkdMGJSNb46_EWrHgHqw8getm619aazIPAOvp3NlMvacEtcJ 8rfm1P7Kip07pXZMt7qKwxiD48lZO1ZV77ASqrCupk1KNCN_HnOK7MP8JusxzCPyYAMWjcruOQez isRfDittkHC8u5TB_3njc2jlOF.mWrD7Dd0X5TbpJzK6Qahmj05IgHitf9SQaU.46eW0fGHhsvz0 J0viNqgb1KKU3pF5hZ_DcqK1PVm_YBA0aqSEPBfZoGoFXcUchXEs9Ij4YugjoRftggGCtvsGc4Zz 8XiIdXL6clZGEz5e3Y5DH0Tg9Jak1DgO6t6UCH1K3cAAoOpggBZovgrACm_JVbfKXKCL5w08jxP9 ybHfu1ZDmRxr1oGZLuYMb3G57Xe2oYwMOekUUOMKVbxMorNcVajj0TgMvXLGNFyMnBKH3e3c5iez H6CUsZV1nJhpc.rOWNIZARvNnW8kNjJjx84iskDCfZARZ0GyAxmowVqTSe5Z.4gHyjXifJm_uhJO 8ga1ZgNGdTDA6kmGid.UDIoymeMhrMBxa_m3vdP_FfE2oidrPL9TSXz5WZwOMX.Li_OFHMRYw6QJ 3YZFpTlKnpektWyD.GBoPF.wzbblVIScrtnOQb8n8ao0xGe_hMLw1KIdIBanPgNHzwHu2l_BHYIx 8aLgYPJJ.Em93Gn.a5M5mMPqukkztNHwmTH5S2stiMYf18q_HrH3CteQ4QVIVmt5TT.4bZs10veL q_taIEmaijPUjCqV.pN_GnU9zpw2tHBYzoAzxETus6diMUivpQsVvJikz2imktPWfxEFbCYsptva bXQ7IT7CHO9kP5ybmL8X6hTl_.tRHwTJQqKengH6zRfowCb5bbE2M7oZhP0XenwHiGXGyOTAMPOw .rh1We8cMx8Dp4bAe19kfXcP0nKEoFViaguJgv15QWOed4L_1.wA1hd2AKidUGeiOnuWKqDLMJqA 75snrFPAWKBDc3ochigjisW.rWOHgJpu1EjfPNqOHP7ayWGJvOjYIqV0.IN6878CnndPV2zJ4kPf Bj4HhLm5eyYe752e6MHHC8Z99TQOzVH3JRp6ewGhNlLi0eKW3KUA2Ow8m_vq1JGSzfXS3U5v9wBi PPFh.OymqH5hRWM7VTK9kuWui1t_L0KdGgY34fo3G3DOCxbnfSe7cZ4AocGy9WR9nnScIqTsARyU ScCTeyFSRV18zVVMJ8O3IhaFO5HCUdbmL9g9xJrVS098JZla3jxbNUkkSvXk9w7JMXH7YHOWHYCg Ef7uvsw__ocoBc6kbRgcAJk3PbvFKEvOf38yDR0gibk_8W_zROtYXohu4Y4S5JyuwlOw233W5OJK vydMZRJzLHUzfabsUKxxeJ3rBBvZUMygoB7TtqFvTJihQdJpC860v319paPr9Ir2Xsivd4YsYXmE x9T8T9HxZsbS1ZejaZlBU9OV6x3lBp7PAWharbnDY5C.QrgnVJRt8Wg9vGRkf1xaLR0uE.PMJKQl TsakoiXa4A.NrwQU.Ap47GOQvKBPY4NT5.CENRhlhpJBeq4bk.GqkCSBqFLAFeezc90uX0i399Aq _h0MrANBu2sSUu2L6LlNdtOHmtk3Mzwpo2XPvqhLB4NQ8oJLSCrTX6WxyaDETIRoFAu3Lyc6vNHg _nTTiytwEdYM0z.ZDhhmTAWQmIay0sdQNj7ABctzbz0Ob1t9KTjXaLo7mJHxk1sMMRkeHj3b9p3C jWH1gz2VzAXhBSKWutjexFfQp1BCpn8d6hOxH5b1RJ2uIEkQXd9pRFtZJqaR1uCkyyUbtaYrho8V fFxKM2qzDSryUI6S7DAlt6Bcg77TfF5uWm.a_DB6ZO_iTPAPACaFsPHL3Y.ea1VbccPUmpRP4H4k - X-Sonic-MF: X-Sonic-ID: 2faf0906-f81f-4396-bfb9-ec4eb366e4e4 Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Thu, 21 Dec 2023 21:03:55 +0000 Received: by hermes--production-gq1-6949d6d8f9-ghhkt (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 0596b7c5c0c42bb8f6c37c390cb4b0b1; Thu, 21 Dec 2023 21:03:51 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.300.61.1.2\)) Subject: Re: measuring swap partition speed Message-Id: Date: Thu, 21 Dec 2023 13:03:41 -0800 To: Warner Losh , void , freebsd-fs@freebsd.org X-Mailer: Apple Mail (2.3774.300.61.1.2) References: X-Spamd-Result: default: False [-3.45 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.95)[-0.953]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.31:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.31:from]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FREEMAIL_TO(0.00)[bsdimp.com,f-m.fm,freebsd.org]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Sx2wZ6Fb3z4MPL X-Spamd-Bar: --- Warner Losh wrote on Date: Fri, 15 Dec 2023 15:41:10 UTC : I'm trying to figure out what to do with the fio, what adjustments to the example are appropriate, both for the orginal message's context and for what I have access to. > . . . > Now, having said all that, your best bet is to run a FIO test. fio is my > go-to choice for doing > benchmarking of storage. Do a random workload with a 8k write size (since > that's the page > size of aarch64) I'm guessing the figure in question is: # sysctl vm.stats.vm.v_page_size vm.stats.vm.v_page_size: 4096 Is that correct? > on one of the swap partitions when it's not in active use. > I suspect you have > a SSD, and that it will kinda suck, but be in line with the swap > performance you are seeing. > > I use the following template for my testing (128k should be reduced to 8k > for this test, Again: # sysctl vm.stats.vm.v_page_size vm.stats.vm.v_page_size: 4096 > though > I've not looked at how much we cluster writes in our swap code, so maybe > that's too pessimistic). Is that based on: # sysctl vm.phys_pager_cluster vm.phys_pager_cluster: 1024 I'm unclear if vm.phys_pager_cluster is relevant or, if it is, how vm.phys_pager_cluster should be put to use here. Where is the 8k figure from? > You might also try reducing the number of I/O jobs, since I'm measuring, or > trying to, what the > best possible sustained throughput numbers are (latency in this test tends > to run kinda high). The original E-mail reported: rpi4 and a usb3-connected disk So: 4 cores and the USB3 is one channel that the 2 USB3 ports share. (There are 2 separate USB2 ports.) Later "spinning rust" was mentioned for the media. (I've only USB3 SSD or USB3 NVMe access.) > ; SSD testing: 128k I/O 64 jobs 32 deep queue Spinning rust, not an SSD for the original message. (But I've no access to spinning rust to test: USB3 SSD or USB3 NVMe access.) Again: 128k's replacement? 64 jobs and 32 deep: might not be a good match to 4 cores and single channel USB3 spinning rust? Or my context: 4 cores and USB3 SSD or USB3 NVMe? > [global] > direct=1 > rw=randread Only reads? I'd have guessed a mix of reads and writes, not necessarily in fixed proportions. So I'm not sure if rw=randwrite was the intended replacement or if something else that would end up exploring mixes would be the intended replacement. > refill_buffers > norandommap > randrepeat=0 > bs=128k 4k? 8k? something else? > ioengine=posixaio > iodepth=32 ??? > numjobs=64 ??? > runtime=60 > group_reporting > thread > > [ssd128k] === Mark Millard marklmi at yahoo.com