From nobody Fri Dec 22 00:19:39 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Sx7Gn1pDKz54STH for ; Fri, 22 Dec 2023 00:20:01 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Sx7Gm5PNbz4g5B for ; Fri, 22 Dec 2023 00:20:00 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm2 header.b=s1H8uayd; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=f8+ao67A; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.28 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute6.internal (compute6.nyi.internal [10.202.2.47]) by mailout.nyi.internal (Postfix) with ESMTP id 650625C0243 for ; Thu, 21 Dec 2023 19:20:00 -0500 (EST) Received: from imap46 ([10.202.2.96]) by compute6.internal (MEProxy); Thu, 21 Dec 2023 19:20:00 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=fm2; t=1703204400; x=1703290800; bh=fpQKu0Cdxf ux9Wp8vVDMk1zyx/yES8HOyXNRc8ARF74=; b=s1H8uaydlN7JADmR3TvypVXwSu zGndMZ5tbA98YDVWYGY0MajzzLtBdFN6TtF/Qh5o6fJ0pvT+Ph4dvt9Ktg8tViZM hORGHjJYjrFqTtTtZtS8v5CRsMZrjVcXuYrBZh6O2GTVhtPSPLqDEXVGTCqrvyse pWeKNx4iegj7IHnxVl5kPTaJh1UvsmhtsInqWmGT7h5MZ/NqNcNhuVdumGav0NQM iC4oYBjqS57JMeGg0y/GiZv9Vgpuwxa+jr4jZrVrptc9TGoRpKTGI3ULwEU3ulAl poSFnP95LpufXh/UMN2CUCSDeTiL9SBFxFwu9e6+iCA38osDHg5OZ8Hql8/w== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm2; t=1703204400; x=1703290800; bh=fpQKu0Cdxfux9Wp8vVDMk1zyx/yE S8HOyXNRc8ARF74=; b=f8+ao67Aw0AGtcNyo1k9VlI6j9eAQ1ObDYZ3M6ybt8rc a9g8ebEblz7BGVHmqn05uEg3ADRMptmiWoEY7/SW1Vp3sQ2FzsXaTAhbIZb5xrid Eh2YKedc0058uZ9Ylp2fvc2NlS6sk6ScS676//3ct35DvqY+TIHo1KiT18ReSBN4 h5uYG3gkz2eX4+T4q6OgKcIDH9qVgM7ZTTsNNolp/l99h7yBQdFbqj0VPUIQF4w0 ZQXIxXEtGP/4tMJWzshBqMOT4xrow385KyKSW0mG1xpubF16bAk1v9iFn2Bey+Ga 2amnRnYtSCidjD2EumVG/+nuEKMG9mvAaI4cDvPX8g== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrvdduiedgvdduucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfgjfhffhffvufgtsehttd ertderredtnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffr rghtthgvrhhnpeeitedvueehtdehtddvhfeuhfevhedvieelvdeiffehveelheegfedule ejudekvdenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhm pehvohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id 2BFD52A2008B; Thu, 21 Dec 2023 19:20:00 -0500 (EST) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.9.0-alpha0-1364-ga51d5fd3b7-fm-20231219.001-ga51d5fd3 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Message-Id: <2dcc21bb-f446-41fa-871b-2c37cdf9afe0@app.fastmail.com> In-Reply-To: References: Date: Fri, 22 Dec 2023 00:19:39 +0000 From: void To: freebsd-fs Subject: Re: measuring swap partition speed Content-Type: text/plain X-Spamd-Result: default: False [-4.19 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.997]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm2,messagingengine.com:s=fm2]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28:c]; RWL_MAILSPIKE_GOOD(-0.10)[66.111.4.28:from]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from]; XM_UA_NO_VERSION(0.01)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[f-m.fm]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-Rspamd-Queue-Id: 4Sx7Gm5PNbz4g5B X-Spamd-Bar: ---- Hi Mark & Warner, I tried using fio with Warner's suggestions as a template, and pasted the results in the latter part of this message. On Thu, 21 Dec 2023, at 21:03, Mark Millard wrote: > # sysctl vm.stats.vm.v_page_size > vm.stats.vm.v_page_size: 4096 Here, this setting is: # sysctl vm.stats.vm.v_page_size vm.stats.vm.v_page_size: 4096 > # sysctl vm.phys_pager_cluster > vm.phys_pager_cluster: 1024 It is 1024 here, too. Only the one usb3 port is occupied. fio output follows. No idea yet if the settings used are suitable for this context and would welcome suggestions. I think --filename can be a device? Output suggests it used hw.ncpu instead of --numjobs=8 ~~~~~~~ # fio --name=randread --ioengine=posixaio --rw=randread --direct=1 --bs=8k --refill_buffers --norandommap --randrepeat=0 --iodepth=32 --numjobs=8 --runtime=60 --group_reporting --thread --size=2048M randread: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 8192B-8192B, (T) 8192B-8192B, ioengine=posixaio, iodepth=32 ... fio-3.36 Starting 8 threads randread: Laying out IO file (1 file / 2048MiB) randread: Laying out IO file (1 file / 2048MiB) randread: Laying out IO file (1 file / 2048MiB) randread: Laying out IO file (1 file / 2048MiB) randread: Laying out IO file (1 file / 2048MiB) randread: Laying out IO file (1 file / 2048MiB) randread: Laying out IO file (1 file / 2048MiB) randread: Laying out IO file (1 file / 2048MiB) Jobs: 4 (f=4): [_(1),r(2),_(2),r(1),_(1),r(1)][21.2%][r=288KiB/s][r=36 IOPS][eta 04m:05s] randread: (groupid=0, jobs=8): err= 0: pid=135125: Thu Dec 21 16:43:00 2023 read: IOPS=43, BW=351KiB/s (359kB/s)(22.6MiB/65986msec) slat (nsec): min=889, max=1948.6k, avg=4172.45, stdev=36488.07 clat (msec): min=1108, max=11660, avg=5644.23, stdev=1282.12 lat (msec): min=1108, max=11660, avg=5644.24, stdev=1282.12 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 3171], 10.00th=[ 4933], 20.00th=[ 5269], | 30.00th=[ 5470], 40.00th=[ 5604], 50.00th=[ 5738], 60.00th=[ 5873], | 70.00th=[ 5940], 80.00th=[ 6074], 90.00th=[ 6342], 95.00th=[ 6812], | 99.00th=[10671], 99.50th=[10939], 99.90th=[11610], 99.95th=[11610], | 99.99th=[11610] bw ( KiB/s): min= 208, max= 3760, per=100.00%, avg=1535.05, stdev=128.23, samples=245 iops : min= 26, max= 470, avg=191.88, stdev=16.03, samples=245 lat (msec) : 2000=3.25%, >=2000=96.75% cpu : usr=0.00%, sys=0.12%, ctx=22712, majf=0, minf=0 IO depths : 1=0.3%, 2=0.6%, 4=1.1%, 8=4.9%, 16=69.6%, 32=23.6%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=94.7%, 8=2.9%, 16=1.5%, 32=0.9%, 64=0.0%, >=64=0.0% issued rwts: total=2895,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=32 Run status group 0 (all jobs): READ: bw=351KiB/s (359kB/s), 351KiB/s-351KiB/s (359kB/s-359kB/s), io=22.6MiB (23.7MB), run=65986-65986msec # --