[EXTERNAL] Re: FreeBSD10 Stable + ZFS + PostgreSQL + SSD performance drop < 24 hours
Caza, Aaron
Aaron.Caza at ca.weatherford.com
Sat Jun 17 07:11:47 UTC 2017
From: Adam Vande More [mailto:amvandemore at gmail.com]
Sent: Saturday, June 17, 2017 12:49 AM
To: Caza, Aaron
Cc: freebsd-hackers at freebsd.org
Subject: [EXTERNAL] Re: FreeBSD10 Stable + ZFS + PostgreSQL + SSD performance drop < 24 hours
On Sat, Jun 17, 2017 at 12:16 AM, Caza, Aaron <Aaron.Caza at ca.weatherford.com<mailto:Aaron.Caza at ca.weatherford.com>> wrote:
Regarding this issue, I've now conducted testing using merely a FreeBSD 10.3 Stable amd64 GENERIC kernel and using dd to read a large file. The following is a log, taken hourly, of the degradation which occurred at just over 9 hours of uptime. As the original is quite large, I've removed some sections; however, these can be supplied if desired.
Supplied are the initial dmesg and zpool status, logged only on startup, followed by uptime, uname -a, and zfs-stats -a output, each of which are logged hourly.
What does this say?
# zpool get all
The output of zpool get all is as follows:
NAME PROPERTY VALUE SOURCE
wwbase type filesystem -
wwbase creation Wed Jun 7 10:37 2017 -
wwbase used 42.8G -
wwbase available 186G -
wwbase referenced 1.96G -
wwbase compressratio 1.00x -
wwbase mounted yes -
wwbase quota none default
wwbase reservation none default
wwbase recordsize 128K default
wwbase mountpoint /zfsroot local
wwbase sharenfs off default
wwbase checksum on default
wwbase compression off default
wwbase atime on default
wwbase devices on default
wwbase exec on default
wwbase setuid on default
wwbase readonly off default
wwbase jailed off default
wwbase snapdir hidden default
wwbase aclmode discard default
wwbase aclinherit restricted default
wwbase canmount on default
wwbase xattr off temporary
wwbase copies 1 default
wwbase version 5 -
wwbase utf8only off -
wwbase normalization none -
wwbase casesensitivity sensitive -
wwbase vscan off default
wwbase nbmand off default
wwbase sharesmb off default
wwbase refquota none default
wwbase refreservation none default
wwbase primarycache all default
wwbase secondarycache all default
wwbase usedbysnapshots 0 -
wwbase usedbydataset 1.96G -
wwbase usedbychildren 40.8G -
wwbase usedbyrefreservation 0 -
wwbase logbias latency default
wwbase dedup off default
wwbase mlslabel -
wwbase sync standard default
wwbase refcompressratio 1.00x -
wwbase written 1.96G -
wwbase logicalused 42.4G -
wwbase logicalreferenced 1.88G -
wwbase volmode default default
wwbase filesystem_limit none default
wwbase snapshot_limit none default
wwbase filesystem_count none default
wwbase snapshot_count none default
wwbase redundant_metadata all default
wwbase/tmp type filesystem -
wwbase/tmp creation Wed Jun 7 10:37 2017 -
wwbase/tmp used 128K -
wwbase/tmp available 512M -
wwbase/tmp referenced 128K -
wwbase/tmp compressratio 1.00x -
wwbase/tmp mounted yes -
wwbase/tmp quota 512M local
wwbase/tmp reservation none default
wwbase/tmp recordsize 128K default
wwbase/tmp mountpoint /zfsroot/tmp local
wwbase/tmp sharenfs off default
wwbase/tmp checksum on default
wwbase/tmp compression off default
wwbase/tmp atime on default
wwbase/tmp devices on default
wwbase/tmp exec on default
wwbase/tmp setuid on default
wwbase/tmp readonly off default
wwbase/tmp jailed off default
wwbase/tmp snapdir hidden default
wwbase/tmp aclmode discard default
wwbase/tmp aclinherit restricted default
wwbase/tmp canmount on default
wwbase/tmp xattr off temporary
wwbase/tmp copies 1 default
wwbase/tmp version 5 -
wwbase/tmp utf8only off -
wwbase/tmp normalization none -
wwbase/tmp casesensitivity sensitive -
wwbase/tmp vscan off default
wwbase/tmp nbmand off default
wwbase/tmp sharesmb off default
wwbase/tmp refquota none default
wwbase/tmp refreservation none default
wwbase/tmp primarycache all default
wwbase/tmp secondarycache all default
wwbase/tmp usedbysnapshots 0 -
wwbase/tmp usedbydataset 128K -
wwbase/tmp usedbychildren 0 -
wwbase/tmp usedbyrefreservation 0 -
wwbase/tmp logbias latency default
wwbase/tmp dedup off default
wwbase/tmp mlslabel -
wwbase/tmp sync standard default
wwbase/tmp refcompressratio 1.00x -
wwbase/tmp written 128K -
wwbase/tmp logicalused 59K -
wwbase/tmp logicalreferenced 59K -
wwbase/tmp volmode default default
wwbase/tmp filesystem_limit none default
wwbase/tmp snapshot_limit none default
wwbase/tmp filesystem_count none default
wwbase/tmp snapshot_count none default
wwbase/tmp redundant_metadata all default
wwbase/ww type filesystem -
wwbase/ww creation Wed Jun 7 10:37 2017 -
wwbase/ww used 40.8G -
wwbase/ww available 186G -
wwbase/ww referenced 40.8G -
wwbase/ww compressratio 1.00x -
wwbase/ww mounted yes -
wwbase/ww quota none default
wwbase/ww reservation none default
wwbase/ww recordsize 8K local
wwbase/ww mountpoint /zfsroot/ww local
wwbase/ww sharenfs off default
wwbase/ww checksum on default
wwbase/ww compression off local
wwbase/ww atime on default
wwbase/ww devices on default
wwbase/ww exec on default
wwbase/ww setuid on default
wwbase/ww readonly off default
wwbase/ww jailed off default
wwbase/ww snapdir hidden default
wwbase/ww aclmode discard default
wwbase/ww aclinherit restricted default
wwbase/ww canmount on default
wwbase/ww xattr off temporary
wwbase/ww copies 1 default
wwbase/ww version 5 -
wwbase/ww utf8only off -
wwbase/ww normalization none -
wwbase/ww casesensitivity sensitive -
wwbase/ww vscan off default
wwbase/ww nbmand off default
wwbase/ww sharesmb off default
wwbase/ww refquota none default
wwbase/ww refreservation none default
wwbase/ww primarycache all default
wwbase/ww secondarycache all default
wwbase/ww usedbysnapshots 0 -
wwbase/ww usedbydataset 40.8G -
wwbase/ww usedbychildren 0 -
wwbase/ww usedbyrefreservation 0 -
wwbase/ww logbias latency default
wwbase/ww dedup off default
wwbase/ww mlslabel -
wwbase/ww sync standard default
wwbase/ww refcompressratio 1.00x -
wwbase/ww written 40.8G -
wwbase/ww logicalused 40.5G -
wwbase/ww logicalreferenced 40.5G -
wwbase/ww volmode default default
wwbase/ww filesystem_limit none default
wwbase/ww snapshot_limit none default
wwbase/ww filesystem_count none default
wwbase/ww snapshot_count none default
wwbase/ww redundant_metadata all default
wwbase/wwdebug type filesystem -
wwbase/wwdebug creation Wed Jun 7 10:37 2017 -
wwbase/wwdebug used 116K -
wwbase/wwdebug available 512M -
wwbase/wwdebug referenced 116K -
wwbase/wwdebug compressratio 1.00x -
wwbase/wwdebug mounted yes -
wwbase/wwdebug quota 512M local
wwbase/wwdebug reservation none default
wwbase/wwdebug recordsize 128K default
wwbase/wwdebug mountpoint /zfsroot/ww/debug local
wwbase/wwdebug sharenfs off default
wwbase/wwdebug checksum on default
wwbase/wwdebug compression off default
wwbase/wwdebug atime on default
wwbase/wwdebug devices on default
wwbase/wwdebug exec on default
wwbase/wwdebug setuid on default
wwbase/wwdebug readonly off default
wwbase/wwdebug jailed off default
wwbase/wwdebug snapdir hidden default
wwbase/wwdebug aclmode discard default
wwbase/wwdebug aclinherit restricted default
wwbase/wwdebug canmount on default
wwbase/wwdebug xattr off temporary
wwbase/wwdebug copies 1 default
wwbase/wwdebug version 5 -
wwbase/wwdebug utf8only off -
wwbase/wwdebug normalization none -
wwbase/wwdebug casesensitivity sensitive -
wwbase/wwdebug vscan off default
wwbase/wwdebug nbmand off default
wwbase/wwdebug sharesmb off default
wwbase/wwdebug refquota none default
wwbase/wwdebug refreservation none default
wwbase/wwdebug primarycache all default
wwbase/wwdebug secondarycache all default
wwbase/wwdebug usedbysnapshots 0 -
wwbase/wwdebug usedbydataset 116K -
wwbase/wwdebug usedbychildren 0 -
wwbase/wwdebug usedbyrefreservation 0 -
wwbase/wwdebug logbias latency default
wwbase/wwdebug dedup off default
wwbase/wwdebug mlslabel -
wwbase/wwdebug sync standard default
wwbase/wwdebug refcompressratio 1.00x -
wwbase/wwdebug written 116K -
wwbase/wwdebug logicalused 45.5K -
wwbase/wwdebug logicalreferenced 45.5K -
wwbase/wwdebug volmode default default
wwbase/wwdebug filesystem_limit none default
wwbase/wwdebug snapshot_limit none default
wwbase/wwdebug filesystem_count none default
wwbase/wwdebug snapshot_count none default
wwbase/wwdebug redundant_metadata all default
Note that the ‘dd’ used in the previously posted logfile is on wwbase/ww hence the recordsize is 8K rather than the 128K as is used elsewhere (8K selection due to PostgreSQL usage).
(ps. Please note that the above in no way reflects that I am in any way concerned about this issue nor that it is keeping me awake at night: 1:10AM here in rainy Calgary, Alberta Canada)
This message may contain confidential and privileged information. If it has been sent to you in error, please reply to advise the sender of the error and then immediately delete it. If you are not the intended recipient, do not read, copy, disclose or otherwise use this message. The sender disclaims any liability for such unauthorized use. PLEASE NOTE that all incoming e-mails sent to Weatherford e-mail accounts will be archived and may be scanned by us and/or by external service providers to detect and prevent threats to our systems, investigate illegal or inappropriate behavior, and/or eliminate unsolicited promotional e-mails (spam). This process could result in deletion of a legitimate e-mail before it is read by its intended recipient at our organization. Moreover, based on the scanning results, the full text of e-mails and attachments may be made available to Weatherford security and other personnel for review and appropriate action. If you have any concerns about this process, please contact us at dataprivacy at weatherford.com.
More information about the freebsd-hackers
mailing list