From nobody Thu Dec 28 14:39:08 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T1B3R1yTbz55xX5 for ; Thu, 28 Dec 2023 14:39:15 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4T1B3R1Tg5z4fZL; Thu, 28 Dec 2023 14:39:15 +0000 (UTC) (envelope-from lev@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1703774355; h=from:from:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=VVJYHzQn5bMtuFkzYg5NpYLzJqFh9JeukLbsFDfvlwQ=; b=Cyi69yROSyNyFqe7AqMI/nfKv+76pwiVMh4rhBR+CRPWAXxgOAVGwDrJlSkn5h97Fg045h czEZ/XSpjqRCAibpzfyrspcisNz10SwzuIh0sNa0ZH1EipKQ1CpmeNyMpzkeAB8N9G4zWy rXjUKoPhsfq1NVSVE1ebCoS0jPKD8iyP+ydpg17M0thgDe7jMgKzx/5YEl1J1/MJ0ojAco FVTmzDM0QN07icLPEAtfXrHfPl1M+txKWIpXEroavUvibnAQCtHRlRo4W0LSwk+U0Vtqwo ieY5URKQ+BPG8qt2buIqiQWUqKQ1LVef2lCQZsYPxmrALoBuJU1LcmdJm3Tlwg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1703774355; a=rsa-sha256; cv=none; b=ZpD9V/YAsjbP+oQnxfPpFjHRjFR8wTLvTy6gb61VVAhM+0Y9aFXUYwu2YvMmNRp0E/7333 aBXFK5uzbhZzuOojKrK4fJ/Gqc040HreuS+zfRi+/3DUtfaVQiNdQxhLnve5t7hrdsg4ea aZ4L/sdyni9MBY3JQFsK1kPT3dbGGi117DMvhOCkmOVIDhYi2osagi4eB1DSned2Yc2Fk+ FChYl5YwLIxCTu7rDLg6lIGeOx5E+NnVtIXe+boFcFI7I7FEjeGupk3+PpnDKxCeTNjGFJ i4o0F0bW044tFYF975zRSWdKikdwDs9VrH34zbbv9Lait5sZ7+YIkwgbkYigaA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1703774355; h=from:from:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=VVJYHzQn5bMtuFkzYg5NpYLzJqFh9JeukLbsFDfvlwQ=; b=Qh2ZoSZTEapHIh2xJKsk0o/U5WYyeP9jo9Jow/qLgXCObK49jhdF3LHzFhvc790DuDSTf8 hvukbqHvCQ9EKh6GHOVKz2piJ3K/TeM6Mn/eaGBBciNLhq7h00K+7ihqOq3I/U2utB+QSZ lloFXuAvz1OHAvvF4EuLzJ4N5wwFolJJ9JaxZQ9m1PLlKdQ5k+cSPxaQsaw/5Ck70gjyCh /CMgwuIJAsfkIQiL0gVJwRNB9Z32YmcFnLtZ5zAoP+P4yHunRMQDvUqWV+FOkv0cQqDW5e aB2IZvjgrRswdc+N3KsYww8tE6Ogb1akxpHRSTYdctN1yd1EbKeEmeXIWgBVGg== Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: lev/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4T1B3Q6yN9z3Qh; Thu, 28 Dec 2023 14:39:14 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [IPV6:2001:470:923f:1:9d97:3145:f9f2:d8bf] (unknown [IPv6:2001:470:923f:1:9d97:3145:f9f2:d8bf]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id C11691685E; Thu, 28 Dec 2023 17:39:09 +0300 (MSK) Message-ID: <24d15dbb-43e7-4a20-b42a-b4b1969a4089@FreeBSD.org> Date: Thu, 28 Dec 2023 15:39:08 +0100 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Reply-To: lev@FreeBSD.org Subject: Re: ZFS pool hangs (live-locks?) after adding L2ARC Content-Language: en-US To: Dimitry Andric Cc: freebsd-fs@freebsd.org References: <88ae141a-93af-4f23-87c1-f44a99975a28@FreeBSD.org> From: Lev Serebryakov Organization: FreeBSD In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 28.12.2023 15:16, Dimitry Andric wrote: >>> I can not find any discussion about such problem on Internet. Also, "live" system doesn't have these "z_int_X_Y" threads at all. >>> I want my L2ARC, I've payed for this NVMe! >> >> Any ideas? > > Do you know 100% sure that this new NVMe device is working correctly? Are there any errors to be found in SMART information, dmesg or syslog? You never can be 100% sure, but I don't see any errors in dmesg/syslog and smartctl shows no errors too: === START OF SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED SMART/Health Information (NVMe Log 0x02) Critical Warning: 0x00 Temperature: 49 Celsius Available Spare: 100% Available Spare Threshold: 10% Percentage Used: 0% Data Units Read: 162,228 [83.0 GB] Data Units Written: 135,786 [69.5 GB] Host Read Commands: 430,232 Host Write Commands: 282,975 Controller Busy Time: 2 Power Cycles: 23 Power On Hours: 530 Unsafe Shutdowns: 14 Media and Data Integrity Errors: 0 Error Information Log Entries: 0 Warning Comp. Temperature Time: 0 Critical Comp. Temperature Time: 0 Error Information (NVMe Log 0x01, 8 of 8 entries) No Errors Logged Unfortunately, AData allows to check for newer firmware only on Windows :( Do you have any advice which tests could I try? It is PCIe 4.0 device in PCIe 3.0 slot (as MoBo supports only PCIe 3.0). -- // Lev Serebryakov