From nobody Thu Nov 18 23:11:45 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3DD43189E762 for ; Thu, 18 Nov 2021 23:12:00 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-22.consmr.mail.gq1.yahoo.com (sonic310-22.consmr.mail.gq1.yahoo.com [98.137.69.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4HwFtR6WGzz4dtt for ; Thu, 18 Nov 2021 23:11:59 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1637277112; bh=DzJE8IIRizpUo0MOW9Nw20wksbtfFrcN71jqlM0pHm0=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=sE18sgO4kIU2reTQPiStE7YOd8bGT/imr3XmWMpcUiA52/7iin2pRKhReq0QCdlYP+w7MJDnoBGeKR4GdqMwMBG31s8cGUxH+OK0toelBDvSpVGXfmtKh6pzY2S41+Ja3OmmIm+tMM1U8iIjjg6Sffec/eGtMnbDhOYT3YyE1rW237vtnMP3D3GcTGarHipKULrFFv6SZ1+Hp+g7skgJ9wXZbJGuESUH0lia6wla2BuYnZwYEYfIkssGvi3ROrqdEaQUps8CQrdYwyuH1szeB/wFzBI2PjlGeblg9W5i+GPHxq0m8fys7XUcS4BTrTi5nT/Txxu4ATURyQw2BXDDCw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1637277112; bh=sLpDeSvQzQrTD2X6z+o2d9fH77MANtUrF9zszjZN380=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=bgHb+1su5iBWkNJrEJvrF9FFJlFXebgMsfksPYznIu/7zCkVksnctOmhrt0Q0+nhQg4CwP0F4vAkhrM8BrQZZJGvpOTnT5jxcnHAYTA5kA5W5lWWMoeCeVwe/G8VaC6lytCM8xEiPyXAWshnnNIc4xkqUjjblGpfaQu/WCOdENSrTxbzodCRXExwI5HPm/RvzHQ59AjT9TnI7HzOgXn5m/kyVMc/FPQjbml1KGW4n2NiTv+jPrzqDFRWE6C8ZbXhxA8o2fG1OJlT0AG/fI4snc+03kesAC/luYEZIqfTGzmpb30GRb74it0bo0EoMe7E0/28gef99g/QdiwWAQ6vdQ== X-YMail-OSG: zmuyg9cVM1lJP48yE4ho9Sl6mKz8Wj5gYQMhFafy2iBnnTJCOSCuVa7.Gx2Wljz Kr_75szQiB25I24USOTYgzj1T1bgLUgfzJENl02v7QrRr5V3sXKQwjcfBXibZNTujP.Ocd3GV1du XYDUlB3g9oVC2Ax0fTvetKva4OZR9KdECLxsD1xNTjmmttmTg8b6_Pr3CEShQU04jCMprfRi7vzm 3JN16HLgwZ2m3CwKCkh3MKp5KAhbcprTMl7XyEi0PprT6pbbwt.6Wxq4YQs_FfXeeYP7taMnhuqW v_6K6MZUgpQHXJNKoMA2BOJsBGduqAZ2qxJ5bfFzj9KwVyZWKmGLzMf1vwPqECoPAwENSFFbyZRk oMv_Z7JeLm_k64GN7fojys9AuUyYFQUE.IdIHnZViH9ISd24yLrv1CGC2yKaEDPBnjmj.L.YtAX4 DqInraR3yLf5nEHwd83tTqjAf7T.l4KnRoHwkYOKLBoHExbZSQNBE2t7wvVgQP14oa_.wAKU4CeE FDO8KmW66OGQScyQNB1JuNvMg72lkbK0Ggdibw3XcDdI.U2ulZQtcRXg8bJVBgqAbd2VEcFJAKUo YOopr8RU50Gu3_2_UIbEsCdyWcYqAtWHfV2swVsr99FmJkxwjlZxGJevfcX1QtCBlNTOIf.aI9Ip WHGjIwuiwz7udm1Ovotzklou4nYJ1OvdT6i9NmNK2X05B81dkKykg0BtkDorIgpeYv_tGFZx2aCm woX82Zz1oIoHLY3S0LPssRNnlPA394CL4NZ59GhngLRs19HVAFBpTiumvmCWytMO.oTIxU.r9K1R ouMFmTgoZuEpQxsJxnCQ63OjjQUjCWmUT6oFIpv17i7qk6oEjxdVGu6_xdaOXBro.4eAWTDEJy8d yDdgfBhX9YyiurLngOsTj61F4_fouUjALzsBjTcfVxtlOSAmzZsXob2Wa4etU30Yb4SulJQarSj9 sT11imscAC5tvVPe3CzqHFgn_piM5exaLSsOCk8uuLTPreI.6Q2qVZxWJHjGtxezydw5EujBxWuD x6r5PFKuLWw_Ua_udkwCTgcjLXFbFkLPcgp1B_PRzwBeZ9aHN5AmWyf_ZfHkCSuOkLtYOvV7Xnwc ZebOE27mQDcj9f9_aiUVcJ8PybUZIYUA7UqrK9ftqZjBxer395ITqwVI40_nWbncMn4LTCVvxF0i bNwIQ_qFOSXWT0ZnMlIKjkf9uyspcKp2xofMnRKkkSGfGUjCY1ojAFbs8hQtXg9VZz3mFlmMTcH9 RBhvX9FLH7aDmp9IOPxRWMzTTvvPi3DGY__Zq9YeKQDEB18vkH8wvXRFIiRGOky4dcHuR0vVZcPr KZSl3jPZQ5nOQW2JpiUxE38piyklua84nzruOWgn0QsnrmVVnrKJojCFvt8uTYIzqBQA8n.LZGDn Rvy2oPUVRzcucd3ceqjBbFI4zslVj.v7d902uKvhc5.LIngTbo644U_33WrxYlLaS7kHiZ9oRTUu ZgcVxXY1bpk5vvkjQCEGHvU1XLrgrzM16RwqC.SA2tPzkbbluAwN10l.P6iYCt0ntyrN5QG1IGGc FW2KlS62ziGenEICe3nQfXfMTy6Uv9VPEZyr9TszRxlNKToC.KLhy5ItnMSo8j0hvY7zwwNdrmdM bLWiYdoI2ai0uEv3aWC5w3V1evNPFCTkoYKqK_eAc1wEFMesBx5Kvjb1zybFkVd5rU.EOolWhjCi sMUKHpizOuwUMZC_XmfMjUy371_.ZY9mQA1OY6sJvD1MigjN.cuPhddsalIO6EOdDtFcu2ikP3oH Ofl_RuZG.xrd6eIWnO.0Dx9Swj2hmVbH9tMu43PW0MlP6tz5T9uPt18wW6MdzK0.elHS4HS3iMNx 3NqUw5VVbbZbAam3K7uwujgy.Ny2Tb2OaDnvw29Sn7MbhuVgj2MRANpbxHCNb6cQvdnXuACIf6dY w6mLhyofW01LpG_.uCixqFiBU4Vfd15zRgZarMQEF_ko0pN_LMydCzygoeLA_FtpDq_DXdcv1b62 j504bwY0wz8CHpP2Uzoe7OXWCrCORhiPm8R36zZQX5o3aQn27B584x7_P.CjYsXYGK86jlRBuNcM xvLds.6zw02WJ8cm3kRASTeMPr6nT4owYSK3jtogA32GxMgvKFLo7TtO6AKdMYuuCqKL3q..tkyE lz52I9lulXoRJ_bWHTTH2O78qxEssqSJ8bACGisM4vVmWxc0pSisV1YfPItMWyiU5eDKYxnWEgw9 Yu3UK7UZHNge3FUj9cKO6iTUjlWcOlF6IJMguH1K5OeZ7ssaRKODBqBHTNNGw.zoWNpRnvqJpIus YfOySSC.EI1j7j69mCYXXgpzmfj879cnE_QdcIzLJIDMjHacmoTMQgd6.HjuL X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Thu, 18 Nov 2021 23:11:52 +0000 Received: by kubenode516.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 32e1decfbd1270aac4cfee0220c08896; Thu, 18 Nov 2021 23:11:47 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: "Khelp module "ertt" can't unload until its refcount drops from 1 to 0." after "All buffers synced."? In-Reply-To: <52374B7E-6ABB-4E55-984C-B7EC82B48506@freebsd.org> Date: Thu, 18 Nov 2021 15:11:45 -0800 Cc: freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: References: <119DC979-EC2C-4BE4-A6E8-2DBF222115A0.ref@yahoo.com> <119DC979-EC2C-4BE4-A6E8-2DBF222115A0@yahoo.com> <52374B7E-6ABB-4E55-984C-B7EC82B48506@freebsd.org> To: "tuexen@freebsd.org" X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Rspamd-Queue-Id: 4HwFtR6WGzz4dtt X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-current X-Original-From: Mark Millard X-ThisMailContainsUnwantedMimeParts: N > On 2021-Nov-18, at 12:31, tuexen@freebsd.org = wrote: >=20 >> On 17. Nov 2021, at 21:13, Mark Millard via freebsd-current = wrote: >>=20 >> I've not noticed the ertt message before in: >>=20 >> . . . >> Waiting (max 60 seconds) for system thread `bufspacedaemon-1' to = stop... done >> All buffers synced. >> Uptime: 1d9h57m18s >> Khelp module "ertt" can't unload until its refcount drops from 1 to = 0. > Hi Mark, >=20 > what kernel configuration are you using? What kernel modules are = loaded? The shutdown was of my ZFS boot media but the machine is currently doing builds on the UFS media. (The ZFS media is present but not mounted). For now I provide information from the booted UFS system. The UFS context is intended to be nearly a copy of the brctl selection for main [so: 14] from the ZFS media. Both systems have been doing the same poudriere builds for various comparison/contrast purposes. The current build activity will likely take 16+ hrs. For reference for now (from UFS context): # uname -apKU FreeBSD HC_CA72_UFS 14.0-CURRENT FreeBSD 14.0-CURRENT #19 = main-n250667-20aa359773be-dirty: Sun Nov 14 02:57:32 PST 2021 = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm6= 4.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1400042 1400042 This environment was built with -mcpu=3Dcortex-a72 in use and the system is a 16 core Cortex-A72 system. (I've caught a FreeBSD weak memory model error in the past with such -mcpu=3Dcortext-a72 use on a Cortext-A72 system, not that I have evidence of such here.) # kldstat Id Refs Address Size Name 1 18 0xffff000000000000 12b1660 kernel 2 1 0xffff0000012b2000 41e070 zfs.ko 3 1 0xffff0000016d1000 26af8 cryptodev.ko 4 1 0xffff00019a400000 27000 nullfs.ko 5 1 0xffff00019a427000 25000 fdescfs.ko # more /usr/main-src/sys/arm64/conf/GENERIC-NODBG-CA72 include "GENERIC-NODBG" ident GENERIC-NODBG-CA72 makeoptions CONF_CFLAGS=3D"-mcpu=3Dcortex-a72" # more /usr/main-src/sys/arm64/conf/GENERIC-NODBG # # GENERIC -- Custom configuration for the arm64/aarch64 # include "GENERIC" ident GENERIC-NODBG makeoptions DEBUG=3D-g # Build kernel with gdb(1) = debug symbols options ALT_BREAK_TO_DEBUGGER options KDB # Enable kernel debugger support # For minimum debugger support (stable branch) use: #options KDB_TRACE # Print a stack trace for a = panic options DDB # Enable the kernel debugger # Extra stuff: #options VERBOSE_SYSINIT=3D0 # Enable verbose sysinit = messages #options BOOTVERBOSE=3D1 #options BOOTHOWTO=3DRB_VERBOSE #options KTR #options KTR_MASK=3DKTR_TRAP ##options KTR_CPUMASK=3D0xF #options KTR_VERBOSE # Disable any extra checking for. . . nooptions DEADLKRES # Enable the deadlock resolver nooptions INVARIANTS # Enable calls of extra sanity = checking nooptions INVARIANT_SUPPORT # Extra sanity checks of = internal structures, required by INVARIANTS nooptions WITNESS # Enable checks to detect = deadlocks and cycles nooptions WITNESS_SKIPSPIN # Don't run witness on spinlocks = for speed nooptions DIAGNOSTIC nooptions MALLOC_DEBUG_MAXZONES # Separate malloc(9) zones nooptions BUF_TRACKING nooptions FULL_BUF_TRACKING The builds do include a bulk for targeting armv7 (so 32-bit compatibility) but that bulk has not started yet in the UFS context. # poudriere jail -jmain-CA7 -i Jail name: main-CA7 Jail version: 14.0-CURRENT Jail arch: arm.armv7 Jail method: null Jail mount: /usr/obj/DESTDIRs/main-CA7-poud Jail fs: =20 Jail updated: 2021-11-16 02:24:57 Jail pkgbase: disabled My networking context is simple context does not provide services outside the local network. The services are normal ones, such as nfs, ssh, and whatever default things. ntpd is in use. distfiles are downloaded during builds. It is not a desktop environment, not even a video card. I've noticed a 2021-Feb-22 report in: = https://forums.freebsd.org/threads/whats-the-error-khelp-module-ertt-unloa= d.79009/ so getting the message does not appear to be unique to my context. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)