From nobody Mon Nov 25 17:32:00 2024 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xxt7h52vFz5dwWp for ; Mon, 25 Nov 2024 17:32:32 +0000 (UTC) (envelope-from dan@langille.org) Received: from fhigh-b2-smtp.messagingengine.com (fhigh-b2-smtp.messagingengine.com [202.12.124.153]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xxt7h07Fhz4MGb for ; Mon, 25 Nov 2024 17:32:31 +0000 (UTC) (envelope-from dan@langille.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=langille.org header.s=fm1 header.b="IwNa/9LO"; dkim=pass header.d=messagingengine.com header.s=fm1 header.b=uqneobsP; spf=pass (mx1.freebsd.org: domain of dan@langille.org designates 202.12.124.153 as permitted sender) smtp.mailfrom=dan@langille.org; dmarc=pass (policy=none) header.from=langille.org Received: from phl-compute-06.internal (phl-compute-06.phl.internal [10.202.2.46]) by mailfhigh.stl.internal (Postfix) with ESMTP id 3BB7C2540085 for ; Mon, 25 Nov 2024 12:32:31 -0500 (EST) Received: from phl-imap-08 ([10.202.2.84]) by phl-compute-06.internal (MEProxy); Mon, 25 Nov 2024 12:32:31 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=langille.org; h= cc:content-transfer-encoding:content-type:content-type:date:date :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm1; t=1732555951; x=1732642351; bh=weykj9WfPg9wqoSKvkeDZVQ27RqUBUJYBWSM0chQ+xQ=; b= IwNa/9LOOPTQWgPhCEdtZn9uoXUAAUNEVFjHQIxojCU6djEWwEkh/V9tm+LR1jwD hqBBMDh32eiEu6GoU8D+OHKNDOtRjRO5Kv0Wz5avO5MQ1mAPh18sbWYG7K5N87/b F3zacXSIjM6cESsNHBb663nrz0zNWxYMZiy08Y3i1yjjBkMMonPxwVlCxrR2daPA m1hU0JPWRXaQUtWHuNwog9GRl94XvETdIQVImafvVr6wDhj9iy2vz6EebXupvyFj Hd99Cwgrt33YG7nFLXzCL1pplDZ7hK7h6zg+aZZKn5hrFhM9upgWpXqxTzs/JeaP hlsr825xxMPEbPuNqOP+EA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:subject:subject:to:to:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm1; t=1732555951; x=1732642351; bh=w eykj9WfPg9wqoSKvkeDZVQ27RqUBUJYBWSM0chQ+xQ=; b=uqneobsPCl9N05Izd CuL17JA0KxdYV0oxIpRgn2odhQOiV6t1zGWs5tvGcOECAJyRKusbqCMtrW8rFNk6 Y7UzxbeeO0mXD4QRxPlAVkEP1OLu+D6FVOgXVkq/W3DE85rLCSqD6MG2uueOQ7fz KwVD2MhtBsGh9x8QIykJHqxPngElDcG2Lg4HRD+Ey7awCcQEK4F2mYGZaOgIxRAL mWEzoFNHsXkhPE+2tvgggKJnPlYq42XdGHH1OuqXHZe78xhkISkJJiy3q42S4uDm cEAKfGK3pdlPj3YgqNN8/KWa1BsxDjXdPXmSc+RfOW8OIGWAljX8XKFNFgUY4cO4 TDoTg== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefuddrgeehgddutddtucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggvpdfu rfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpefoggffhf fvkfgjfhfutgfgsehtjeertdertddtnecuhfhrohhmpedfffgrnhcunfgrnhhgihhllhgv fdcuoegurghnsehlrghnghhilhhlvgdrohhrgheqnecuggftrfgrthhtvghrnheptdevge ejiefhffetudetkedvgfevhefftdeggfdvtdegheefjeehjedtgfeuueegnecuvehluhhs thgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepuggrnheslhgrnhhgih hllhgvrdhorhhgpdhnsggprhgtphhtthhopedupdhmohguvgepshhmthhpohhuthdprhgt phhtthhopehquhgvshhtihhonhhssehfrhgvvggsshgurdhorhhg X-ME-Proxy: Feedback-ID: ifbf9424e:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id CB16A18A006E; Mon, 25 Nov 2024 12:32:30 -0500 (EST) X-Mailer: MessagingEngine.com Webmail Interface List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-questions@freebsd.org Sender: owner-freebsd-questions@FreeBSD.org MIME-Version: 1.0 Date: Mon, 25 Nov 2024 12:32:00 -0500 From: "Dan Langille" To: questions@freebsd.org Message-Id: In-Reply-To: <325967b5-f5f4-43b6-9f7b-39c2f4793a81@app.fastmail.com> References: <22042f18-4cbb-4f62-841b-fef4a7262899@app.fastmail.com> <1c49d4a22aefd22541a526d387912eb3@dalescott.net> <20241031225337.288E8A4F1F81@ary.qy> <382f9b53-0d5e-0fd3-5d9f-9d1a8954dd5b@iecc.com> <00907865-86c5-4fb4-bc3f-0c795de2f6fc@taugh.com> <325967b5-f5f4-43b6-9f7b-39c2f4793a81@app.fastmail.com> Subject: Re: dma: could not pick up queue file Content-Type: text/plain Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-4.09 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[langille.org,none]; R_DKIM_ALLOW(-0.20)[langille.org:s=fm1,messagingengine.com:s=fm1]; R_SPF_ALLOW(-0.20)[+ip4:202.12.124.128/27]; RCVD_IN_DNSWL_LOW(-0.10)[202.12.124.153:from]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; FREEFALL_USER(0.00)[dan]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[questions@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[langille.org:+,messagingengine.com:+] X-Rspamd-Queue-Id: 4Xxt7h07Fhz4MGb X-Spamd-Bar: ---- On Sun, Nov 10, 2024, at 7:37 AM, Dan Langille wrote: > On Tue, Nov 5, 2024, at 3:35 PM, Daniel Tameling wrote: >> On Sun, Nov 03, 2024 at 08:58:21AM -0500, Dan Langille wrote: >>> >>> Based on that, I'll add this to /etc/periodic.conf: >>> >>> # disable queuerun_enable to avoid conflict with dma >>> daily_queuerun_enable="NO" >>> >>> That comment is just to remind me what it's for. >>> >>> Now it's just a matter of time. If there are no more incidents, I say you've solved it. Let's give it a few weeks. >>> >>> Thank you. Good job. :) >> >> Thanks. If something is running automatically that isn't started by >> cron, periodic is always a good candidate. >> >> Btw.: there still is a dma port and its pkg-message says: >> >> And you can disable some sendmail specific daily maintenance routines in your >> /etc/periodic.conf file: >> >> daily_clean_hoststat_enable="NO" >> daily_status_mail_rejects_enable="NO" >> daily_status_include_submit_mailq="NO" >> daily_submit_queuerun="NO" > > That is a good find. Perhaps that should be added to the FreeBSD man > page / docs for dma. For those following along at home, this is a good > way to get more involved with the FreeBSD project. > > I'll talk more about those below. > >> The last one almost looks like what you set. The man page says: >> >> daily_queuerun_enable >> (bool) Set to "YES" if you want to manually run the mail queue >> at least once a day. >> >> daily_submit_queuerun >> (bool) Set to "YES" if you also want to manually run the submit >> mail queue at least once a day when daily_queuerun_enable is >> set to "YES". >> >> So it looks like you found the parent of daily_submit_queuerun. >> Hopefully that fixes the issue. > > I came to the mailing list to report upon progress. > > Over the past 7 days, there has been one incident. That was on a host > which did not have any remediation - it did not have > daily_queuerun_enable="NO" set. > > Note that the error message in question was slightly different from > originally reported. The timing (around 0300 UTC, which is the time > daily periodic scripts are run) is right. > > Nov 10 03:01:37 dev-pgeu dma[55d33.377910848050][79105]: could not > acquire queue file: No such file or directory > > The original was: > > Oct 18 03:01:00 x8dtu-pg01 dma[dma][92883]: could not pick up queue > file: > `/var/spool/dma/Q5993d.326f7fa48050'/`/var/spool/dma/M5993d.326f7fa48050': > No such file or directory > > I have since added the four directives you mention to that host and > I'll spread that around to other hosts as well. > > Thank you. The problem has not occurred since this change. -- Dan Langille dan@langille.org