From nobody Mon Jun 03 22:45:46 2024 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VtTNK048cz5LQd4 for ; Mon, 03 Jun 2024 22:46:09 +0000 (UTC) (envelope-from wfdudley@gmail.com) Received: from mail-vs1-xe33.google.com (mail-vs1-xe33.google.com [IPv6:2607:f8b0:4864:20::e33]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VtTNJ13nlz52PP for ; Mon, 3 Jun 2024 22:46:08 +0000 (UTC) (envelope-from wfdudley@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=LySi+eBc; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of wfdudley@gmail.com designates 2607:f8b0:4864:20::e33 as permitted sender) smtp.mailfrom=wfdudley@gmail.com Received: by mail-vs1-xe33.google.com with SMTP id ada2fe7eead31-48a3989641cso1093522137.1 for ; Mon, 03 Jun 2024 15:46:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1717454766; x=1718059566; darn=freebsd.org; h=cc:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=rc+KnUKpndu+9fNlnpduYbnGfBvoFZa+8hd8yLRGRcA=; b=LySi+eBcmR1F6ugFxQp63NAYysqZlVQYzBOI7Y9X20pD0IUnlHglE7P9p+aLSwwp5T 2WKf6r/+Wtdl7j0DEhM5sE8JR/Js6ztKMuYK1HX0zlGE4B8nWlLreogU/Gp9bcGpM/Z+ YWPC0Ov8THEmzTJRDWm2t8IPPMstObWLR04xCdRHy9JAEYo7yv2c8LqoeIY0j3j7xzyK bPy4r8vVsa3i/vhnPdZAxYeJj6jxe1Cwc0pspbhJ2pYaHGRVCvqI75TT93Msnrls8RVP 1kU61IFvvv9X09mmCzjTl8zMVOExWbgXjhZQyUZWmOC0xz3/c2nfG309PHlEDvElmYgx d1vg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1717454766; x=1718059566; h=cc:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=rc+KnUKpndu+9fNlnpduYbnGfBvoFZa+8hd8yLRGRcA=; b=io64p/xi9QJp1rtS27pTScfHY1B/1zHlaeyc65JfQ7EcEUBAZT8swuNSY5veotrN6B ft/+RaV3kJ49qhZTOGf2uu2KTmr6AX4erQ4KFmzMe8iCIiZs/PQ1v7ZxSfFNmg4QHH/U UdIicIfZ2WzwPV38gFZbEprIPcyvF+rwj9wYlO6QfF2DggkjPqpl/Fz16RlRmaCOx+u0 rRQWzqWewfUKFLGIrT+RV7QbB7NU+OE3oeW9RJ4Nn6O+j0Y/2+3A+zUFt2pWwb96m66b qCCpSU21mfmsM3DtYhrxW7PPo3IOrciVmUDefN67akFeXrZrCpm6X3DP+uqaSGguUNp6 JEJQ== X-Gm-Message-State: AOJu0YwVItrTsfHJ9Xn37zO6ZfXO7WPf62w6v7Ea9ZvRpvxgtsC7lH3Q NXxZUo7U7T3ZJ8qhhw9tm10BczaDtq5wTyx+TYscFY7LSAf8DZzDHjaBJ5CCAKmCDaw0MJEvq0j ZNa8BRIBvMT5YgxVTy4zzP8yf2Z5zVA== X-Google-Smtp-Source: AGHT+IG5Qu1Vxegp/qCMWf9+7xWlcElsYIM0S11jNADFTRHM/Gp5kIdp8TIBsVNnX7T1n/lqGErQMsHUYRqVv4WbPV0= X-Received: by 2002:a05:6102:24ae:b0:48b:bf07:5980 with SMTP id ada2fe7eead31-48bc2400df7mr11395903137.33.1717454766288; Mon, 03 Jun 2024 15:46:06 -0700 (PDT) List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-questions@freebsd.org Sender: owner-freebsd-questions@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: William Dudley Date: Mon, 3 Jun 2024 18:45:46 -0400 Message-ID: Subject: Re: help with full zfs "partitions" - can't delete files - SOLVED? Cc: questions@freebsd.org Content-Type: multipart/alternative; boundary="0000000000004337b4061a0419fe" X-Spamd-Bar: / X-Spamd-Result: default: False [-0.93 / 15.00]; MISSING_TO(2.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.93)[-0.926]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; MISSING_XM_UA(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MLMMJ_DEST(0.00)[questions@freebsd.org]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROMTLD(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e33:from] X-Rspamd-Queue-Id: 4VtTNJ13nlz52PP --0000000000004337b4061a0419fe Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable see below On Mon, Jun 3, 2024 at 6:31=E2=80=AFPM Edward Sanford Sutton, III < mirror176@hotmail.com> wrote: > On 6/3/24 13:28, William Dudley wrote: > > The problem: > > > > FreeBSD 13.3 amd64 system, with > > a zfs pool built from two physical drives. > > Mirrored or striped layout? > Striped > > > The zfs pool has 7 "partitions" (is that what they're called?) > > > > I was copying files over from another machine and didn't realize that > > I filled one of the partitions. > > What user? What command(s)? > as root, by doing rsync from another machine's disk that is an NFS mount. > > > I can't proceed now with this one full partition. > > If the pool is full, all datasets on it should be impacted instead of > just one. > > > Every single command fails due to "out of space". > > > > That includes: > > rm (one file or many) > > dd if=3D/dev/zero of=3D(some file) > > truncate (somefile) > > zfs destroy poolname/partitionname > > cannot destroy 'poolname/partitionname': out of space > > Tried as root? Users are limited from filling a partition fully. I > thought ZFS always forces a certain amount be free to avoid issues like > being unable to COW write to delete data. > All commands as root. > > > There are no snapshots, I never created any. > > > > Extensive googling has not shown any more than bug reports acknowledgin= g > > that this is a problem. > > > > How do I fix this, short of burning the machine to the ground and > > starting over? > > > > Thanks, > > Bill Dudley > > > > This email is free of malware because I run Linux. > > No system, Linux included, can guarantee that. I have Linux malware > infested botnets reaching out to me every day though 'usually' not by > email. > I know, but it's "mostly" true, compared to people running Winders. ANYWAY, this might be "solved", in the sense that I have a work around. Paul Procacci emailed me a suggestion to try this: sysctl -w vfs.zfs.spa.slop_shift=3D6 and if that doesn't work, try 7 or 8. A setting of 7 allows me to delete files. Not sure if this lets me fully clean up the mess, but so far, so good. Bill Dudley --0000000000004337b4061a0419fe Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
see below


On Mon, Jun 3= , 2024 at 6:31=E2=80=AFPM Edward Sanford Sutton, III <mirror176@hotmail.com> wrote:
On 6/3/24 13:28, William Dudley= wrote:
> The problem:
>
> FreeBSD 13.3 amd64 system, with
> a zfs pool built from two physical drives.

Mirrored or striped layout?

Striped=C2= =A0

> The zfs pool has 7 "partitions" (is that what they're ca= lled?)
>
> I was copying files over from another machine and didn't realize t= hat
> I filled one of the partitions.

What user? What command(s)?

as root, by= doing rsync from another machine's disk that is an NFS mount.=C2=A0

> I can't proceed now with this one full partition.

If the pool is full, all datasets on it should be impacted instead of
just one.

> Every single command fails due to "out of space".
>
> That includes:
> rm (one file or many)
> dd if=3D/dev/zero of=3D(some file)
> truncate (somefile)
> zfs destroy poolname/partitionname
> cannot destroy 'poolname/partitionname': out of space

Tried as root? Users are limited from filling a partition fully. I
thought ZFS always forces a certain amount be free to avoid issues like being unable to COW write to delete data.

All commands as root.=C2=A0

> There are no snapshots, I never created any.
>
> Extensive googling has not shown any more than bug reports acknowledgi= ng
> that this is a problem.
>
> How do I fix this, short of burning the machine to the ground and
> starting over?
>
> Thanks,
> Bill Dudley
>
> This email is free of malware because I run Linux.

No system, Linux included, can guarantee that. I have Linux malware
infested botnets reaching out to me every day though 'usually' not = by email.

I know, but it's "mo= stly" true, compared to people running Winders.

ANYWAY, this might be "solved", in the sense that I have a wor= k around.
Paul Procacci emailed me a suggestion to try this:
<= /div>
sysctl -w vfs.zfs.spa.slop_shift=3D6
and if that doesn't work, try 7 or 8.=C2=A0 A setting= of 7 allows me to delete files.
Not sure if this lets me fully c= lean up the mess, but so far, so good.

Bill Dudley= =C2=A0
--0000000000004337b4061a0419fe--