Re: help with full zfs "partitions" - can't delete files - SOLVED?

From: William Dudley <wfdudley_at_gmail.com>
Date: Mon, 03 Jun 2024 22:45:46 UTC
see below


On Mon, Jun 3, 2024 at 6:31 PM Edward Sanford Sutton, III <
mirror176@hotmail.com> wrote:

> On 6/3/24 13:28, William Dudley wrote:
> > The problem:
> >
> > FreeBSD 13.3 amd64 system, with
> > a zfs pool built from two physical drives.
>
> Mirrored or striped layout?
>

Striped

>
> > The zfs pool has 7 "partitions" (is that what they're called?)
> >
> > I was copying files over from another machine and didn't realize that
> > I filled one of the partitions.
>
> What user? What command(s)?
>

as root, by doing rsync from another machine's disk that is an NFS mount.

>
> > I can't proceed now with this one full partition.
>
> If the pool is full, all datasets on it should be impacted instead of
> just one.
>
> > Every single command fails due to "out of space".
> >
> > That includes:
> > rm (one file or many)
> > dd if=/dev/zero of=(some file)
> > truncate (somefile)
> > zfs destroy poolname/partitionname
> > cannot destroy 'poolname/partitionname': out of space
>
> Tried as root? Users are limited from filling a partition fully. I
> thought ZFS always forces a certain amount be free to avoid issues like
> being unable to COW write to delete data.
>

All commands as root.

>
> > There are no snapshots, I never created any.
> >
> > Extensive googling has not shown any more than bug reports acknowledging
> > that this is a problem.
> >
> > How do I fix this, short of burning the machine to the ground and
> > starting over?
> >
> > Thanks,
> > Bill Dudley
> >
> > This email is free of malware because I run Linux.
>
> No system, Linux included, can guarantee that. I have Linux malware
> infested botnets reaching out to me every day though 'usually' not by
> email.
>

I know, but it's "mostly" true, compared to people running Winders.

ANYWAY, this might be "solved", in the sense that I have a work around.
Paul Procacci emailed me a suggestion to try this:
sysctl -w vfs.zfs.spa.slop_shift=6
and if that doesn't work, try 7 or 8.  A setting of 7 allows me to delete
files.
Not sure if this lets me fully clean up the mess, but so far, so good.

Bill Dudley