ZFS and disk usage

[Volodymyr Kostyrko]

Mark Schouten wrote:
>> Just curious, what `ls -la /storage/' and `ls -la /storage/.zfs/s*` show?

It's plain weird.

>
> [root at storage ~]# zfs list -o name,used,referenced,usedbychildren,usedbydataset,usedbysnapshots,available,mountpoint,quota,reserv,refquota,refreserv "$@" | sed -r "s/none/   -/g"
> NAME                                    USED  REFER  USEDCHILD  USEDDS  USEDSNAP  AVAIL  MOUNTPOINT  QUOTA  RESERV  REFQUOTA  REFRESERV
> storage                                1.60T   431G      1.18T    431G         0   138G  /storage        -       -         -          -
> storage/av.https-ict.nl..OS               20G    16K          0     16K         0   158G  -               -       -         -        20G
> storage/bestandonline.https-ict.nl.OS    20G    16K          0     16K         0   158G  -               -       -         -        20G

Let's take this one for example. It's not mounted! It shouldn't be 
listed in next command output.

> storage/crm.fastbenelux.DATA            100G    16K          0     16K         0   238G  -               -       -         -       100G
> storage/crm.fastbenelux.OS               20G    16K          0     16K         0   158G  -               -       -         -        20G
> storage/default.do.not.remove             1G    16K          0     16K         0   139G  -               -       -         -         1G
> storage/mail.https-ict.nl.DATA          400G    16K          0     16K         0   538G  -               -       -         -       400G
> storage/mail.https-ict.nl.OS             20G    16K          0     16K         0   158G  -               -       -         -        20G
> storage/webserver.https-ict.nl.DATA     400G    16K          0     16K         0   538G  -               -       -         -       400G
> storage/webserver.https-ict.nl.OS        20G    16K          0     16K         0   158G  -               -       -         -        20G
> storage/webserver2.https-ict.nl.DATA     20G    16K          0     16K         0   158G  -               -       -         -        20G
> storage/webserver2.https-ict.nl.OS       20G    16K          0     16K         0   158G  -               -       -         -        20G
> storage/xlmail.xladsl.nl.DATA           150G    16K          0     16K         0   288G  -               -       -         -       150G
> storage/xlmail.xladsl.nl.os              20G    16K          0     16K         0   158G  -               -       -         -        20G
>
> [root at storage /storage]# ls -al
> total 452101743
> drwxr-xr-x   2 root  wheel            18 Mar 24 17:42 .
> drwxr-xr-x  20 root  wheel           512 May 10  2011 ..
> -rw-r--r--   1 root  wheel   21474836480 Apr 16 12:40 av.https-ict.nl.OS
> -rw-r--r--   1 root  wheel  155692564480 Mar 24 17:42 bestandonline.https-ict.nl.DATA
> -rw-r--r--   1 root  wheel   21474836480 Apr  5 12:19 bestandonline.https-ict.nl.OS

This is not a zfs dataset. This is a file. It has no relevance to named 
dataset. And it drains space from /storage.

> -rw-r--r--   1 root  wheel  107374182400 Apr 16 12:40 crm.fastbenelux.DATA
> -rw-r--r--   1 root  wheel   21474836480 Apr 16 12:39 crm.fastbenelux.OS
> -rw-r--r--   1 root  wheel    1073741824 Apr  5 12:19 default.do.not.remove
> -rw-r--r--   1 root  wheel   10737418240 May 12  2011 documentatievm.https-ict.nl
> -rw-r--r--   1 root  wheel  429496729600 Apr 15 02:07 mail.https-ict.nl.DATA
> -rw-r--r--   1 root  wheel   21474836480 Apr 16 12:40 mail.https-ict.nl.OS
> -rw-r--r--   1 root  wheel   16106127360 May 16  2011 testvm1.https-ict.nl
> -rw-r--r--   1 root  wheel  429496729600 Apr 16 12:40 webserver.https-ict.nl.DATA
> -rw-r--r--   1 root  wheel   21474836480 Apr 16 12:40 webserver..https-ict.nl.OS
> -rw-r--r--   1 root  wheel   21474836480 Apr  5 12:19 webserver2.https-ict.nl.DATA
> -rw-r--r--   1 root  wheel   21474836480 Apr 16 12:40 webserver2.https-ict.nl.OS
> -rw-r--r--   1 root  wheel  161061273600 Apr 16 12:40 xlmail.xladsl.nl.DATA
> -rw-r--r--   1 root  wheel   21474836480 Apr 16 12:40 xlmail.xladsl.nl.os
>
> [root at storage /storage]# ls -la /storage/.zfs/s*
> /storage/.zfs/shares:
> total 2
> dr-xr-xr-x  2 root  wheel  2 May 10  2011 .
> dr-xr-xr-x  4 root  wheel  4 May 10  2011 ..
>
> /storage/.zfs/snapshot:
> total 0
> dr-xr-xr-x  2 root  wheel  2 May 10  2011 .
> dr-xr-xr-x  4 root  wheel  4 May 10  2011 ..

There's also another discrepancies in your output like:
  * "av.https-ict.nl..OS" != "av.https-ict.nl.OS", seems like 
copy-and-paste error(?);
  * "bestandonline.https-ict.nl.DATA" and "documentatievm.https-ict.nl" 
doesn't exist in datasets, it looks like correspondent datasets were 
already removed, but not files.

> It definitly looks like the reserved space for the zvols is counted in /storage, but the written data is counted for /storage as well, instead of the zvols..
>
> Will an upgrade fix this?
>

-- 
Sphinx of black quartz judge my vow.