fsck on big UFS filesystems (>100TB)

[Stefan Esser]

Am 14.10.20 um 18:19 schrieb Nikita Grechikhin:
> Hi, everyone.
>   
> I have several servers with large UFS partitions (>100TB).
> Physically it is RAID-6 on MegaRaid 9361.
> 
> If i try to run fsck on them, i get same error on all servers:
>   
> Code:
> 
> ** Phase 5 - Check Cyl groups
> fsck_ffs: inoinfo: inumber 18446744071562087424 out of range

This number is near minus 2^31 - without having looked at the
code this smells like an integer overflow.
> inumber is exact same on all servers.
> tested on clean and drity filesystems with same result.
> 
> And without succsessful run of fsck i can't remove dirty flag from filesystem
>   
> This is a fresh install of FreeBSD 12.1 and filesystem created in 12.1 from scratch with default options.

The default options assume an average file size of just a few KB,
and I severely doubt you are going to fill 100 TB with small files.

> This is file storage for videoproduction. So, there is not too much files and they is relatively big.
>   
> Code:
> 
> # find . -type f -print | wc -l
>    251485
>   
> # find . -type d -print | wc -l
>     48351

What fraction of the storage is filled?

You may need to recreate the file system with an appropriate
value if "-i", the number of bytes per inode.

If your files are generally in the order of 1 GB, then you
should try -i 100000000 (i.e. 100 mio to allow for up to
1 million files to have some slack).

> Maybe i doing something wrong?
>   
> Code:
> 
> # uname -a
> FreeBSD *** 12.1-RELEASE FreeBSD 12.1-RELEASE r354233 GENERIC  amd64
> 
> # gpart show mfid3
> => 40  250031243184  mfid3  GPT  (116T)
>     40  250031243184      1  freebsd-ufs  (116T)
> 
> # df -i /mnt/data2
> Filesystem      Size    Used   Avail Capacity iused ifree %iused  Mounted on
> /dev/mfid3p1    116T     15T     91T    14%    300k  3.9G    0%   /mnt/data2

Yes, way too many inodes (4G) - you are wasting space and run
into the fsck issue due to them ...

Regards, STefan
-------------- next part --------------
A non-text attachment was scrubbed...
Name: OpenPGP_signature
Type: application/pgp-signature
Size: 495 bytes
Desc: OpenPGP digital signature
URL: <http://lists.freebsd.org/pipermail/freebsd-fs/attachments/20201014/5aec7134/attachment.sig>