FreeBSD 12.2-RELEASE-p9 trim (ZFS, not OpenZFS): open failed: /dev/ada0: Operation not permitted

[Graham Perrin]

On 31/08/2021 02:06, David Christensen wrote:
> On 8/30/21 2:16 AM, Graham Perrin wrote:
>> On 30/08/2021 08:45, David Christensen wrote:
>>
>>> … created with FreeBSD-12.1-RELEASE-amd64-memstick on a USB flash 
>>> drive with ZFS boot, encrypted swap, and encrypted ZFS root.
>>>
>>>
>>>> If so: with or without OpenZFS kernel module?
>>>
>>>
>>> ZFS kernel module is loaded:
>>>
>>> 2021-08-30 00:30:42 toor at f3 ~
>>> # kldstat
>>> Id Refs Address                Size Name
>>>  1   23 0xffffffff80200000  227ae98 kernel
>>>  2    1 0xffffffff8247c000    1e7b0 geom_eli.ko
>>>  3    2 0xffffffff8249b000     a448 opensolaris.ko
>>>  4    1 0xffffffff824a8000     ee98 aesni.ko
>>>  5    1 0xffffffff824b7000   3bad38 zfs.ko
>>>  6    1 0xffffffff82872000    27c00 geom_mirror.ko
>>>  7    1 0xffffffff8289a000    27ce8 fuse.ko
>>>  8    1 0xffffffff82b21000      acf mac_ntpd.ko
>>>
>>> …
>>
>>
>> Thanks. Simply installing sysutils/openzfs will get you a relevant 
>> manual page:
>>
>> man 8 zpool-trim
>>
>> – and `zpool trim` (alone) will run (tested in VirtualBox), however: 
>> _without_ an OpenZFS-enabled boot, I'd be wary of specifying a pool 
>> to be trimmed. Here be dragons?
>
>
> Thank you for the response.  :-)
>
>
> I installed the package "openzfs":
>
> 2021-08-30 17:54:40 toor at f2 ~
> # pkg install -y openzfs
> Updating FreeBSD repository catalogue...
> FreeBSD repository is up to date.
> All repositories are up to date.
> The following 2 package(s) will be affected (of 0 checked):
>
> New packages to be INSTALLED:
>     openzfs: 2021062100
>     openzfs-kmod: 2021062100
>
> Number of packages to be installed: 2
>
> The process will require 22 MiB more space.
> 4 MiB to be downloaded.
> [1/2] Fetching openzfs-2021062100.txz: 100%    3 MiB 365.1kB/s 00:08
> [2/2] Fetching openzfs-kmod-2021062100.txz: 100%    1 MiB 1.2MB/s 00:01
> Checking integrity... done (0 conflicting)
> [1/2] Installing openzfs-kmod-2021062100...
> [1/2] Extracting openzfs-kmod-2021062100: 100%
> [2/2] Installing openzfs-2021062100...
> [2/2] Extracting openzfs-2021062100: 100%
>
>
> The man page is there:
>
> 2021-08-30 18:00:33 toor at f2 ~
> # man zpool-trim | head -n 7
> ZPOOL-TRIM(8)           FreeBSD System Manager's Manual ZPOOL-TRIM(8)
>
> NAME
>      zpool-trim - initiate TRIM of free space in ZFS storage pool
>
> SYNOPSIS
>      zpool trim [-dw] [-r rate] [-c|-s] pool [device]<?>
>
>
> When I try to trim a pool that is on an SSD:
>
> 2021-08-30 18:01:18 toor at f2 ~
> # zpool trim bootpool 2>&1 | head -n 1
> unrecognized command 'trim'
>
>
> When I try to load the kernel module:
>
> 2021-08-30 18:01:22 toor at f2 ~
> # kldload openzfs
> kldload: an error occurred while loading module openzfs. Please check 
> dmesg(8) for more details.
>
> 2021-08-30 18:02:10 toor at f2 ~
> # dmesg | tail -n 2
> interface zfsctrl.1 already present in the KLD 'zfs.ko'!
> linker_load_file: /boot/modules/openzfs.ko - unsupported file type
>
>
> zpool-trim(8) mentions an "autotrim" property, but my pool does not 
> seem to have it:
>
> 2021-08-30 18:03:14 toor at f2 ~
> # zpool get all bootpool | grep -i trim
>
>
> Suggestions?
>
>
> David


% pkg query %M openzfs openzfs-kmod


%

– strange; openzfs-kmod should probably have a package message.

/boot/loader.conf can be edited to include:

zfs_load="NO"
openzfs_load="YES"

– HOWEVER I recommend creating then activating a new boot environment 
before doing so (and before any future update to 12.0-RELEASE). Given 
the possibility of the pre-packaged kernel module not working, be 
prepared to build and install from ports.

(If the module will not load, you'll be unable to boot. If this happens, 
you can boot a good environment then use `bectl mount` to temporarily 
access the affected environment, then revert the two lines in its 
loader.conf.)

If the pool will require an upgrade, for what you'd like to do with 
TRIM, be extremely cautious about upgrading a FreeBSD 12 boot pool.