From nobody Sat Nov 09 12:06:21 2024 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xlvfy6h2Lz5c3rj for ; Sat, 09 Nov 2024 12:06:34 +0000 (UTC) (envelope-from girgen@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xlvfy54Z5z4qpV; Sat, 9 Nov 2024 12:06:34 +0000 (UTC) (envelope-from girgen@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1731153994; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=g4acKkrxIx1aDYcgvsAwS/+AzAJdD2cAhG+q9xb9Hik=; b=D5BrpLN4kvETP/Y+zNjQtbzjD+yBiq0+d1rrmt3dlnD3UH2QwxROxwIDFOHNSwxNWCMnVa 9MQN0jc6MeS6hbE9TcGhSi5o1OyrUTxmw0ivoITuB7wiTHAbkzJQhXoz0cG9GezIqLAVCp wj6LWUhITzR2SJXhcY9unyaY21JIdVJKIdsDoIcXfMRexYpsRa5zZnGvBq7boaY8sF2eBM Bt+TpHxv5eno6A+ek16UcvoiCk5n5FSdHUrcMrNjwEuTcnOckRkXR/SpKUE/Ox+WW1eFRz fEcylglRMW9spNN33C79s2INfmcEGowcyWblsEN85lXDguITKMR2hwvjU8ZxuA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1731153994; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=g4acKkrxIx1aDYcgvsAwS/+AzAJdD2cAhG+q9xb9Hik=; b=shFBGrAy7/pwNHVZ5i8dqDCNl+83VfskKvCub6j/CaQ2ULacrq/1iLTTRFqkNkgZVm3+Dq lS/n1UUzjwY+SJxlVqeSttFiqi0b8lUJmeC+v/I308+KhTy6Z1v1iPWGuk0HxuvF9bikMM l0Y7ZTuAoBb3L83wCb+8WQXoVPgEtyZl2fnhGLWUjOE+fepTED0ufaM4WX9PcDVQ49BC/t KdgVa+yBAqEtDlipwzLD7EW93kgkEyHtYRdRCcfFpbL5yyCUBuRqlf0/yM1hvimM/YP6I/ SnuOIIq7KnTV2qphbHZsh6PSyQCwMyLQUfglZ5yUee6+XieZhrCKvq8sle4jlw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1731153994; a=rsa-sha256; cv=none; b=CO5Q+IC0BPCvPA1rTs02lYiAQdkkX/9nRxTfiQXkx+BWXKfQ8H/6E44mqgeVG0ZfemAYZU dD93OkACXnvxF3fvTQlVvt6K0sATTmjh7v/UQLQ4iapM8CdLXctHvza5jZklWDa8CiWD/0 rCT8FMXB8JG3iJYMJStCeHze8T6N5VnqwsIdPegMcWLdDfMJjW1dcHEC28QlWEfe/Ch+bh c7e13Bw7Hwjj/rl/fc0PxQX3UnkTZc5Stn8n08S7JxziiKf7wH9F3BBIulnH4sWy2xVSrB MgeCzEb3lwA7Btig88F//qdsK3aA8iNHXkmaD/ySvw5hQv0vuqLR8TXC3yhzQA== Received: from smtpclient.apple (h-213-164-202-49.A498.priv.bahnhof.se [213.164.202.49]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: girgen/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Xlvfy27Z9z1Mwg; Sat, 9 Nov 2024 12:06:33 +0000 (UTC) (envelope-from girgen@FreeBSD.org) Content-Type: text/plain; charset=us-ascii List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.200.121\)) Subject: Re: zfs snapshot corruption when using encryption From: Palle Girgensohn In-Reply-To: Date: Sat, 9 Nov 2024 13:06:21 +0100 Cc: freebsd-fs@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <03E4CCF5-0F9A-4B0E-A9DA-81C7C677860C@FreeBSD.org> <3E85AAAE-8B1E-47C7-B581-E3D98AB03907@FreeBSD.org> To: void X-Mailer: Apple Mail (2.3826.200.121) > 9 nov. 2024 kl. 02:59 skrev void : >=20 > On Fri, Nov 08, 2024 at 11:11:23PM +0100, Palle Girgensohn wrote: >=20 >> $ freebsd-version -ku >> 14.0-RELEASE-p10 >> 14.0-RELEASE-p10 >>=20 >> dunno how to present in the above fashion? Binary install, not from = source. >=20 > % zfs version >=20 >> The latter, zfs per-filesystem zfs encryption. I haven't heard any = horror stories about it, albeit it's quite fresh code. >=20 > I'm wrong about native zfs encryption not being on 14.0. Seems like it = is. https://www.freebsd.org/releases/14.0R/relnotes/ >=20 > I'm reading this bit: >=20 > ### > ZFS Changes >=20 > OpenZFS has been upgraded to version 2.2. New features include: >=20 > block cloning, which allows shallow copies of blocks in file copies. = This is optional, and disabled by default; it can be enabled with sysctl = vfs.zfs.bclone_enabled=3D1. >=20 > scrub error log (zpool scrub -e) > BLAKE3 checksums, which are fast, and are now the recommended secure = checksums > corrective zfs receive can heal corrupted data vdev and zpool user = properties, similar to dataset user properties. > ### >=20 > Then again, 14.0 is EoL. >=20 >> Na, it's JBOD alright. I see nothing weird with the disks. >=20 >>> Reallocated_Sector_Ct >>> Reported_Uncorrect >>> Current_Pending_Sector >>> Offline_Uncorrectable >=20 > Were all these values '0' ? I don't see the props at all. >=20 > Using truss might give a clue about the failure: >=20 > # truss -o /tmp/truss.out zfs-send-commands >=20 > make sure the outfile is made in a place with lots of spare space. At present I don't have an error, had to remove the snapshot and run = zpool scrub -e, to get the zfs send propagation working. We see these = error popping up every other day, so I'll get a truss once we get the = next problematic snapshot. Box is updated to 14.1, FWIW. Palle