From nobody Mon Apr 11 21:51:03 2022 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0423311CF8A5 for ; Mon, 11 Apr 2022 21:51:15 +0000 (UTC) (envelope-from dclarke@blastwave.org) Received: from mail.oetec.com (mail.oetec.com [108.160.241.186]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.oetec.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KcjGp1Kwwz3vPj for ; Mon, 11 Apr 2022 21:51:14 +0000 (UTC) (envelope-from dclarke@blastwave.org) X-Spam-Status: No X-oetec-MailScanner-From: dclarke@blastwave.org X-oetec-MailScanner-SpamCheck: not spam, SpamAssassin (not cached, score=-4.721, required 6, autolearn=not spam, ALL_TRUSTED -1.00, BAYES_00 -1.90, DKIM_SIGNED 0.10, DKIM_VALID -0.10, DKIM_VALID_AU -0.10, DKIM_VALID_EF -0.10, NICE_REPLY_A -1.62, T_FILL_THIS_FORM_SHORT 0.01, T_SCC_BODY_TEXT_LINE -0.01, URIBL_BLOCKED 0.00) X-oetec-MailScanner: Found to be clean X-oetec-MailScanner-ID: 23BLp3ff003840 X-oetec-MailScanner-Information: Please contact oetec for more information Received: from [10.14.0.14] (static-198-54-132-57.cust.tzulo.com [198.54.132.57]) (authenticated bits=0) by mail.oetec.com (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 23BLp3ff003840 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Mon, 11 Apr 2022 17:51:04 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=blastwave.org; s=default; t=1649713865; bh=4g+JRBuYCQ3VHNzc9RN7wSscW0i3EkPsVevCwwp8cdY=; h=Date:Subject:To:References:From:In-Reply-To:From; b=MDZ9w/bdzZjehWUsxqMVTOgv0+KcyiA2RWtjhZKFtEm8vndD7/0IE5g385dKBU45I 5Wl9/kN6AT0tQ1IoNIQeBDi1Is4p0UlgQ03QX4V53plGuAjSaeT8O2hodTi3VID4gM n21PcBelIoQ5quCiqzUe9WssFkgtelvWcMChST1cUuNbCGoO4o6iY9KjjSS0+jLZIG sXDTCDPwG3S1T0fEBdL/jd+eRdf5UZZMMDHBWmWeM1VT/eO01WBvgKUPRd/3VheWU1 nlSm/EuaIc586FcPfX0MMPWwYS9lDb3v9MuSF0Sy5dO/LCEYO+c6LvZgrz/uUqUHUx 8KGrRtsVYItXg== Message-ID: <3f666c51-d884-9b8f-04ff-bb0edf57f37a@blastwave.org> Date: Mon, 11 Apr 2022 17:51:03 -0400 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Subject: Re: main-n254654-d4e8207317c results in "no pools available to import" Content-Language: en-US To: freebsd-current@freebsd.org References: <778a795c-5413-9c79-5312-e34dd6bb29c1@blastwave.org> From: Dennis Clarke In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4KcjGp1Kwwz3vPj X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=blastwave.org header.s=default header.b="MDZ9w/bd"; dmarc=pass (policy=quarantine) header.from=blastwave.org; spf=pass (mx1.freebsd.org: domain of dclarke@blastwave.org designates 108.160.241.186 as permitted sender) smtp.mailfrom=dclarke@blastwave.org X-Spamd-Result: default: False [-4.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[blastwave.org:s=default]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DKIM_TRACE(0.00)[blastwave.org:+]; DMARC_POLICY_ALLOW(-0.50)[blastwave.org,quarantine]; RCVD_IN_DNSWL_MED(-0.20)[108.160.241.186:from]; MLMMJ_DEST(0.00)[freebsd-current]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:812, ipnet:108.160.240.0/20, country:CA]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N > > Up until now you are the only one with this error on the mailinglist > today. So I doubt something is borked. > You could consider to share more details about your setup to help people > to think along with you. > Nothing remotely interesting. I managed to boot kernel.old from the boot loader and reverted to : root@phobos:/usr/src # root@phobos:/usr/src # uname -apKU FreeBSD phobos 14.0-CURRENT FreeBSD 14.0-CURRENT #4 main-n253712-0784121c963: Fri Mar 11 03:59:31 UTC 2022 root@phobos:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 amd64 1400053 1400053 root@phobos:/usr/src # Where the zpool is the lone NVME device in this Lenovo laptop : root@phobos:/usr/src # zpool status pool: c3 state: ONLINE status: Some supported and requested features are not enabled on the pool. The pool can still be used, but some features are unavailable. action: Enable all features using 'zpool upgrade'. Once this is done, the pool may no longer be accessible by software that does not support the features. See zpool-features(7) for details. config: NAME STATE READ WRITE CKSUM c3 ONLINE 0 0 0 nvd0p4 ONLINE 0 0 0 errors: No known data errors root@phobos:/usr/src # That is an interesting message about the zpool there. So zpool upgrade -v says : root@phobos:/usr/src # root@phobos:/usr/src # zpool upgrade -v This system supports ZFS pool feature flags. The following features are supported: FEAT DESCRIPTION ------------------------------------------------------------- async_destroy (read-only compatible) Destroy filesystems asynchronously. empty_bpobj (read-only compatible) Snapshots use less space. lz4_compress LZ4 compression algorithm support. multi_vdev_crash_dump Crash dumps to multiple vdev pools. spacemap_histogram (read-only compatible) Spacemaps maintain space histograms. enabled_txg (read-only compatible) Record txg at which a feature is enabled hole_birth Retain hole birth txg for more precise zfs send extensible_dataset Enhanced dataset functionality, used by other features. embedded_data Blocks which compress very well use even less space. bookmarks (read-only compatible) "zfs bookmark" command filesystem_limits (read-only compatible) Filesystem and snapshot limits. large_blocks Support for blocks larger than 128KB. large_dnode Variable on-disk size of dnodes. sha512 SHA-512/256 hash algorithm. skein Skein hash algorithm. edonr Edon-R hash algorithm. userobj_accounting (read-only compatible) User/Group object accounting. encryption Support for dataset level encryption project_quota (read-only compatible) space/object accounting based on project ID. device_removal Top-level vdevs can be removed, reducing logical pool size. obsolete_counts (read-only compatible) Reduce memory used by removed devices when their blocks are freed or remapped. zpool_checkpoint (read-only compatible) Pool state can be checkpointed, allowing rewind later. spacemap_v2 (read-only compatible) Space maps representing large segments are more efficient. allocation_classes (read-only compatible) Support for separate allocation classes. resilver_defer (read-only compatible) Support for deferring new resilvers when one is already running. bookmark_v2 Support for larger bookmarks redaction_bookmarks Support for bookmarks which store redaction lists for zfs redacted send/recv. redacted_datasets Support for redacted datasets, produced by receiving a redacted zfs send stream. bookmark_written Additional accounting, enabling the written# property (space written since a bookmark), and estimates of send stream sizes for incrementals from bookmarks. log_spacemap (read-only compatible) Log metaslab changes on a single spacemap and flush them periodically. livelist (read-only compatible) Improved clone deletion performance. device_rebuild (read-only compatible) Support for sequential mirror/dRAID device rebuilds zstd_compress zstd compression algorithm support. draid Support for distributed spare RAID zilsaxattr (read-only compatible) Support for xattr=sa extended attribute logging in ZIL. The following legacy versions are also supported: VER DESCRIPTION --- -------------------------------------------------------- 1 Initial ZFS version 2 Ditto blocks (replicated metadata) 3 Hot spares and double parity RAID-Z 4 zpool history 5 Compression using the gzip algorithm 6 bootfs pool property 7 Separate intent log devices 8 Delegated administration 9 refquota and refreservation properties 10 Cache devices 11 Improved scrub performance 12 Snapshot properties 13 snapused property 14 passthrough-x aclinherit 15 user/group space accounting 16 stmf property support 17 Triple-parity RAID-Z 18 Snapshot user holds 19 Log device removal 20 Compression using zle (zero-length encoding) 21 Deduplication 22 Received properties 23 Slim ZIL 24 System attributes 25 Improved scrub stats 26 Improved snapshot deletion performance 27 Improved snapshot creation performance 28 Multiple vdev replacements For more information on a particular version, including supported releases, see the ZFS Administration Guide. root@phobos:/usr/src # Where the zpool version info says : root@phobos:/usr/src # root@phobos:/usr/src # zpool version zfs-2.1.99-FreeBSD_g17b2ae0b2 zfs-kmod-2.1.99-FreeBSD_g17b2ae0b2 root@phobos:/usr/src # A zfs list shows the usual stuff : root@phobos:/usr/src # zfs list -o name,used,avail,usedbysnapshots,mounted,mountpoint NAME USED AVAIL USEDSNAP MOUNTED MOUNTPOINT c3 120G 326G 808K yes /c3 c3/ROOT 44.6G 326G 0B no none c3/ROOT/default 44.6G 326G 40.1G yes / c3/opt 13.6M 326G 3.17M yes /opt c3/tmp 2.59M 326G 2.48M yes /tmp c3/usr 75.0G 326G 0B no /usr c3/usr/home 2.21G 326G 126M yes /usr/home c3/usr/obj 63.4G 326G 52.8G yes /usr/obj c3/usr/ports 2.34G 326G 561M yes /usr/ports c3/usr/src 7.05G 326G 4.88G yes /usr/src c3/var 14.8M 326G 0B no /var c3/var/audit 944K 326G 848K yes /var/audit c3/var/crash 544K 326G 448K yes /var/crash c3/var/log 7.76M 326G 6.80M yes /var/log c3/var/mail 2.35M 326G 2.07M yes /var/mail c3/var/tmp 3.16M 326G 3.03M yes /var/tmp root@phobos:/usr/src # All filesystems are compressed with a sha512 checksum everywhere. I am using zstd compression but nothing oddball : root@phobos:/usr/src # zfs list -o name,used,avail,compression,mounted,mountpoint NAME USED AVAIL COMPRESS MOUNTED MOUNTPOINT c3 120G 326G lz4 yes /c3 c3/ROOT 44.6G 326G lz4 no none c3/ROOT/default 44.6G 326G lz4 yes / c3/opt 13.6M 326G zstd yes /opt c3/tmp 2.59M 326G lz4 yes /tmp c3/usr 75.0G 326G lz4 no /usr c3/usr/home 2.21G 326G lz4 yes /usr/home c3/usr/obj 63.4G 326G on yes /usr/obj c3/usr/ports 2.34G 326G lz4 yes /usr/ports c3/usr/src 7.05G 326G lz4 yes /usr/src c3/var 14.8M 326G lz4 no /var c3/var/audit 944K 326G lz4 yes /var/audit c3/var/crash 544K 326G lz4 yes /var/crash c3/var/log 7.76M 326G lz4 yes /var/log c3/var/mail 2.35M 326G lz4 yes /var/mail c3/var/tmp 3.16M 326G lz4 yes /var/tmp root@phobos:/usr/src # There are some snapshots on all filesystems : root@phobos:/usr/src # zfs list -o name,used,avail,usedbysnapshots,mounted,mountpoint -t all -r c3/var/tmp NAME USED AVAIL USEDSNAP MOUNTED MOUNTPOINT c3/var/tmp 3.16M 326G 3.03M yes /var/tmp c3/var/tmp@20211209104512 76K - - - - c3/var/tmp@20211209105732 68K - - - - c3/var/tmp@20211209110035 76K - - - - c3/var/tmp@20211226221122 68K - - - - c3/var/tmp@20220117113614 92K - - - - c3/var/tmp@20220118005539 76K - - - - c3/var/tmp@20220118005944 84K - - - - c3/var/tmp@20220120090537 76K - - - - c3/var/tmp@20220121024902 76K - - - - c3/var/tmp@20220121031721 76K - - - - c3/var/tmp@20220121033412 84K - - - - c3/var/tmp@20220121035649 76K - - - - c3/var/tmp@20220121040118 84K - - - - c3/var/tmp@20220121042929 76K - - - - c3/var/tmp@20220130114038 84K - - - - c3/var/tmp@20220130115954 76K - - - - c3/var/tmp@20220130121000 84K - - - - c3/var/tmp@20220226222228 84K - - - - c3/var/tmp@20220227211856 84K - - - - c3/var/tmp@20220228045355 92K - - - - c3/var/tmp@20220228180052 76K - - - - c3/var/tmp@20220228181542 76K - - - - c3/var/tmp@20220302194101 76K - - - - c3/var/tmp@20220306070845 84K - - - - c3/var/tmp@20220306080502 84K - - - - c3/var/tmp@20220306215850 84K - - - - c3/var/tmp@20220306220437 76K - - - - c3/var/tmp@20220306221245 76K - - - - c3/var/tmp@20220307003647 84K - - - - c3/var/tmp@20220310144525 92K - - - - c3/var/tmp@20220311030047 84K - - - - c3/var/tmp@20220311044203 84K - - - - c3/var/tmp@20220311044643 84K - - - - c3/var/tmp@20220311163309 84K - - - - c3/var/tmp@20220316134056 84K - - - - c3/var/tmp@20220316160003 84K - - - - c3/var/tmp@20220318012900 84K - - - - c3/var/tmp@20220410063610 84K - - - - root@phobos:/usr/src # Not sure what else to say. -- Dennis Clarke RISC-V/SPARC/PPC/ARM/CISC UNIX and Linux spoken GreyBeard and suspenders optional