ZFS: unsupported ZFS version 5000 (should be 28)

Tim Gustafson tjg at ucsc.edu
Fri Aug 2 15:43:08 UTC 2013


First, let me thank you all for offering help.  I really appreciate
it.  I'm going to try to respond to all your comments and questions
in-line here:

> Maybe post the setup of your disks. So people can take a look if your
> commands are right or wrong. The output of 'gpart show' and 'gpart list'
> are a good starting point.

I've attached the output of both commands to this e-mail.
Incidentally, this zpool was built using mfsBSD (http://mfsbsd.vx.sk/)
originally as a FreeBSD 8.2 system, if that matters.

> As it was already indicated, there is no support for zpool version 5000
> (feature flags) in base/releng/9.1. There is however in base/stable/9 and
> in base/stable/8 what you obviously has before.

I'm quite certain I've never tracked anything other than the following
two Subversion URLs for my /usr/src:

http://svn.freebsd.org/base/releng/8.2
http://svn.freebsd.org/base/releng/8.4
http://svn.freebsd.org/base/releng/9.1

As I understand it, those are supposed to be only "release" versions;
they aren't "stable" versions.  Or am I using the incorrect URLs?

> One thing that comes to mind is some older setups may only have 32K
> freebsd-boot partitions, and gptzfsboot is 41K at present.  I'd expect an
> error on trying to install the bootcode, but have not tested it.

This has never been anything other than a 64-bit machine.

> can you run 'zpool history | grep upgrade' and see if it recalls any
> upgrade commands?

Actually, I can't right now.  All zfs-related commands fail with:

internal error: failed to initialized ZFS library

I suspect that's because I don't have a proper /dev and because my
boot environment is now on an inaccessible mount point, as my boot
root partition has been over-mounted with my zfs root partition:

/dev/iso9660/FREEBSD_INSTALL on / (cd9660, local, read-only)
devfs on /dev (devfs, local, multilabel)
tank/root on / (zfs, local, noatime, nfsv4acls)
tank/root/jails on /jails (zfs, local, noatime, nfsv4acls)
tank/root/jails/db-01 on /jails/db-01 (zfs, local, noatime, nfsv4acls)
tank/root/jails/www-01 on /jails/www-01 (zfs, local, noatime, nfsv4acls)
devfs on /jails/db-01/dev (devfs, local, multilabel)
devfs on /jails/www-01/dev (devfs, local, multilabel)

So, I was thinking about possible recovery modes now, and I wonder: it
seems that the zpool version has been upgraded to something that's not
supported by releng/9.1, but the ZFS file systems themselves are still
at version 5, as far as I can tell.  So, wouldn't it be possible to
"zfs send" my file systems to another box that is running releng/9.1
so that the snapshots are preserved, rebuild this box as a fresh
releng/9.1 install and then "zfs send" the file systems back again?
Or does upgrading the zpool also affect the zfs file systems, even if
the zfs file system version hasn't changed?

-- 

Tim Gustafson
tjg at ucsc.edu
831-459-5354
Baskin Engineering, Room 313A
-------------- next part --------------
Geom name: da0
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 1953525134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da0p1
   Mediasize: 65536 (64k)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 17408
   Mode: r0w0e0
   rawuuid: 5680bd32-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f
   label: (null)
   length: 65536
   offset: 17408
   type: freebsd-boot
   index: 1
   end: 161
   start: 34
2. Name: da0p2
   Mediasize: 25769803776 (24G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 82944
   Mode: r0w0e0
   rawuuid: 568c01e1-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 25769803776
   offset: 82944
   type: freebsd-swap
   index: 2
   end: 50331809
   start: 162
3. Name: da0p3
   Mediasize: 974434982400 (907G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 82944
   Mode: r1w1e2
   rawuuid: 569925bb-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 974434982400
   offset: 25769886720
   type: freebsd-zfs
   index: 3
   end: 1953525134
   start: 50331810
Consumers:
1. Name: da0
   Mediasize: 1000204886016 (931G)
   Sectorsize: 512
   Mode: r1w1e3

Geom name: da1
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 1953525134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da1p1
   Mediasize: 65536 (64k)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 17408
   Mode: r0w0e0
   rawuuid: 5775fd70-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f
   label: (null)
   length: 65536
   offset: 17408
   type: freebsd-boot
   index: 1
   end: 161
   start: 34
2. Name: da1p2
   Mediasize: 25769803776 (24G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 82944
   Mode: r0w0e0
   rawuuid: 578003c4-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 25769803776
   offset: 82944
   type: freebsd-swap
   index: 2
   end: 50331809
   start: 162
3. Name: da1p3
   Mediasize: 974434982400 (907G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 82944
   Mode: r1w1e2
   rawuuid: 578aa879-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 974434982400
   offset: 25769886720
   type: freebsd-zfs
   index: 3
   end: 1953525134
   start: 50331810
Consumers:
1. Name: da1
   Mediasize: 1000204886016 (931G)
   Sectorsize: 512
   Mode: r1w1e3

Geom name: da2
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 1953525134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da2p1
   Mediasize: 65536 (64k)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 17408
   Mode: r0w0e0
   rawuuid: 58693a7e-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f
   label: (null)
   length: 65536
   offset: 17408
   type: freebsd-boot
   index: 1
   end: 161
   start: 34
2. Name: da2p2
   Mediasize: 25769803776 (24G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 82944
   Mode: r0w0e0
   rawuuid: 58744ce2-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 25769803776
   offset: 82944
   type: freebsd-swap
   index: 2
   end: 50331809
   start: 162
3. Name: da2p3
   Mediasize: 974434982400 (907G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 82944
   Mode: r1w1e2
   rawuuid: 587ea126-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 974434982400
   offset: 25769886720
   type: freebsd-zfs
   index: 3
   end: 1953525134
   start: 50331810
Consumers:
1. Name: da2
   Mediasize: 1000204886016 (931G)
   Sectorsize: 512
   Mode: r1w1e3

Geom name: da3
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 1953525134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da3p1
   Mediasize: 65536 (64k)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 17408
   Mode: r0w0e0
   rawuuid: 59599ee0-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f
   label: (null)
   length: 65536
   offset: 17408
   type: freebsd-boot
   index: 1
   end: 161
   start: 34
2. Name: da3p2
   Mediasize: 25769803776 (24G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 82944
   Mode: r0w0e0
   rawuuid: 5963a78d-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 25769803776
   offset: 82944
   type: freebsd-swap
   index: 2
   end: 50331809
   start: 162
3. Name: da3p3
   Mediasize: 974434982400 (907G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 82944
   Mode: r1w1e2
   rawuuid: 596f6a14-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 974434982400
   offset: 25769886720
   type: freebsd-zfs
   index: 3
   end: 1953525134
   start: 50331810
Consumers:
1. Name: da3
   Mediasize: 1000204886016 (931G)
   Sectorsize: 512
   Mode: r1w1e3

Geom name: da4
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 1953525134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da4p1
   Mediasize: 65536 (64k)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 17408
   Mode: r0w0e0
   rawuuid: 5a4e817a-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f
   label: (null)
   length: 65536
   offset: 17408
   type: freebsd-boot
   index: 1
   end: 161
   start: 34
2. Name: da4p2
   Mediasize: 25769803776 (24G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 82944
   Mode: r0w0e0
   rawuuid: 5a58835a-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 25769803776
   offset: 82944
   type: freebsd-swap
   index: 2
   end: 50331809
   start: 162
3. Name: da4p3
   Mediasize: 974434982400 (907G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 82944
   Mode: r1w1e2
   rawuuid: 5a64a373-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 974434982400
   offset: 25769886720
   type: freebsd-zfs
   index: 3
   end: 1953525134
   start: 50331810
Consumers:
1. Name: da4
   Mediasize: 1000204886016 (931G)
   Sectorsize: 512
   Mode: r1w1e3

Geom name: da5
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 1953525134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da5p1
   Mediasize: 65536 (64k)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 17408
   Mode: r0w0e0
   rawuuid: 5b458387-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f
   label: (null)
   length: 65536
   offset: 17408
   type: freebsd-boot
   index: 1
   end: 161
   start: 34
2. Name: da5p2
   Mediasize: 25769803776 (24G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 82944
   Mode: r0w0e0
   rawuuid: 5b4f81e4-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 25769803776
   offset: 82944
   type: freebsd-swap
   index: 2
   end: 50331809
   start: 162
3. Name: da5p3
   Mediasize: 974434982400 (907G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 82944
   Mode: r1w1e2
   rawuuid: 5b5ae69e-094c-11e0-96e1-842b2b5a9ee0
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 974434982400
   offset: 25769886720
   type: freebsd-zfs
   index: 3
   end: 1953525134
   start: 50331810
Consumers:
1. Name: da5
   Mediasize: 1000204886016 (931G)
   Sectorsize: 512
   Mode: r1w1e3
-------------- next part --------------
=>        34  1953525101  da0  GPT  (931G)
          34         128    1  freebsd-boot  (64k)
         162    50331648    2  freebsd-swap  (24G)
    50331810  1903193325    3  freebsd-zfs  (907G)

=>        34  1953525101  da1  GPT  (931G)
          34         128    1  freebsd-boot  (64k)
         162    50331648    2  freebsd-swap  (24G)
    50331810  1903193325    3  freebsd-zfs  (907G)

=>        34  1953525101  da2  GPT  (931G)
          34         128    1  freebsd-boot  (64k)
         162    50331648    2  freebsd-swap  (24G)
    50331810  1903193325    3  freebsd-zfs  (907G)

=>        34  1953525101  da3  GPT  (931G)
          34         128    1  freebsd-boot  (64k)
         162    50331648    2  freebsd-swap  (24G)
    50331810  1903193325    3  freebsd-zfs  (907G)

=>        34  1953525101  da4  GPT  (931G)
          34         128    1  freebsd-boot  (64k)
         162    50331648    2  freebsd-swap  (24G)
    50331810  1903193325    3  freebsd-zfs  (907G)

=>        34  1953525101  da5  GPT  (931G)
          34         128    1  freebsd-boot  (64k)
         162    50331648    2  freebsd-swap  (24G)
    50331810  1903193325    3  freebsd-zfs  (907G)


More information about the freebsd-fs mailing list