[Bug 271989] zfs root mount error 6 after upgrade from 11.1-release to 13.2-release

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=271989

            Bug ID: 271989
           Summary: zfs root mount error 6 after upgrade from 11.1-release
                    to 13.2-release
           Product: Base System
           Version: 13.2-RELEASE
          Hardware: amd64
                OS: Any
            Status: New
          Severity: Affects Only Me
          Priority: ---
         Component: kern
          Assignee: bugs@FreeBSD.org
          Reporter: freebsd-bugs@virtualtec.ch

Problem:
- system runs fine with 11.1-RELEASE
- prepared upgrade to 13.2-RELEASE in new boot environment
- updated first efi partition to load loader_4th.efi  (the lua default will
fail when trying to load the 11.1 environment)
- upon reboot to 13.2, the kernel loads fine, but fails to mount the root pool:

   Mounting from zfs:zroot/ROOT/fbsd132 failed with error 6.

   Loader variables:
      vfs.root.mountfrom=zfs:zroot/ROOT/fbsd132


Environment:
- supermicro X10DRi server, used to implement an iscsi nas within separate data
pool (lsi controllers)
- contains 2 NVME P3700 cards to host zroot pool, and contains additional
partitions to provide log mirror to a data pool (p4)

$ gpart show -l nvd0
=>       40  781422688  nvd0  GPT  (373G)
         40     409600     1  efiboot0  (200M)
     409640       2008        - free -  (1.0M)
     411648   33554432     2  swap0  (16G)
   33966080  104857600     3  (null)  (50G)
  138823680   33554432     4  (null)  (16G)
  172378112  609044616        - free -  (290G)

$ gpart show -l nvd1
=>       40  781422688  nvd1  GPT  (373G)
         40     409600     1  efiboot1  (200M)
     409640       2008        - free -  (1.0M)
     411648   33554432     2  swap1  (16G)
   33966080  104857600     3  (null)  (50G)
  138823680   33554432     4  (null)  (16G)
  172378112  609044616        - free -  (290G)

zroot:
        NAME        STATE     READ WRITE CKSUM
        zroot       ONLINE       0     0     0
          mirror-0  ONLINE       0     0     0
            nvd0p3  ONLINE       0     0     0
            nvd1p3  ONLINE       0     0     0

GUIDs:
zroot  guid                          2596257223750470056            default
data  guid                           10144353125609547525           default

I enabled vfs.zfs.debug = "1" in loader.conf, and it seems the boot loader is
trying to 
load the wrong pool guid 10350976291831707895, but I have no idea where it gets
this guid
from:

vdev_geom_open_by_guids:767[1]: Searching by guids
[10350976291831707895:18166718715878495545].
vdev_geom_open_by_guids:767[1]: Searching by guids
[10350976291831707895:8932737958006505339].
vdev_attach_ok:687[1]: pool guid mismatch for provider nvd1p4:
10350976291831707895 != 10144353125609547525.
vdev_attach_ok:687[1]: pool guid mismatch for provider nvd1p4:
10350976291831707895 != 10144353125609547525.
vdev_attach_ok:687[1]: pool guid mismatch for provider nvd1p3:
10350976291831707895 != 2596257223750470056.
vdev_attach_ok:687[1]: pool guid mismatch for provider nvd1p3:
10350976291831707895 != 2596257223750470056.
[...]
vdev_geom_open_by_guids:779[1]: Attach by guid
[10350976291831707895:18166718715878495545] succeeded, provider nvd0.
vdev_geom_open_by_guids:779[1]: Attach by guid
[10350976291831707895:8932737958006505339] succeeded, provider nvd1.
[...]
Mounting from zfs:zroot/ROOT/fbsd132 failed with error 6.

Can I somehow force the use of a specific guid, or blacklist the wrong one?

Regards,
Markus

-- 
You are receiving this mail because:
You are the assignee for the bug.