bin/152087: 8-STABLE gmultipath error 'Unknown verb add'

[Mike Carlson]

>Number:         152087
>Category:       bin
>Synopsis:       8-STABLE gmultipath error 'Unknown verb add'
>Confidential:   no
>Severity:       non-critical
>Priority:       low
>Responsible:    freebsd-bugs
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Wed Nov 10 00:40:07 UTC 2010
>Closed-Date:
>Last-Modified:
>Originator:     Mike Carlson
>Release:        8-STABLE
>Organization:
LLNL
>Environment:
FreeBSD write.llnl.gov 8.1-STABLE FreeBSD 8.1-STABLE #0: Mon Nov  8 16:38:06 PST 2010     root at write.llnl.gov:/usr/obj/usr/src/sys/GENERIC  amd64

>Description:
I just built 8-STABLE today.

Previously, gmultipath seemed to work by specifying the device handles per label. However, now gmultipath doesn't seem to add any other components besides the first one (da2 in this case):

write# camcontrol inquiry da2 -S
085E8C000000006B38CC76
write# camcontrol inquiry da9 -S
085E8C000000006B38CC76

write# gmultipath label -v WINSYS-V001 /dev/da2 /dev/da9
gmultipath: Unknown verb add
write# gmultipath status
                 Name  Status  Components
multipath/WINSYS-V001     N/A  da2
write# dmesg | tail -2
GEOM_MULTIPATH: adding da2 to WINSYS-V001/cbaa6887-ec4f-11df-bb7a-1cc1dee9fbae
GEOM_MULTIPATH: da2 now active path in WINSYS-V001

I have trick GEOM into recognizing the other disk:

write# echo 1 > /dev/da9 
write# dmesg| tail -1
GEOM_MULTIPATH: adding da9 to WINSYS-V001/bd0f1f20-ec50-11df-bb7a-1cc1dee9fbae

write# gmultipath status
                 Name  Status  Components
multipath/WINSYS-V001     N/A  da2
                               da9


Otherwise, the interaction with the device label works fine. I know the SVN commit 207384 changed the behavior of gmultipath, so I'm assuming it is related.
>How-To-Repeat:
see 'gmultipath woes' http://docs.freebsd.org/cgi/getmsg.cgi?fetch=40337+0+archive/2010/freebsd-geom/20100801.freebsd-geom :

[root at ostracod /mnt]# mdconfig -a -t vnode -f /scratch/test.dsk -u 12
[root at ostracod /mnt]# mdconfig -a -t vnode -f /scratch/test.dsk -u 13
[root at ostracod /mnt]# sysctl kern.geom.multipath.debug=1
kern.geom.multipath.debug: 1 -> 1
[root at ostracod /mnt]# gmultipath label -v TEST /dev/md12 /dev/md13
gmultipath: Unknown verb add
[root at ostracod /mnt]# gmultipath list
Geom name: TEST
Providers:
1. Name: multipath/TEST
   Mediasize: 52428288 (50M)
   Sectorsize: 512
   Mode: r0w0e0
Consumers:
1. Name: md12
   Mediasize: 52428800 (50M)
   Sectorsize: 512
   Mode: r0w0e0

[root at ostracod /mnt]# gmultipath status
          Name  Status  Components
multipath/TEST     N/A  md12

However doing
echo 1 > /dev/md13 made geom re-taste the device so I get
[root at ostracod /mnt]# gmultipath list
Geom name: TEST
Providers:
1. Name: multipath/TEST
   Mediasize: 52428288 (50M)
   Sectorsize: 512
   Mode: r0w0e0
Consumers:
1. Name: md12
   Mediasize: 52428800 (50M)
   Sectorsize: 512
   Mode: r0w0e0
2. Name: md13
   Mediasize: 52428800 (50M)
   Sectorsize: 512
   Mode: r0w0e0

>Fix:


>Release-Note:
>Audit-Trail:
>Unformatted: