Informal(?) sesX messages

Mykel at mWare.ca Mykel at mWare.ca
Sat Dec 12 03:02:08 UTC 2015


On 15-12-11 17:44, Alan Somers wrote:
> On Fri, Dec 11, 2015 at 3:34 PM,  <Mykel at mware.ca> wrote:
>> Hi all, please CC me on reply as I'm not subscribed to this list.
>>
>> I've got one of those Supermicro 72-drive monster machines, all ZFS'd up.
>> https://www.supermicro.com/products/system/4u/6048/SSG-6048R-E1CR72L.cfm
>>
>> And before & after replacing a faulty SAS Expander and a pair of cables
>> (gobs of WRITE/ABORT errors), I'm still occasionally seeing these kernel
>> messages (in groups), and I'm not sure if they're benign, or pointing to a
>> SAS expander event... or what. I admit, this is my first time dealing with a
>> machine with SAS expanders, so I'm a bit out of my depth in diagnosis
>> thereof.
>>
>> Dec 11 16:06:54 ZFS-AF kernel: ses5: da7,pass7: Element descriptor: 'Slot00'
>> Dec 11 16:06:54 ZFS-AF kernel: ses5: da7,pass7: SAS Device Slot Element: 1
>> Phys at Slot 0
>> Dec 11 16:06:54 ZFS-AF kernel: ses5:  phy 0: SAS device type 1 id 0
>> Dec 11 16:06:54 ZFS-AF kernel: ses5:  phy 0: protocols: Initiator( None )
>> Target( SSP )
>> Dec 11 16:06:54 ZFS-AF kernel: ses5:  phy 0: parent 500304801ea2df3f addr
>> 5000c500844bd449
>>
> These look like device arrival notifications.  If you scroll up, do
> you see any departure notifications?  They should look like this:
>
> mps0: mpssas_prepare_remove: Sending reset for target ID 10
> da0 at mps0 bus 0 scbus0 target 10 lun 0
> da0: <ATA Hitachi HUA72201 A39C> s/n       JPW930HQ15H26H detached
> mps0: Unfreezing devq for target ID 10
> xpt_release_devq(): requested 1 > present 0
> (da0:mps0:0:10:0): Periph destroyed
>
> Also, could you post your HBA and expander firmware versions?  For the
> HBA, use "sysctl dev.mps.0.firmware_version".  For the expander,
> install sg3_utils and do "sg_inq --hex --len=64 ses0".  The firmware
> version is the dotted quad at the end.
>
> # sg_inq --hex --len=64 ses0
>   00     0d 00 05 02 34 00 40 02  41 49 43 20 43 4f 52 50    ....4. at .AIC CORP
>   10     53 41 53 20 36 47 20 45  78 70 61 6e 64 65 72 20    SAS 6G Expander
>   20     30 62 30 31 78 33 36 2d  31 2e 31 31 2e 31 2e 31    0b01x36-1.11.1.1
>   30     00 20 20 20 20 20 20 20
>
> -Alan

I can say, without doubt, that I do NOT have any preceding 
detachments... which is why I'm so baffled by the messages. If the 
devices aren't de/reattaching, what's the point of these informal/benign 
ones? I am familiar with them from other hot-swap and disk failure 
scenarios in other machines.

Could this be a driver bug not logging the disconnection? But when I 
hot-unplugged them, I do see that in dmesg.
Or does SAS do something where it might renegotiate or reconfigure the 
lanes, and I'm just seeing it do that?

Thanks,

Myke


dev.mpr.0.driver_version: 09.255.01.00-fbsd
dev.mpr.0.firmware_version: 06.00.00.00
dev.mpr.1.driver_version: 09.255.01.00-fbsd
dev.mpr.1.firmware_version: 08.00.00.00
dev.mpr.2.driver_version: 09.255.01.00-fbsd
dev.mpr.2.firmware_version: 08.00.00.00

[root at ZFS-AF ~]# sg_inq --hex --len=64 ses0
  00     0d 00 05 02 33 00 40 02  4c 53 49 20 20 20 20 20 ....3. at .LSI
  10     53 41 53 33 78 34 38 20  20 20 20 20 20 20 20 20 SAS3x48
  20     30 37 30 31 78 34 38 2d  36 36 2e 37 2e 31 2e 31 0701x48-66.7.1.1
  30     37 00 20 20 20 20 20 20 7.
[root at ZFS-AF ~]# sg_inq --hex --len=64 ses1
  00     0d 00 05 02 33 00 40 02  4c 53 49 20 20 20 20 20 ....3. at .LSI
  10     53 41 53 33 78 33 36 20  20 20 20 20 20 20 20 20 SAS3x36
  20     30 37 30 31 78 33 36 2d  36 36 2e 37 2e 31 2e 31 0701x36-66.7.1.1
  30     37 00 20 20 20 20 20 20 7.
[root at ZFS-AF ~]# sg_inq --hex --len=64 ses2
SCSI INQUIRY failed on ses2, res=-1
[root at ZFS-AF ~]# sg_inq --hex --len=64 ses3
SCSI INQUIRY failed on ses3, res=-1
[root at ZFS-AF ~]# sg_inq --hex --len=64 ses4
  00     0d 00 05 02 33 00 40 02  4c 53 49 20 20 20 20 20 ....3. at .LSI
  10     53 41 53 33 78 32 38 20  20 20 20 20 20 20 20 20 SAS3x28
  20     30 37 30 31 78 32 38 2d  36 36 2e 37 2e 31 2e 31 0701x28-66.7.1.1
  30     37 00 20 20 20 20 20 20 7.
[root at ZFS-AF ~]# sg_inq --hex --len=64 ses5
  00     0d 00 05 02 33 00 40 02  4c 53 49 20 20 20 20 20 ....3. at .LSI
  10     53 41 53 33 78 34 38 20  20 20 20 20 20 20 20 20 SAS3x48
  20     30 37 30 31 78 34 38 2d  36 36 2e 37 2e 31 2e 31 0701x48-66.7.1.1
  30     37 00 20 20 20 20 20 20 7.
[root at ZFS-AF ~]#


And here's dmesg after fresh reboot:
[root at ZFS-AF ~]# dmesg
Copyright (c) 1992-2015 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
     The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.2-RELEASE-p7 #0: Mon Nov  2 14:19:39 UTC 2015
root at amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64
FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
CPU: Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz (1900.04-MHz K8-class CPU)
   Origin="GenuineIntel"  Id=0x306f2  Family=0x6  Model=0x3f Stepping=2
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x7ffefbff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,<b11>,FMA,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
   AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
   AMD Features2=0x21<LAHF,ABM>
   Structured Extended 
Features=0x37ab<FSGSBASE,TSCADJ,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,NFPUSG>
   XSAVE Features=0x1<XSAVEOPT>
   VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
   TSC: P-state invariant, performance statistics
real memory  = 137438953472 (131072 MB)
avail memory = 133408280576 (127228 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <ALASKA A M I >
FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs
FreeBSD/SMP: 2 package(s) x 6 core(s)
  cpu0 (BSP): APIC ID:  0
  cpu1 (AP): APIC ID:  2
  cpu2 (AP): APIC ID:  4
  cpu3 (AP): APIC ID:  6
  cpu4 (AP): APIC ID:  8
  cpu5 (AP): APIC ID: 10
  cpu6 (AP): APIC ID: 16
  cpu7 (AP): APIC ID: 18
  cpu8 (AP): APIC ID: 20
  cpu9 (AP): APIC ID: 22
  cpu10 (AP): APIC ID: 24
  cpu11 (AP): APIC ID: 26
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
ioapic2 <Version 2.0> irqs 48-71 on motherboard
random: <Software, Yarrow> initialized
module_register_init: MOD_LOAD (vesa, 0xffffffff80db8e60, 0) error 19
kbd1 at kbdmux0
acpi0: <ALASKA A M I > on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
cpu8: <ACPI CPU> on acpi0
cpu9: <ACPI CPU> on acpi0
cpu10: <ACPI CPU> on acpi0
cpu11: <ACPI CPU> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x71,0x74-0x77 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 340
Event timer "HPET2" frequency 14318180 Hz quality 340
Event timer "HPET3" frequency 14318180 Hz quality 340
Event timer "HPET4" frequency 14318180 Hz quality 340
Event timer "HPET5" frequency 14318180 Hz quality 340
Event timer "HPET6" frequency 14318180 Hz quality 340
Event timer "HPET7" frequency 14318180 Hz quality 340
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci255: <ACPI PCI bus> on pcib0
pcib1: <ACPI Host-PCI bridge> on acpi0
pci127: <ACPI PCI bus> on pcib1
pcib2: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 26 at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 32 at device 2.0 on pci0
pci2: <ACPI PCI bus> on pcib4
mpr0: <Avago Technologies (LSI) SAS3008> port 0x6000-0x60ff mem 
0xc7400000-0xc740ffff irq 32 at device 0.0 on pci2
mpr0: IOCFacts    :
     MsgVersion: 0x205
     HeaderVersion: 0x2300
     IOCNumber: 0
     IOCExceptions: 0x0
     MaxChainDepth: 128
     NumberOfPorts: 1
     RequestCredit: 3072
     ProductID: 0x2221
     IOCRequestFrameSize: 32
     MaxInitiators: 1
     MaxTargets: 256
     MaxSasExpanders: 48
     MaxEnclosures: 16
     HighPriorityCredit: 128
     MaxReplyDescriptorPostQueueDepth: 65504
     ReplyFrameSize: 32
     MaxVolumes: 0
     MaxDevHandle: 313
     MaxPersistentEntries: 128
mpr0: Firmware: 06.00.00.00, Driver: 09.255.01.00-fbsd
mpr0: IOCCapabilities: 
7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc>
pcib5: <ACPI PCI-PCI bridge> irq 32 at device 2.2 on pci0
pci3: <ACPI PCI bus> on pcib5
mpr1: <Avago Technologies (LSI) SAS3008> port 0x5000-0x50ff mem 
0xc7240000-0xc724ffff,0xc7200000-0xc723ffff irq 34 at device 0.0 on pci3
mpr1: IOCFacts    :
     MsgVersion: 0x205
     HeaderVersion: 0x2300
     IOCNumber: 0
     IOCExceptions: 0x0
     MaxChainDepth: 128
     NumberOfPorts: 1
     RequestCredit: 3072
     ProductID: 0x2221
     IOCRequestFrameSize: 32
     MaxInitiators: 1
     MaxTargets: 256
     MaxSasExpanders: 48
     MaxEnclosures: 16
     HighPriorityCredit: 128
     MaxReplyDescriptorPostQueueDepth: 65504
     ReplyFrameSize: 32
     MaxVolumes: 0
     MaxDevHandle: 313
     MaxPersistentEntries: 128
mpr1: Firmware: 08.00.00.00, Driver: 09.255.01.00-fbsd
mpr1: IOCCapabilities: 
7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc>
pcib6: <ACPI PCI-PCI bridge> irq 40 at device 3.0 on pci0
pci4: <ACPI PCI bus> on pcib6
pcib7: <ACPI PCI-PCI bridge> irq 40 at device 3.2 on pci0
pci5: <ACPI PCI bus> on pcib7
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.8.3> 
port 0x4020-0x403f mem 0xc7c00000-0xc7dfffff,0xc7e04000-0xc7e07fff irq 
42 at device 0.0 on pci5
ix0: Using MSIX interrupts with 9 vectors
ix0: Ethernet address: 0c:c4:7a:35:12:c0
ix0: PCI Express Bus: Speed 5.0GT/s Width x8
ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.8.3> 
port 0x4000-0x401f mem 0xc7a00000-0xc7bfffff,0xc7e00000-0xc7e03fff irq 
45 at device 0.1 on pci5
ix1: Using MSIX interrupts with 9 vectors
ix1: Ethernet address: 0c:c4:7a:35:12:c1
ix1: PCI Express Bus: Speed 5.0GT/s Width x8
pci0: <unknown> at device 17.0 (no driver attached)
ahci0: <Intel Wellsburg AHCI SATA controller> port 
0x7110-0x7117,0x7100-0x7103,0x70f0-0x70f7,0x70e0-0x70e3,0x7020-0x703f 
mem 0xc7538000-0xc75387ff irq 16 at device 17.4 on pci0
ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahciem0: <AHCI enclosure management bridge> on ahci0
xhci0: <XHCI (generic) USB 3.0 controller> mem 0xc7500000-0xc750ffff irq 
19 at device 20.0 on pci0
xhci0: 32 bytes context size, 64-bit DMA
usbus0 on xhci0
pci0: <simple comms> at device 22.0 (no driver attached)
pci0: <simple comms> at device 22.1 (no driver attached)
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xc7534000-0xc75343ff irq 
18 at device 26.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci0
pcib8: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci6: <ACPI PCI bus> on pcib8
pcib9: <ACPI PCI-PCI bridge> irq 16 at device 28.4 on pci0
pci7: <ACPI PCI bus> on pcib9
pcib10: <ACPI PCI-PCI bridge> at device 0.0 on pci7
pci8: <ACPI PCI bus> on pcib10
vgapci0: <VGA-compatible display> port 0x3000-0x307f mem 
0xc6000000-0xc6ffffff,0xc7000000-0xc701ffff irq 16 at device 0.0 on pci8
vgapci0: Boot video device
ehci1: <EHCI (generic) USB 2.0 controller> mem 0xc7533000-0xc75333ff irq 
18 at device 29.0 on pci0
usbus2: EHCI version 1.0
usbus2 on ehci1
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci1: <Intel Wellsburg AHCI SATA controller> port 
0x7070-0x7077,0x7060-0x7063,0x7050-0x7057,0x7040-0x7043,0x7000-0x701f 
mem 0xc7532000-0xc75327ff irq 16 at device 31.2 on pci0
ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ahcich4: <AHCI channel> at channel 0 on ahci1
ahcich5: <AHCI channel> at channel 1 on ahci1
ahcich6: <AHCI channel> at channel 2 on ahci1
ahcich7: <AHCI channel> at channel 3 on ahci1
ahcich8: <AHCI channel> at channel 4 on ahci1
ahcich9: <AHCI channel> at channel 5 on ahci1
ahciem1: <AHCI enclosure management bridge> on ahci1
pcib11: <ACPI Host-PCI bridge> on acpi0
pci128: <ACPI PCI bus> on pcib11
pcib12: <ACPI PCI-PCI bridge> at device 0.0 on pci128
pci129: <ACPI PCI bus> on pcib12
pcib13: <ACPI PCI-PCI bridge> irq 50 at device 1.0 on pci128
pci130: <ACPI PCI bus> on pcib13
pcib14: <ACPI PCI-PCI bridge> irq 56 at device 2.0 on pci128
pci131: <ACPI PCI bus> on pcib14
em0: <Intel(R) PRO/1000 Network Connection 7.4.2> port 0xf020-0xf03f mem 
0xfbea0000-0xfbebffff,0xfbe80000-0xfbe9ffff irq 56 at device 0.0 on pci131
em0: Using an MSI interrupt
em0: Ethernet address: 00:26:55:d3:1b:3a
em1: <Intel(R) PRO/1000 Network Connection 7.4.2> port 0xf000-0xf01f mem 
0xfbe40000-0xfbe5ffff,0xfbe20000-0xfbe3ffff irq 60 at device 0.1 on pci131
em1: Using an MSI interrupt
em1: Ethernet address: 00:26:55:d3:1b:3b
pcib15: <ACPI PCI-PCI bridge> irq 56 at device 2.2 on pci128
pci132: <ACPI PCI bus> on pcib15
ix2: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.8.3> 
mem 0xfb800000-0xfb9fffff,0xfba04000-0xfba07fff irq 61 at device 0.0 on 
pci132
ix2: Using MSIX interrupts with 9 vectors
ix2: Ethernet address: a0:36:9f:5d:40:a8
ix2: PCI Express Bus: Speed 5.0GT/s Width x8
ix3: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.8.3> 
mem 0xfb600000-0xfb7fffff,0xfba00000-0xfba03fff irq 58 at device 0.1 on 
pci132
ix3: Using MSIX interrupts with 9 vectors
ix3: Ethernet address: a0:36:9f:5d:40:aa
ix3: PCI Express Bus: Speed 5.0GT/s Width x8
pcib16: <ACPI PCI-PCI bridge> irq 64 at device 3.0 on pci128
pci133: <ACPI PCI bus> on pcib16
mpr2: <Avago Technologies (LSI) SAS3008> port 0xe000-0xe0ff mem 
0xfbc40000-0xfbc4ffff,0xfbc00000-0xfbc3ffff irq 64 at device 0.0 on pci133
mpr2: IOCFacts    :
     MsgVersion: 0x205
     HeaderVersion: 0x2300
     IOCNumber: 0
     IOCExceptions: 0x0
     MaxChainDepth: 128
     NumberOfPorts: 1
     RequestCredit: 3072
     ProductID: 0x2221
     IOCRequestFrameSize: 32
     MaxInitiators: 1
     MaxTargets: 256
     MaxSasExpanders: 48
     MaxEnclosures: 16
     HighPriorityCredit: 128
     MaxReplyDescriptorPostQueueDepth: 65504
     ReplyFrameSize: 32
     MaxVolumes: 0
     MaxDevHandle: 313
     MaxPersistentEntries: 128
mpr2: Firmware: 08.00.00.00, Driver: 09.255.01.00-fbsd
mpr2: IOCCapabilities: 
7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc>
acpi_button0: <Power Button> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
ipmi0: <IPMI System Interface> port 0xca2,0xca3 on acpi0
ipmi0: KCS mode found at io 0xca2 on acpi
orm0: <ISA Option ROMs> at iomem 
0xc0000-0xc7fff,0xc8000-0xc87ff,0xc8800-0xc97ff,0xc9800-0xca7ff,0xca800-0xcb7ff,0xcb800-0xcc7ff,0xcc800-0xcd7ff 
on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: CGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3d0-0x3db iomem 0xb8000-0xbffff on isa0
ppc0: cannot reserve I/O port range
est0: <Enhanced SpeedStep Frequency Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est2: <Enhanced SpeedStep Frequency Control> on cpu2
est3: <Enhanced SpeedStep Frequency Control> on cpu3
est4: <Enhanced SpeedStep Frequency Control> on cpu4
est5: <Enhanced SpeedStep Frequency Control> on cpu5
est6: <Enhanced SpeedStep Frequency Control> on cpu6
est7: <Enhanced SpeedStep Frequency Control> on cpu7
est8: <Enhanced SpeedStep Frequency Control> on cpu8
est9: <Enhanced SpeedStep Frequency Control> on cpu9
est10: <Enhanced SpeedStep Frequency Control> on cpu10
est11: <Enhanced SpeedStep Frequency Control> on cpu11
random: unblocking device.
usbus0: 5.0Gbps Super Speed USB v3.0
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
usbus1: 480Mbps High Speed USB v2.0
usbus2: 480Mbps High Speed USB v2.0
ugen0.1: <0x8086> at usbus0
uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
ugen2.1: <Intel> at usbus2
uhub2: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
ipmi0: IPMI device rev. 1, firmware rev. 2.14, version 2.0
ipmi0: Number of channels 2
ipmi0: Attached watchdog
uhub1: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
uhub0: 21 ports with 21 removable, self powered
ugen0.2: <Apple, Inc.> at usbus0
uhub3: <Apple, Inc. Keyboard Hub, class 9/0, rev 2.00/96.15, addr 1> on 
usbus0
mpr0: SAS Address from SAS device page0 = 5000c500844c64e5
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000a> 
enclosureHandle<0x0002> slot 5
mpr0: At enclosure level 0 and connector name (    )
mpr0: SAS Address from SAS device page0 = 5000c500844d8de5
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000b> 
enclosureHandle<0x0002> slot 6
mpr0: At enclosure level 0 and connector name (    )
mpr0: SAS Address from SAS device page0 = 5000c500844d6865
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000c> 
enclosureHandle<0x0002> slot 7
mpr0: At enclosure level 0 and connector name (    )
mpr1: SAS Address for SATA device = 9683a928e2b4aab3
mpr0: SAS Address from SAS device page0 = 5000c500844c9a3d
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000d> 
enclosureHandle<0x0002> slot 15
mpr0: At enclosure level 0 and connector name (    )
mpr0: SAS Address from SAS device page0 = 50030480090b8d3d
mpr0: Found device <4411<SmpInit,SspTarg,SepDev>,End Device> <12.0Gbps> 
handle<0x000e> enclosureHandle<0x0002> slot 24
mpr0: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844bb641
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000b> 
enclosureHandle<0x0002> slot 0
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address for SATA device = 9684b128e2b4aab3
mpr2: SAS Address from SAS device page0 = 5000c500844ba865
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000c> 
enclosureHandle<0x0002> slot 1
mpr1: SAS Address for SATA device = 9687a328e2b4aab3
ugen1.2: <vendor 0x8087> at usbus1
uhub4: <vendor 0x8087 product 0x800a, class 9/0, rev 2.00/0.05, addr 2> 
on usbus1
ugen2.2: <vendor 0x8087> at usbus2
uhub5: <vendor 0x8087 product 0x8002, class 9/0, rev 2.00/0.05, addr 2> 
on usbus2
mpr2: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844c6699
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0011> 
enclosureHandle<0x0002> slot 2
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address for SATA device = 9586a528e2b4aab3
mpr2: SAS Address from SAS device page0 = 5000c500844bd9d5
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0012> 
enclosureHandle<0x0002> slot 3
mpr2: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844d8c29
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0013> 
enclosureHandle<0x0002> slot 4
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SAS device page0 = 5000c5007788ad75
mpr1: mpr2: SAS Address from SAS device page0 = 5000c500844ba3c1
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0014> 
enclosureHandle<0x0002> slot 5
mpr2: At enclosure level 0 and connector name (    )
Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000a> 
enclosureHandle<0x0002> slot 0
mpr1: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844ca251
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0015> 
enclosureHandle<0x0002> slot 6
mpr2: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844bcc31
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0016> 
enclosureHandle<0x0002> slot 7
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SAS device page0 = 5000c5007799d161
mpr1: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000b> 
enclosureHandle<0x0002> slot 1
mpr1: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844bda45
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0017> 
enclosureHandle<0x0002> slot 8
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SAS device page0 = 5000c5007788fd71
mpr1: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000c> 
enclosureHandle<0x0002> slot 2
mpr1: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844c8579
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0018> 
enclosureHandle<0x0002> slot 9
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SAS device page0 = 5000c5007788d7f9
mpr1: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000d> 
enclosureHandle<0x0002> slot 3
mpr1: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844c7ee1
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0019> 
enclosureHandle<0x0002> slot 10
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SAS device page0 = 50030480090b8d88
mpr2: SAS Address from SAS device page0 = 5000c500844d01fd
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x001a> 
enclosureHandle<0x0002> slot 11
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SATA device = 9683a928e2b4aab3
mpr1: Found device <81<SataDev>,End Device> <12.0Gbps> handle<0x000e> 
enclosureHandle<0x0002> slot 4
mpr1: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SAS device page0 = 5000c500844c2185
mpr1: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000f> 
enclosureHandle<0x0002> slot 5
mpr1: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 500304801ea2dfbd
mpr2: Found device <4411<SmpInit,SspTarg,SepDev>,End Device> <12.0Gbps> 
handle<0x001f> enclosureHandle<0x0002> slot 12
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SAS device page0 = 5000c500844d7ca1
mpr1: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0010> 
enclosureHandle<0x0002> slot 6
mpr1: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SAS device page0 = 5000c500844c5db5
mpr1: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0011> 
enclosureHandle<0x0002> slot 7
mpr1: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SAS device page0 = 50030480090b8d90
mpr2: SAS Address from SAS device page0 = 5000c500844bd449
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000d> 
enclosureHandle<0x0003> slot 0
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SATA device = 9684b128e2b4aab3
mpr1: Found device <81<SataDev>,End Device> <12.0Gbps> handle<0x0012> 
enclosureHandle<0x0002> slot 12
mpr1: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844bc9b1
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000e> 
enclosureHandle<0x0003> slot 1
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SAS device page0 = 50030480090b8d91
mpr2: SAS Address from SAS device page0 = 5000c500844d6ea1
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000f> 
enclosureHandle<0x0003> slot 2
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SATA device = 9687a328e2b4aab3
mpr1: Found device <81<SataDev>,End Device> <12.0Gbps> handle<0x0013> 
enclosureHandle<0x0002> slot 13
mpr1: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844b9785
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0010> 
enclosureHandle<0x0003> slot 3
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SAS device page0 = 50030480090b8d92
mpr2: SAS Address from SAS device page0 = 5000c500844bda21
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x001b> 
enclosureHandle<0x0003> slot 4
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SATA device = 9586a528e2b4aab3
mpr1: Found device <81<SataDev>,End Device> <12.0Gbps> handle<0x0014> 
enclosureHandle<0x0002> slot 14
mpr1: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844d050d
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x001c> 
enclosureHandle<0x0003> slot 5
mpr2: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SAS device page0 = 5000c500844d028d
mpr1: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0015> 
enclosureHandle<0x0002> slot 15
mpr1: At enclosure level 0 and connector name (    )
mpr1: SAS Address from SAS device page0 = 50030480090b8dbd
mpr1: Found device <4411<SmpInit,SspTarg,SepDev>,End Device> <12.0Gbps> 
handle<0x0016> enclosureHandle<0x0002> slot 24
mpr1: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844c81cd
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x001d> 
enclosureHandle<0x0003> slot 6
mpr2: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844bf42d
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x001e> 
enclosureHandle<0x0003> slot 7
mpr2: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844cf71d
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0020> 
enclosureHandle<0x0003> slot 8
mpr2: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844bde8d
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0021> 
enclosureHandle<0x0003> slot 9
mpr2: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844d66c9
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0022> 
enclosureHandle<0x0003> slot 10
mpr2: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 5000c500844cf01d
mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0023> 
enclosureHandle<0x0003> slot 11
mpr2: At enclosure level 0 and connector name (    )
mpr2: SAS Address from SAS device page0 = 500304801ea2df3d
mpr2: Found device <4411<SmpInit,SspTarg,SepDev>,End Device> <12.0Gbps> 
handle<0x0024> enclosureHandle<0x0003> slot 24
mpr2: At enclosure level 0 and connector name (    )
uhub4: 6 ports with 6 removable, self powered
uhub5: 8 ports with 8 removable, self powered
uhub3: 3 ports with 2 removable, bus powered
ugen0.3: <Apple Inc.> at usbus0
ukbd0: <Apple Inc. Apple Keyboard, class 0/0, rev 2.00/0.74, addr 2> on 
usbus0
kbd0 at ukbd0
ugen0.4: <vendor 0x0557> at usbus0
uhub6: <vendor 0x0557 product 0x7000, class 9/0, rev 2.00/0.00, addr 3> 
on usbus0
uhub6: 4 ports with 3 removable, self powered
ugen0.5: <vendor 0x0557> at usbus0
ukbd1: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 4> 
on usbus0
kbd2 at ukbd1
da0 at mpr0 bus 0 scbus0 target 13 lun 0
da0: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da0: Serial Number Z4F0BTFL0000R551Y6M9
da0: 1200.000MB/s transfers
da0: Command Queueing enabled
da0: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da1 at mpr0 bus 0 scbus0 target 14 lun 0
da2 at mpr0 bus 0 scbus0 target 15 lun 0
da1: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da1: Serial Number Z4F0BFJS0000R548WQDM
da1: 1200.000MB/s transfers
da1: Command Queueing enabled
da1: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da2: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da2: Serial Number Z4F0BG670000R548ZWZP
da2: 1200.000MB/s transfers
da2: Command Queueing enabled
da2: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da3 at mpr0 bus 0 scbus0 target 23 lun 0
da4 at mpr1 bus 0 scbus1 target 8 lun 0
da3: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da3: Serial Number Z4F0BSKY0000R548Z0E2
da3: 1200.000MB/s transfers
da3: Command Queueing enabled
da3: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da11 at mpr1 bus 0 scbus1 target 15 lun 0
da11: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da4: <SEAGATE ST600MP0005 N003> Fixed Direct Access SPC-4 SCSI device
da9 at mpr1 bus 0 scbus1 target 13 lun 0
da9: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da9: Serial Number Z4F0BVZP0000R551Y333
da9: 1200.000MB/s transfers
da9: Command Queueing enabled
da9: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da11: Serial Number Z4F0BTLX0000R551NW3V
da11: 1200.000MB/s transfers
da11: Command Queueing enabled
da11: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da5 at mpr1 bus 0 scbus1 target 9 lun 0
da4: Serial Number S7M016SG0000S439LVPG
da4: 1200.000MB/s transfers
da4: Command Queueing enabled
da4: 572325MB (1172123568 512 byte sectors: 255H 63S/T 72961C)
da10 at mpr1 bus 0 scbus1 target 14 lun 0
da6 at mpr1 bus 0 scbus1 target 10 lun 0
da5: <SEAGATE ST600MP0005 N003> Fixed Direct Access SPC-4 SCSI device
da5: Serial Number S7M01AYK0000J503B7CT
da5: 1200.000MB/s transfers
da5: Command Queueing enabled
da5: 572325MB (1172123568 512 byte sectors: 255H 63S/T 72961C)
da10: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da6: <SEAGATE ST600MP0005 N003> Fixed Direct Access SPC-4 SCSI device
da6: Serial Number S7M016TK0000J448E26D
da6: 1200.000MB/s transfers
da6: Command Queueing enabled
da6: 572325MB (1172123568 512 byte sectors: 255H 63S/T 72961C)
da10: Serial Number Z4F0BFW70000R548WR5D
da10: 1200.000MB/s transfers
da10: Command Queueing enabled
da10: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da8 at mpr1 bus 0 scbus1 target 12 lun 0
da8: <ATA SAMSUNG MZ7KM960 003Q> Fixed Direct Access SPC-4 SCSI device
da8: Serial Number S2L2NWAG701294P
da8: 1200.000MB/s transfers
da8: Command Queueing enabled
da8: 915715MB (1875385008 512 byte sectors: 255H 63S/T 116737C)
da7 at mpr1 bus 0 scbus1 target 11 lun 0
da13 at mpr1 bus 0 scbus1 target 21 lun 0
da13: <ATA SAMSUNG MZ7KM960 003Q> Fixed Direct Access SPC-4 SCSI device
da13: Serial Number S2L2NWAG701298J
da13: 1200.000MB/s transfers
da13: Command Queueing enabled
da13: 915715MB (1875385008 512 byte sectors: 255H 63S/T 116737C)
da16 at mpr2 bus 0 scbus14 target 8 lun 0
da16: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da16: Serial Number Z4F0BMKW0000R551NVS4
da16: 1200.000MB/s transfers
da16: Command Queueing enabled
da16: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da19 at mpr2 bus 0 scbus14 target 11 lun 0
da19: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da19: Serial Number Z4F0BMC60000R551NWQB
da19: 1200.000MB/s transfers
da19: Command Queueing enabled
da19: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da14 at mpr1 bus 0 scbus1 target 22 lun 0
da14: <ATA SAMSUNG MZ7KM960 003Q> Fixed Direct Access SPC-4 SCSI device
da14: Serial Number S2L2NWAG701287L
da14: 1200.000MB/s transfers
da14: Command Queueing enabled
da14: 915715MB (1875385008 512 byte sectors: 255H 63S/T 116737C)
da17 at mpr2 bus 0 scbus14 target 9 lun 0
da17: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da17: Serial Number Z4F0BMTX0000R551NUEH
da17: 1200.000MB/s transfers
da17: Command Queueing enabled
da17: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da20 at mpr2 bus 0 scbus14 target 12 lun 0
da20: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da20: Serial Number Z4F0BFL20000R548HJTN
da20: 1200.000MB/s transfers
da20: Command Queueing enabled
da20: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da23 at mpr2 bus 0 scbus14 target 15 lun 0
da23: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da23: Serial Number Z4F0BM690000R551NSDP
da23: 1200.000MB/s transfers
da23: Command Queueing enabled
da23: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da26 at mpr2 bus 0 scbus14 target 18 lun 0
da26: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da26: Serial Number Z4F0BT4B0000R551NVJD
da26: 1200.000MB/s transfers
da26: Command Queueing enabled
da26: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da28 at mpr2 bus 0 scbus14 target 39 lun 0
da28: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da28: Serial Number Z4F0BMEA0000R551PA2G
da28: 1200.000MB/s transfers
da28: Command Queueing enabled
da28: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da31 at mpr2 bus 0 scbus14 target 42 lun 0
da31: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da31: Serial Number Z4F0BN5C0000R551NW9C
da31: 1200.000MB/s transfers
da31: Command Queueing enabled
da31: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da34 at mpr2 bus 0 scbus14 target 45 lun 0
da34: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da34: Serial Number Z4F0BT3M0000R551NTPG
da34: 1200.000MB/s transfers
da34: Command Queueing enabled
da34: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da37 at mpr2 bus 0 scbus14 target 48 lun 0
da37: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da37: Serial Number Z4F0BMGK0000R551NWLG
da37: 1200.000MB/s transfers
da37: Command Queueing enabled
da37: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da7: <SEAGATE ST600MP0005 N003> Fixed Direct Access SPC-4 SCSI device
da7: Serial Number S7M016V90000J449GN30
da7: 1200.000MB/s transfers
da7: Command Queueing enabled
da7: 572325MB (1172123568 512 byte sectors: 255H 63S/T 72961C)
da15 at mpr1 bus 0 scbus1 target 23 lun 0
da22 at mpr2 bus 0 scbus14 target 14 lun 0
da22: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da15: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da15: Serial Number Z4F0BRB00000R551NWNR
da15: 1200.000MB/s transfers
da15: Command Queueing enabled
da15: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da18 at mpr2 bus 0 scbus14 target 10 lun 0
da18: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da18: Serial Number Z4F0BTDW0000R544PAJB
da18: 1200.000MB/s transfers
da18: Command Queueing enabled
da18: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da21 at mpr2 bus 0 scbus14 target 13 lun 0
da21: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da21: Serial Number Z4F0BMX90000R551NVLQ
da21: 1200.000MB/s transfers
da21: Command Queueing enabled
da21: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da24 at mpr2 bus 0 scbus14 target 16 lun 0
da24: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da24: Serial Number Z4F0BLZD0000R551NWQ5
da24: 1200.000MB/s transfers
da24: Command Queueing enabled
da24: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da27 at mpr2 bus 0 scbus14 target 19 lun 0
da27: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da27: Serial Number Z4F0BRBA0000R551NUC6
da27: 1200.000MB/s transfers
da27: Command Queueing enabled
da27: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da29 at mpr2 bus 0 scbus14 target 40 lun 0
da29: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da29: Serial Number Z4F0BM7E0000R551P9UJ
da29: 1200.000MB/s transfers
da29: Command Queueing enabled
da29: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da32 at mpr2 bus 0 scbus14 target 43 lun 0
da32: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da32: Serial Number Z4F0BLZF0000R551NUWR
da32: 1200.000MB/s transfers
da32: Command Queueing enabled
da32: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da35 at mpr2 bus 0 scbus14 target 46 lun 0
da35: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da35: Serial Number Z4F0BLN00000R551P9CY
da35: 1200.000MB/s transfers
da35: Command Queueing enabled
da35: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da38 at mpr2 bus 0 scbus14 target 49 lun 0
da38: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da38: Serial Number Z4F0BG6Y0000R548HL0Y
da38: 1200.000MB/s transfers
da38: Command Queueing enabled
da38: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da22: Serial Number Z4F0BSEP0000R548YZLB
da22: 1200.000MB/s transfers
da22: Command Queueing enabled
da22: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da25 at mpr2 bus 0 scbus14 target 17 lun 0
da25: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da25: Serial Number Z4F0BT2T0000R551NSSW
da25: 1200.000MB/s transfers
da25: Command Queueing enabled
da25: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da30 at mpr2 bus 0 scbus14 target 41 lun 0
da30: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da30: Serial Number Z4F0BG2Z0000R548HL43
da30: 1200.000MB/s transfers
da30: Command Queueing enabled
da30: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da33 at mpr2 bus 0 scbus14 target 44 lun 0
da33: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da33: Serial Number Z4F0BR9X0000R551P9JR
da33: 1200.000MB/s transfers
da33: Command Queueing enabled
da33: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da36 at mpr2 bus 0 scbus14 target 47 lun 0
da36: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da36: Serial Number Z4F0BRKH0000R548WQAT
da36: 1200.000MB/s transfers
da36: Command Queueing enabled
da36: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da39 at mpr2 bus 0 scbus14 target 50 lun 0
da39: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device
da39: Serial Number Z4F0BRP30000R548YYMT
da39: 1200.000MB/s transfers
da39: Command Queueing enabled
da39: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da12 at mpr1 bus 0 scbus1 target 20 lun 0
da12: <ATA SAMSUNG MZ7KM960 003Q> Fixed Direct Access SPC-4 SCSI device
da12: Serial Number S2L2NWAG701295X
da12: 1200.000MB/s transfers
da12: Command Queueing enabled
da12: 915715MB (1875385008 512 byte sectors: 255H 63S/T 116737C)
ada0 at ahcich8 bus 0 scbus11 target 0 lun 0
ada0: <INTEL SSDSC2BB080G6 G2010130> ACS-2 ATA SATA 3.x device
ada0: Serial Number BTWA518309N3080BGN
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada0: Command Queueing enabled
ada0: 76319MB (156301488 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad20
ada1 at ahcich9 bus 0 scbus12 target 0 lun 0
ada1: <INTEL SSDSC2BB080G6 G2010130> ACS-2 ATA SATA 3.x device
ada1: Serial Number BTWA518309N0080BGN
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada1: Command Queueing enabled
ada1: 76319MB (156301488 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad22
ses0 at mpr0 bus 0 scbus0 target 32 lun 0
ses0: <LSI SAS3x48 0701> Fixed Enclosure Services SPC-3 SCSI device
ses0: Serial Number 
\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?
ses0: 1200.000MB/s transfers
ses0: Command Queueing enabled
ses0: SCSI-3 ENC Device
ses1 at mpr1 bus 0 scbus1 target 32 lun 0
ses1: <LSI SAS3x36 0701> Fixed Enclosure Services SPC-3 SCSI device
ses1: Serial Number 
\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?
ses1: 1200.000MB/s transfers
ses1: Command Queueing enabled
ses1: SCSI-3 ENC Device
ses2 at ahciem0 bus 0 scbus6 target 0 lun 0
ses2: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses2: SEMB SES Device
ses3 at ahciem1 bus 0 scbus13 target 0 lun 0
ses3: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses3: SEMB SES Device
ses4 at mpr2 bus 0 scbus14 target 20 lun 0
ses4: <LSI SAS3x28 0701> Fixed Enclosure Services SPC-3 SCSI device
ses4: Serial Number 
\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?
ses4: 1200.000MB/s transfers
ses4: Command Queueing enabled
ses4: SCSI-3 ENC Device
ses5 at mpr2 bus 0 scbus14 target 63 lun 0
ses5: <LSI SAS3x48 0701> Fixed Enclosure Services SPC-3 SCSI device
ses5: Serial Number 
\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?
ses5: 1200.000MB/s transfers
ses5: Command Queueing enabled
ses5: SCSI-3 ENC Device
SMP: AP CPU #10 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #11 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #9 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #8 Launched!
Timecounter "TSC" frequency 1900035932 Hz quality 1000
GEOM_MIRROR: Device mirror/swap launched (2/2).
Trying to mount root from zfs:ZFS-AF/ROOT/default []...
uhid0: <Apple Inc. Apple Keyboard, class 0/0, rev 2.00/0.74, addr 2> on 
usbus0
ums0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 4> 
on usbus0
ums0: 3 buttons and [Z] coordinates ID=0
ix0: link state changed to UP
lagg0: link state changed to UP
ix0: link state changed to DOWN
lagg0: link state changed to DOWN
ix0: link state changed to UP
lagg0: link state changed to UP
ix1: link state changed to UP
ix2: link state changed to UP
ix3: link state changed to UP
[root at ZFS-AF ~]#



More information about the freebsd-scsi mailing list