sporadic CAM (all devices) outage on 11-stable, mps(4), ahci(4) and bhyve(8) involved.

Fri Dec 9 14:42:39 UTC 2016

Bad memory or CPU?

On 09/12/2016 14:23, Harald Schmalzbauer wrote:
>   Hello,
>
> I have big problems with my 11-stable bhyve playground.
>
> Suddenly (the machine ran without CAM-I/O-load for days), all CAM
> devices fail one after another – reproducable.
> It happens e.g. during buildworld, in the following example buildworld
> run inside bhyve guest.
>
> The system has a zfs bootpool and root on mirror-stripe zpool.
> Unfortunately I only have the kernel messages, see next lines.
>
> I guess the interesting point is that _all_ devices over different
> controllers are affected. There's mps(4) and ahci(4) involved.
>
> Can someony with SCB/CAM/SCSIcmd understanding see what's wrong here?
>
> Thanks in advance,
>
> -Harry
>
> ahcich6: Timeout on slot 6 port 0
> ahcich6: is 00000000 cs 00000000 ss 00003fc0 rs 00003fc0 tfd 40 serr
> 00000000 cmd 0004cc17
> (ada6:ahcich6:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 18 c0 da 7f 40 06 00
> 00 00 00 00
> (ada6:ahcich6:0:0:0): CAM status: Command timeout
> (ada6:ahcich6:0:0:0): Retrying command
> ahcich6: Timeout on slot 20 port 0
> ahcich6: is 00000000 cs 0e000000 ss 0ff00000 rs 0ff00000 tfd c0 serr
> 00000000 cmd 0004d917
> (ada6:ahcich6:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 18 c0 da 7f 40 06 00
> 00 00 00 00
> (ada6:ahcich6:0:0:0): CAM status: Command timeout
> (ada6:ahcich6:0:0:0): Retrying command
> ahcich6: Timeout on slot 28 port 0
> ahcich6: is 00000000 cs 10000000 ss 00000000 rs 10000000 tfd 150 serr
> 00000000 cmd 0004dc17
> (aprobe0:ahcich6:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00
> 00 00 00
> (aprobe0:ahcich6:0:0:0): CAM status: Command timeout
> (aprobe0:ahcich6:0:0:0): Retrying command
> ahcich6: Timeout on slot 29 port 0
> ahcich6: is 00000000 cs 20000000 ss 00000000 rs 20000000 tfd 150 serr
> 00000000 cmd 0004dd17
> (aprobe0:ahcich6:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00
> 00 00 00
> (aprobe0:ahcich6:0:0:0): CAM status: Command timeout
> (aprobe0:ahcich6:0:0:0): Error 5, Retries exhausted
> ahcich6: Timeout on slot 30 port 0
> ahcich6: is 00000000 cs 40000000 ss 00000000 rs 40000000 tfd 150 serr
> 00000000 cmd 0004de17
> (aprobe0:ahcich6:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00
> 00 00 00
> (aprobe0:ahcich6:0:0:0): CAM status: Command timeout
> (aprobe0:ahcich6:0:0:0): Error 5, Retry was blocked
> ada6 at ahcich6 bus 0 scbus12 target 0 lun 0
> ada6: <INTEL SSDSC2CT060A3 300i> s/n BTMP317600EG060AGN detached
> ahcich6: Timeout on slot 31 port 0
> ahcich6: is 00000000 cs 80000000 ss 00000000 rs 80000000 tfd 150 serr
> 00000000 cmd 0004df17
> (aprobe0:ahcich6:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00
> 00 00 00
> (aprobe0:ahcich6:0:0:0): CAM status: Command timeout
> (aprobe0:ahcich6:0:0:0): Retrying command
> ahcich6: Timeout on slot 0 port 0
> ahcich6: is 00000000 cs 00000001 ss 00000000 rs 00000001 tfd 150 serr
> 00000000 cmd 0004c017
> (aprobe0:ahcich6:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00
> 00 00 00
> (aprobe0:ahcich6:0:0:0): CAM status: Command timeout
> (aprobe0:ahcich6:0:0:0): Error 5, Retries exhausted
> ahcich6: Poll timeout on slot 1 port 0
> ahcich6: is 00000000 cs 00000002 ss 00000000 rs 00000002 tfd 150 serr
> 00000000 cmd 0004c117
> (aprobe0:ahcich6:0:0:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00
> 00 00
> (aprobe0:ahcich6:0:0:0): CAM status: Command timeout
> (aprobe0:ahcich6:0:0:0): Error 5, Retries exhausted
> SGL for command 0xfffffe000112f750
> 0000 0c 00 00 00 00 00 00 00 00 00 00 00 7c d1 b9 bc |............|...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 05 f0 ce ed 00 00 08 00 00 00 00 00 00 00 |*...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 d7 00 10 d8 d0 01 00 00 00 00 00 00 00 |................|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x001000 addr=0x00000001d0d81000
> SGL for command 0xfffffe000112c810
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 f0 ce ed 00 00 08 00
> 0000 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> 0a(da0: 00mps0:0: 002: 000): 00Retrying command
> 00 00 00 00 00 00 00 0c ae b9 bc |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 05 41 ae ed 00 00 08 00 00 00 00 00 00 00 |*..A............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 d7 00 90 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x001000 addr=0x00000001d0709000
> (da2:mps0:0:4:0): WRITE(10). CDB: 2a 00 05 41 ae ed 00 00 08 00
> (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da2:mps0:0:4:0): Retrying command
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 af d9 99 00 00 08 00
> (da0:mps0:0:2:0): CAM status: SCSI Status Error
> (da0:mps0:0:2:0): SCSI status: Check Condition
> (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> SGL for command 0xfffffe000112ff30
> (da0:0000 mps0:0: 0c2: 000): 00Retrying command (per sense data)
> 00 00 00 00 00 00 00 00 00 64 d7 b9 bc |............d...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 05 f0 ce ed 00 00 08 00 00 00 00 00 00 00 |*...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 d7 00 10 d8 d0 01 00 00 00 00 00 00 00 |................|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x001000 addr=0x00000001d0d81000
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 f0 ce ed 00 00 08 00
> (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da0:mps0:0:2:0): Retrying command
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 f0 ce ed 00 00 08 00
> (da0:mps0:0:2:0): CAM status: SCSI Status Error
> (da0:mps0:0:2:0): SCSI status: Check Condition
> (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da0:mps0:0:2:0): Retrying command (per sense data)
> SGL for command 0xfffffe000112c030
> 0000 0c 00 00 00 00 00 00 00 00 00 00 00 24 a8 b9 bc |............$...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 05 f0 ce ed 00 00 08 00 00 00 00 00 00 00 |*...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 d7 00 10 d8 d0 01 00 00 00 00 00 00 00 |................|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x001000 addr=0x00000001d0d81000
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 f0 ce ed 00 00 08 00
> (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da0:mps0:0:2:0): Retrying command
> (da2:mps0:0:4:0): WRITE(10). CDB: 2a 00 05 41 ae ed 00 00 08 00
> (da2:mps0:0:4:0): CAM status: SCSI Status Error
> (da2:mps0:0:4:0): SCSI status: Check Condition
> (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da2:mps0:0:4:0): Retrying command (per sense data)
> (da0:mps0:0:2:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
> (da0:mps0:0:2:0): CAM status: SCSI Status Error
> (da0:mps0:0:2:0): SCSI status: Check Condition
> (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da0:mps0:0:2:0): Retrying command (per sense data)
> SGL for command 0xfffffe00010fd800
> 0000 0a 00 00 00 00 00 00 00 00 00 00 00 00 7a b7 bc |.............z..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 02 00 00 |................|
> 0040 35 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |5...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 00 00 d7 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x000000 addr=0x0000000000000000
> SGL for command 0xfffffe00010f2ac0
> (da2:mps0:0:4:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
> 0000 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error
> 0a(da2: 00mps0:0: 004: 000): 00Retrying command
> 00 00 00 00 00 00 00 10 f8 b6 bc |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 05 41 ae ed 00 00 08 00 00 00 00 00 00 00 |*..A............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 d7 00 90 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x001000 addr=0x00000001d0709000
> SGL for command 0xfffffe0001105750
> 0000 0c 00 00 00 00 00 00 00 00 00 00 00 7c d9 b7 bc |............|...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 02 00 00 |................|
> 0040 35 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |5...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 00 00 d7 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000000 addr=0x0000000000000000
> SGL for command 0xfffffe00010ed180
> 0000 0c 00 00 00 00 00 00 00 00 00 00 00 20 b5 b6 bc |............ ...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 05 f0 ce ed 00 00 08 00 00 00 00 00 00 00 |*...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 d7 00 10 d8 d0 01 00 00 00 00 00 00 00 |................|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x001000 addr=0x00000001d0d81000
> (da2:mps0:0:4:0): WRITE(10). CDB: 2a 00 05 41 ae ed 00 00 08 00
> (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da2:mps0:0:4:0): Retrying command
> (da0:mps0:0:2:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
> (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da0:mps0:0:2:0): Error 5, Retries exhausted
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 f0 ce ed 00 00 08 00
> (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da0:mps0:0:2:0): Error 5, Retries exhausted
> (da2:mps0:0:4:0): WRITE(10). CDB: 2a 00 05 41 ae ed 00 00 08 00
> (da2:mps0:0:4:0): CAM status: SCSI Status Error
> (da2:mps0:0:4:0): SCSI status: Check Condition
> (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da2:mps0:0:4:0): Retrying command (per sense data)
> (da0:mps0:0:2:0): READ(10). CDB: 28 00 1b e2 9e 10 00 00 10 00
> (da0:mps0:0:2:0): CAM status: SCSI Status Error
> (da0:mps0:0:2:0): SCSI status: Check Condition
> (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da0:mps0:0:2:0): Retrying command (per sense data)
> SGL for command 0xfffffe00010ea4e0
> 0000 0a 00 00 00 00 00 00 00 00 00 00 00 a8 93 b6 bc |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 30 00 00 |.............0..|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 00 b9 a1 18 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 16 00 30 bc be 00 00 00 00 00 10 00 96 |.....0..........|
> 0070 00 10 b7 bb 00 00 00 00 80 00 00 30 00 16 b2 bc |...........0....|
> seg0 flags=0x16 len=0x001000 addr=0x00000000bebc3000
> seg1 flags=0x96 len=0x001000 addr=0x00000000bbb71000
> chain flags=0x30 len=0x80 Offset=0x0 Address=0xbcb21600
> 0000 00 10 00 d7 00 70 29 a7 01 00 00 00 00 00 00 00 |.....p).........|
> 0010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0040 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0070 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> seg2 flags=0xd7 len=0x001000 addr=0x00000001a7297000
> SGL for command 0xfffffe000112d530
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 00 b9 a1 18 00
> 0000 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error
> 0a(da2: 00mps0:0: 004: 000): 00Retrying command
> 00 00 00 00 00 00 00 e4 b7 b9 bc |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 05 41 ae ed 00 00 08 00 00 00 00 00 00 00 |*..A............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 d7 00 90 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x001000 addr=0x00000001d0709000
> (da2:mps0:0:4:0): WRITE(10). CDB: 2a 00 05 41 ae ed 00 00 08 00
> (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da2:mps0:0:4:0): Error 5, Retries exhausted
> (da2:mps0:0:4:0): READ(6). CDB: 08 00 02 10 10 00
> (da2:mps0:0:4:0): CAM status: SCSI Status Error
> (da2:mps0:0:4:0): SCSI status: Check Condition
> (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da2:mps0:0:4:0): Retrying command (per sense data)
> SGL for command 0xfffffe000110a760
> 0000 0a 00 00 00 00 00 00 00 00 00 00 00 88 15 b8 bc |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0e 00 00 |................|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 1e e3 6e 07 00 00 00 00 00 00 00 00 00 00 00 |...n............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0e 00 d7 00 10 d8 d0 01 00 00 00 00 00 00 00 |................|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x000e00 addr=0x00000001d0d81000
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e3 6e 07 00
> (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da2:mps0:0:4:0): Retrying command
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e3 6e 07 00
> (da2:mps0:0:4:0): CAM status: SCSI Status Error
> (da2:mps0:0:4:0): SCSI status: Check Condition
> (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da2:mps0:0:4:0): Retrying command (per sense data)
> SGL for command 0xfffffe0001105b40
> 0000 0a 00 00 00 00 00 00 00 00 00 00 00 70 dc b7 bc |............p...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 02 00 00 |................|
> 0040 35 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |5...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 00 00 d7 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000000 addr=0x0000000000000000
> SGL for command 0xfffffe0001108fc0
> (da2:mps0:0:4:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
> 0000 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error
> 0a(da2: 00mps0:0: 004: 000): 00Retrying command
> 00 00 00 00 00 00 00 d0 03 b8 bc |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0e 00 00 |................|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 1e e3 6e 07 00 00 00 00 00 00 00 00 00 00 00 |...n............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0e 00 d7 00 10 d8 d0 01 00 00 00 00 00 00 00 |................|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x000e00 addr=0x00000001d0d81000
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e3 6e 07 00
> (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da2:mps0:0:4:0): Retrying command
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e3 6e 07 00
> (da2:mps0:0:4:0): CAM status: SCSI Status Error
> (da2:mps0:0:4:0): SCSI status: Check Condition
> (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da2:mps0:0:4:0): Retrying command (per sense data)
> SGL for command 0xfffffe0001115350
> 0000 0a 00 00 00 00 00 00 00 00 00 00 00 7c 96 b8 bc |............|...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0e 00 00 |................|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 1e e3 6e 07 00 00 00 00 00 00 00 00 00 00 00 |...n............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0e 00 d7 00 10 d8 d0 01 00 00 00 00 00 00 00 |................|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x000e00 addr=0x00000001d0d81000
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e3 6e 07 00
> (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da2:mps0:0:4:0): Error 5, Retries exhausted
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 00 ba 49 08 00
> (da2:mps0:0:4:0): CAM status: SCSI Status Error
> (da2:mps0:0:4:0): SCSI status: Check Condition
> (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da2:mps0:0:4:0): Retrying command (per sense data)
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e3 98 f4 00
> (da2:mps0:0:4:0): CAM status: SCSI Status Error
> (da2:mps0:0:4:0): SCSI status: Check Condition
> (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da2:mps0:0:4:0): Retrying command (per sense data)
> SGL for command 0xfffffe00010e5cb0
> 0000 0c 00 00 00 00 00 00 00 00 00 00 00 84 5d b6 bc |.............]..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 05 ef 5f 0b 00 00 08 00 00 00 00 00 00 00 |*..._...........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 d7 00 90 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 d0 b4 bb 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> seg0 flags=0xd7 len=0x001000 addr=0x00000001d0709000
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 ef 5f 0b 00 00 08 00
> (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da0:mps0:0:2:0): Retrying command
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 ef 5f 0b 00 00 08 00
> (da0:mps0:0:2:0): CAM status: SCSI Status Error
> (da0:mps0:0:2:0): SCSI status: Check Condition
> (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da0:mps0:0:2:0): Retrying command (per sense data)
> SGL for command 0xfffffe00010ff4e0
> 0000 0c 00 00 00 00 00 00 00 00 00 00 00 a8 8f b7 bc |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 00 af d9 99 00 00 08 00 00 00 00 00 00 00 |*...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 d7 00 80 fc 12 00 00 00 00 00 00 00 00 |................|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x001000 addr=0x0000000012fc8000
> SGL for command 0xfffffe0001130080
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 af d9 99 00 00 08 00
> 0000 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> 0c(da0: 00mps0:0: 002: 000): 00Retrying command
> 00 00 00 00 00 00 00 60 d8 b9 bc |............`...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 05 ef 5f 0b 00 00 08 00 00 00 00 00 00 00 |*..._ahcich6:
> .Timeout on slot 2 port 0
> .ahcich6: .is 00000000 cs 00000004 ss 00000000 rs 00000004 tfd 150 serr
> 00000000 cmd 0004c217
> ........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 d7 00 90 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x001000 addr=0x00000001d0709000
> (ada6:ahcich6:0:0:0): SETFEATURES ENABLE RCACHE. ACB: ef aa 00 00 00 40
> 00 00 00 00 00 00
> (ada6:ahcich6:0:0:0): CAM status: Command timeout
> (ada6:ahcich6:0:0:0): Error 5, Periph was invalidated
> ahcich6: Poll timeout on slot 3 port 0
> ahcich6: is 00000000 cs 00000008 ss 00000000 rs 00000008 tfd 150 serr
> 00000000 cmd 0004c317
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 ef 5f 0b 00 00 08 00
> (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da0:mps0:0:2:0): Retrying command
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 af d9 99 00 00 08 00
> (da0:mps0:0:2:0): CAM status: SCSI Status Error
> (da0:mps0:0:2:0): SCSI status: Check Condition
> (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da0:mps0:0:2:0): Retrying command (per sense data)
> (aprobe0:ahcich6:0:0:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00
> 00 00
> (aprobe0:ahcich6:0:0:0): CAM status: Command timeout
> (aprobe0:ahcich6:0:0:0): Error 5, Retries exhausted
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 ef 5f 0b 00 00 08 00
> (da0:mps0:0:2:0): CAM status: SCSI Status Error
> (da0:mps0:0:2:0): SCSI status: Check Condition
> (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da0:mps0:0:2:0): Retrying command (per sense data)
> SGL for command 0xfffffe0001125340
> 0000 0c 00 00 00 00 00 00 00 00 00 00 00 70 56 b9 bc |............pV..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 02 00 00 |................|
> 0040 35 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |5...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 00 00 d7 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x000000 addr=0x0000000000000000
> SGL for command 0xfffffe00010f9510
> (da0:mps0:0:2:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
> 0000 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> 0c(da0: 00mps0:0: 002: 000): 00Retrying command
> 00 00 00 00 00 00 00 cc 47 b7 bc |.............G..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 05 ef 5f 0b 00 00 08 00 00 00 00 00 00 00 |*..._...........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 d7 00 90 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x001000 addr=0x00000001d0709000
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 ef 5f 0b 00 00 08 00
> (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da0:mps0:0:2:0): Error 5, Retries exhausted
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 ce 07 3d 00 00 0a 00
> (da0:mps0:0:2:0): CAM status: SCSI Status Error
> (da0:mps0:0:2:0): SCSI status: Check Condition
> (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da0:mps0:0:2:0): Retrying command (per sense data)
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 ce 07 9e 00 00 03 00
> (da0:mps0:0:2:0): CAM status: SCSI Status Error
> (da0:mps0:0:2:0): SCSI status: Check Condition
> (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da0:mps0:0:2:0): Retrying command (per sense data)
> SGL for command 0xfffffe0001115dd0
> 0000 09 00 00 00 00 00 00 00 00 00 00 00 5c 9e b8 bc |............\134...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 14 3b 7d 05 00 00 00 00 00 00 00 00 00 00 00 |..;}............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> SGL for command 0xfffffe000112f8a0
> (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00
> 0000 (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error
> 0b(da3: 00mps0:0: 005: 000): 00Retrying command
> 00 00 00 00 00 00 00 78 d2 b9 bc |............x...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 00 c3 5b 7d 00 00 05 00 00 00 00 00 00 00 |*...[}..........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00
> (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da1:mps0:0:3:0): Retrying command
> (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00
> (da3:mps0:0:5:0): CAM status: SCSI Status Error
> (da3:mps0:0:5:0): SCSI status: Check Condition
> (da3:mps0:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da3:mps0:0:5:0): Retrying command (per sense data)
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00
> (da1:mps0:0:3:0): CAM status: SCSI Status Error
> (da1:mps0:0:3:0): SCSI status: Check Condition
> (da1:mps0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> SGL for command 0xfffffe000111ade0
> (da1:0000 mps0:0: 093: 000): 00Retrying command (per sense data)
> 00 00 00 00 00 00 00 00 00 68 da b8 bc |............h...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 14 3b 7d 05 00 00 00 00 00 00 00 00 00 00 00 |..;}............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00
> (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da3:mps0:0:5:0): Retrying command
> SGL for command 0xfffffe00011165b0
> 0000 0b 00 00 00 00 00 00 00 00 00 00 00 44 a4 b8 bc |............D...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 02 00 00 |................|
> 0040 35 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |5...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 00 00 d7 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000000 addr=0x0000000000000000
> SGL for command 0xfffffe000112a9e0
> (da1:mps0:0:3:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
> 0000 (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error
> 0b(da1: 00mps0:0: 003: 000): 00Retrying command
> 00 00 00 00 00 00 00 68 97 b9 bc |............h...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 00 c3 5b 7d 00 00 05 00 00 00 00 00 00 00 |*...[}..........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00
> (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da1:mps0:0:3:0): Retrying command
> (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00
> (da3:mps0:0:5:0): CAM status: SCSI Status Error
> (da3:mps0:0:5:0): SCSI status: Check Condition
> (da3:mps0:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da3:mps0:0:5:0): Retrying command (per sense data)
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00
> (da1:mps0:0:3:0): CAM status: SCSI Status Error
> (da1:mps0:0:3:0): SCSI status: Check Condition
> (da1:mps0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> SGL for command 0xfffffe000111a4b0
> (da1:0000 mps0:0: 093: 000): 00Retrying command (per sense data)
> 00 00 00 00 00 00 00 00 00 84 d3 b8 bc |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 14 3b 7d 05 00 00 00 00 00 00 00 00 00 00 00 |..;}............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00
> (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da3:mps0:0:5:0): Error 5, Retries exhausted
> SGL for command 0xfffffe000112dbc0
> 0000 0b 00 00 00 00 00 00 00 00 00 00 00 d0 bc b9 bc |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 00 c3 5b 7d 00 00 05 00 00 00 00 00 00 00 |*...[}..........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00
> (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da1:mps0:0:3:0): Error 5, Retries exhausted
> (da3:mps0:0:5:0): WRITE(6). CDB: 0a 0c 0d a4 08 00
> (da3:mps0:0:5:0): CAM status: SCSI Status Error
> (da3:mps0:0:5:0): SCSI status: Check Condition
> (da3:mps0:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da3:mps0:0:5:0): Retrying command (per sense data)
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 af 8b 04 00 00 10 00
> (da1:mps0:0:3:0): CAM status: SCSI Status Error
> (da1:mps0:0:3:0): SCSI status: Check Condition
> (da1:mps0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da1:mps0:0:3:0): Retrying command (per sense data)
> SGL for command 0xfffffe00010e1870
> 0000 0b 00 00 00 00 00 00 00 00 00 00 00 54 2a b6 bc |............T*..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 00 c3 5b 7d 00 00 05 00 00 00 00 00 00 00 |*...[}..........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 30 d5 76 01 00 00 00 80 00 00 30 80 13 b2 bc |.0.v.......0....|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> SGL for command 0xfffffe0001123a50
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00
> 0000 (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error
> 09(da1: 00mps0:0: 003: 000): 00Retrying command
> 00 00 00 00 00 00 00 bc 43 b9 bc |.............C..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 14 3b 7d 05 00 00 00 00 00 00 00 00 00 00 00 |..;}............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> SGL for command 0xfffffe0001107040
> 0000 0c 00 00 00 00 00 00 00 00 00 00 00 30 ec b7 bc |............0...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 00 af da 71 00 00 08 00 00 00 00 00 00 00 |*....q..........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 d7 00 80 fc 12 00 00 00 00 00 00 00 00 |................|
> 0070 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> seg0 flags=0xd7 len=0x001000 addr=0x0000000012fc8000
> SGL for command 0xfffffe00010ea390
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 af da 71 00 00 08 00
> 0000 0c 00 00 00 00 00 00 00 00 00 00 00 ac 92 b6 bc |................|
> 0010 00(da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> 00(da0: fcmps0:0: 002: 180): 00Retrying command
> 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 00 ce 07 e1 00 00 05 00 00 00 00 00 00 00 |*...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> SGL for command 0xfffffe000112e640
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 ce 07 e1 00 00 05 00
> 0000 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> 0a(da0: 00mps0:0: 002: 00 00 00 00 00 00 00 00 00 b0 c4 b9 bc
> |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................|
> 0020 00 00 000): 00Retrying command
> 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 00 ba 71 08 00 00 00 00 00 00 00 00 00 00 00 |...q............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 d7 00 80 fc 12 00 00 00 00 00 00 00 00 |................|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x001000 addr=0x0000000012fc8000
> SGL for command 0xfffffe00011312e0
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 00 ba 71 08 00
> 0000 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error
> 0a(da2: 00mps0:0: 004: 000): 00Retrying command
> 00 00 00 00 00 00 00 28 e6 b9 bc |............(...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 1e e7 e1 05 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e7 e1 05 00
> (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00
> (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da2:(da3:mps0:0:mps0:0:4:5:0): 0): Retrying command
> Retrying command
> (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00
> (da3:mps0:0:5:0): CAM status: SCSI Status Error
> (da3:mps0:0:5:0): SCSI status: Check Condition
> (da3:mps0:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da3:mps0:0:5:0): Retrying command (per sense data)
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00
> (da1:mps0:0:3:0): CAM status: SCSI Status Error
> (da1:mps0:0:3:0): SCSI status: Check Condition
> (da1:mps0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> SGL for command 0xfffffe0001125b20
> (da1:0000 mps0:0: 093: 000): 00Retrying command (per sense data)
> 00 00 00 00 00 00 00 00 00 58 5c b9 bc |............X\134..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 14 3b 7d 05 00 00 00 00 00 00 00 00 00 00 00 |..;}............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00
> (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da3:mps0:0:5:0): Retrying command
> SGL for command 0xfffffe00010ed960
> 0000 0b 00 00 00 00 00 00 00 00 00 00 00 08 bb b6 bc |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 00 c3 5b 7d 00 00 05 00 00 00 00 00 00 00 |*...[}..........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 20 84 01 00 00 00 00 00 00 00 00 00 00 00 |.. .............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00
> (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 00 ba 71 08 00
> (da1:(da2:mps0:0:4:0): CAM status: SCSI Status Error
> mps0:0:(da2:mps0:0:4:0): SCSI status: Check Condition
> 3:(da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
> reset, or bus device reset occurred)
> 0): (da2:Retrying command
> mps0:0:(da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00
> 4:(da3:mps0:0:5:0): CAM status: SCSI Status Error
> 0): SGL for command 0xfffffe00010e1f00
> (da3:mps0:0:5:0): SCSI status: Check Condition
> Retrying command (per sense data)
> 0000 (da3:mps0:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
> reset, or bus device reset occurred)
> 0a(da3: 00mps0:0: 005:(da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 af da
> 71 00 00 08 00
> 000): (da0:mps0:0:2:0): CAM status: SCSI Status Error
> 00(da0:mps0:0:2:0): SCSI status: Check Condition
> Retrying command (per sense data)
> 00 00 00 00 00 00 00 40 2f b6 bc |............@/..|
> 0010 00(da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
> reset, or bus device reset occurred)
> 00(da0: fcmps0:0: 002: 180): 00Retrying command (per sense data)
> 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 1e e7 e1 05 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> SGL for command 0xfffffe000112b460
> 0000 0c 00 00 00 00 00 00 00 00 00 00 00 48 9f b9 bc |............H...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 00 ce 07 e1 00 00 05 00 00 00 00 00 00 00 |*...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e7 e1 05 00
> (da1:mps0:0:3:0): CAM status: SCSI Status Error
> (da1:mps0:0:3:0): SCSI status: Check Condition
> (da1:mps0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> SGL for command 0xfffffe000111b710
> (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da1:(da2:0000 mps0:0:mps0:0: 093: 000): 4:Retrying command (per sense data)
> 0): 00 00Retrying command
> 00 00 00 00 00 00 00 00 4c e1 b8 bc |............L...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 14 3b 7d 05 00 00 00 00 00 00 00 00 00 00 00 |..;}............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 ce 07 e1 00 00 05 00
> (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da3:(da0:mps0:0:mps0:0:5:2:0): 0): Error 5, Retries exhausted
> Retrying command
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e7 e1 05 00
> (da2:mps0:0:4:0): CAM status: SCSI Status Error
> (da2:mps0:0:4:0): SCSI status: Check Condition
> (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> SGL for command 0xfffffe00011272c0
> (da2:0000 mps0:0: 0b4: 000): 00Retrying command (per sense data)
> 00 00 00 00 00 00 00 00 00 10 6e b9 bc |.............n..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 00 c3 5b 7d 00 00 05 00 00 00 00 00 00 00 |*...[}..........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> SGL for command 0xfffffe000110de80
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00
> 0000 (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error
> 0c(da1: 00mps0:0: 003: 000): 00Error 5, Retries exhausted
> 00 00 00 00 00 00 00 e0 3e b8 bc |.............>..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 00 ce 07 e1 00 00 05 00 00 00 00 00 00 00 |*...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 af da 71 00 00 08 00
> (da0:mps0:0:2:0): CAM status: SCSI Status Error
> (da0:mps0:0:2:0): SCSI status: Check Condition
> (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> SGL for command 0xfffffe0001126450
> (da0:0000 mps0:0: 0a2: 000): 00Retrying command (per sense data)
> 00(da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 ce 07 e1 00 00 05 00
> 00(da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> 00(da0: 00 00 00 00 00 00 3c 63 b9 bc |............<c..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00mps0:0: 0a2: 000): 00Retrying
> command
> |................|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 1e e7 e1 05 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e7 e1 05 00
> (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da2:mps0:0:4:0): Retrying command
> (da3:mps0:0:5:0): WRITE(10). CDB: 2a 00 05 41 3d 20 00 00 05 00
> (da3:mps0:0:5:0): CAM status: SCSI Status Error
> (da3:mps0:0:5:0): SCSI status: Check Condition
> (da3:mps0:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> SGL for command 0xfffffe00010e4660
> (da3:0000 mps0:0: 0b5: 000): 00Retrying command (per sense data)
> 00(da1:mps0:0:3:0): READ(10). CDB: 28 00 1b e2 9e 10 00 00 10 00
> 00(da1:mps0:0:3:0): CAM status: SCSI Status Error
> 00(da1:mps0:0:3:0): SCSI status: Check Condition
> 00(da1:mps0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
> reset, or bus device reset occurred)
> 00(da1: 00mps0:0: 003: 000): 00Retrying command (per sense data)
> c8 4c b6 bc |.............L..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 20 00 00 |............. ..|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 02 |................|
> 0040 28 00 00 af 22 10 00 00 10 00 00 00 00 00 00 00 |(..."...........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 12 00 b0 87 88 01 00 00 00 00 10 00 d3 |................|
> 0070 00 e0 41 a9 01 00 00 00 00 00 00 00 00 00 00 00 |..A.............|
> seg0 flags=0x12 len=0x001000 addr=0x000000018887b000
> seg1 flags=0xd3 len=0x001000 addr=0x00000001a941e000
> SGL for command 0xfffffe00010eaa20
> (da1:mps0:0:3:0): READ(10). CDB: 28 00 00 af 22 10 00 00 10 00
> 0000 (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error
> 0b(da1: 00mps0:0: 003: 000): 00Retrying command
> 00 00 00 00 00 00 00 98 97 b6 bc |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 20 00 00 |............. ..|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 02 |................|
> 0040 28 00 1b e2 9c 10 00 00 10 00 00 00 00 00 00 00 |(...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 10 00 12 00 30 b3 b2 01 00 00 00 00 10 00 d3 |.....0..........|
> 0070 00 d0 b0 b2 01 00 00 00 00 00 00 00 00 00 00 00 |................|
> seg0 flags=0x12 len=0x001000 addr=0x00000001b2b33000
> seg1 flags=0xd3 len=0x001000 addr=0x00000001b2b0d000
> SGL for command 0xfffffe00011211a0
> (da1:mps0:0:3:0): READ(10). CDB: 28 00 1b e2 9c 10 00 00 10 00
> 0000 (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error
> 0b(da1: 00mps0:0: 003: 000): 00Retrying command
> 00 00 00 00 00 00 00 38 25 b9 bc |............8%..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 05 f0 5d 20 00 00 05 00 00 00 00 00 00 00 |*...] ..........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 05 f0 5d 20 00 00 05 00
> (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da1:mps0:0:3:0): Retrying command
> (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e7 e1 05 00
> (da2:mps0:0:4:0): CAM status: SCSI Status Error
> SGL for command 0xfffffe000110b720
> (da2:mps0:0:4:0): SCSI status: Check Condition
> 0000 (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
> reset, or bus device reset occurred)
> 09(da2: 00mps0:0: 004: 000): 00Error 6, Retries exhausted
> 00(da2: 00mps0:0: 004: 000): 00Invalidating pack
> 00(da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 ce 07 e1 00 00 05 00
> 00(da0:mps0:0:2:0): CAM status: SCSI Status Error
> 58(da0:mps0:0:2:0): SCSI status: Check Condition
> 21(da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
> reset, or bus device reset occurred)
> b8(da0: bcmps0:0: |2:.0): .Retrying command (per sense data)
> ..........X!..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 20 00 00 |............. ..|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 1b f2 42 10 00 00 10 00 00 00 00 00 00 00 |*...B...........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 20 00 d7 00 f0 6c 09 00 00 00 00 00 00 00 00 |. ....l.........|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x002000 addr=0x00000000096cf000
> SGL for command 0xfffffe00010ef100
> (da3:mps0:0:5:0): WRITE(10). CDB: 2a 00 1b f2 42 10 00 00 10 00
> 0000 (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error
> 09(da3: 00mps0:0: 005: 000): 00Retrying command
> 00 00 00 00 00 00 00 c0 cc b6 bc |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 20 00 00 |............. ..|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 1b f2 40 10 00 00 10 00 00 00 00 00 00 00 |*... at ...........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 20 00 d7 00 40 8f 0c 00 00 00 00 00 00 00 00 |. ... at ..........|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x002000 addr=0x000000000c8f4000
> SGL for command 0xfffffe0001122a90
> (da3:mps0:0:5:0): WRITE(10). CDB: 2a 00 1b f2 40 10 00 00 10 00
> 0000 (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error
> 09(da3: 00mps0:0: 005: 000): 00Retrying command
> 00 00 00 00 00 00 00 ec 37 b9 bc |.............7..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 05 41 3d 20 00 00 05 00 00 00 00 00 00 00 |*..A= ..........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> SGL for command 0xfffffe00010e11e0
> (da3:mps0:0:5:0): WRITE(10). CDB: 2a 00 05 41 3d 20 00 00 05 00
> 0000 (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error
> 09(da3: 00mps0:0: 005: 000): 00Retrying command
> 00 00 00 00 00 00 00 68 25 b6 bc |............h%..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 20 00 00 |............. ..|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 00 02 10 10 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 20 00 d7 00 70 bf 0c 00 00 00 00 00 00 00 00 |. ...p..........|
> 0070 00 00 a0 88 01 00 00 00 00 00 00 00 00 00 00 00 |................|
> seg0 flags=0xd7 len=0x002000 addr=0x000000000cbf7000
> (da3:mps0:0:5:0): WRITE(6). CDB: 0a 00 02 10 10 00
> (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da3:mps0:0:5:0): Retrying command
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 05 f0 5d 20 00 00 05 00
> SGL for command 0xfffffe0001126ed0
> (da1:mps0:0:3:0): CAM status: SCSI Status Error
> 0000 (da1:mps0:0:3:0): SCSI status: Check Condition
> 0c(da1:mps0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
> reset, or bus device reset occurred)
> 00(da1: 00mps0:0: 003: 000): 00Retrying command (per sense data)
> 00 00 00 00 00 00 1c 6b b9 bc |.............k..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 02 00 00 |................|
> 0040 35 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |5...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 00 00 d7 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000000 addr=0x0000000000000000
> SGL for command 0xfffffe0001122010
> 0000 0c 00 00 00 00 00 00 00 00 00 00 00 0c 30 b9 bc |.............0..|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 00 ce 07 e1 00 00 05 00 00 00 00 00 00 00 |*...............|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da0:mps0:0:2:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
> (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da0:mps0:0:(da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 05 f0 5d 20 00 00 05 00
> 2:(da1:mps0:0:3:0): CAM status: SCSI Status Error
> 0): (da1:mps0:0:3:0): SCSI status: Check Condition
> Retrying command
> (da1:mps0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 ce 07 e1 00 00 05 00
> (da1:(da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error
> mps0:0:(da0:3:mps0:0:0): 2:Retrying command (per sense data)
> 0): Error 5, Retries exhausted
> SGL for command 0xfffffe00011209c0
> 0000 0b 00 00 00 00 00 00 00 00 00 00 00 50 1f b9 bc |............P...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 05 f0 5d 20 00 00 05 00 00 00 00 00 00 00 |*...] ..........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 05 f0 5d 20 00 00 05 00
> (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da1:mps0:0:3:0): Retrying command
> (da3:mps0:0:5:0): WRITE(10). CDB: 2a 00 05 41 3d 20 00 00 05 00
> (da0:mps0:0:2:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
> (da3:mps0:0:5:0): CAM status: SCSI Status Error
> (da0:mps0:0:2:0): CAM status: SCSI Status Error
> (da3:mps0:0:5:0): SCSI status: Check Condition
> (da0:mps0:0:2:0): SCSI status: Check Condition
> (da3:mps0:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da3:(da0:mps0:0:mps0:0:5:2:0): 0): Retrying command (per sense data)
> Error 6, Retries exhausted
> (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 05 f0 5d 20 00 00 05 00
> (da0:(da1:mps0:0:3:0): CAM status: SCSI Status Error
> mps0:0:(da1:mps0:0:3:0): SCSI status: Check Condition
> 2:(da1:mps0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
> reset, or bus device reset occurred)
> 0): (da1:Invalidating pack
> mps0:0:3:0): Error 6, Retries exhausted
> (da1:mps0:0:3:0): Invalidating pack
> SGL for command 0xfffffe000112de60
> 0000 09 00 00 00 00 00 00 00 00 00 00 00 c8 be b9 bc |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 90 00 00 |................|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 00 6b 4c 48 00 00 00 00 00 00 00 00 00 00 00 |..kLH...........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 90 00 d7 00 60 cf 16 00 00 00 00 00 00 00 00 |.....`..........|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x009000 addr=0x0000000016cf6000
> SGL for command 0xfffffe0001117420
> (da3:mps0:0:5:0): WRITE(6). CDB: 0a 00 6b 4c 48 00
> 0000 (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error
> 09(da3: 00mps0:0: 005: 000): 00Retrying command
> 00 00 00 00 00 00 00 18 af b8 bc |................|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 50 01 00 |.............P..|
> 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 0a 00 c5 98 a8 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 50 01 d7 00 f0 3d 84 01 00 00 00 00 00 00 00 |.P....=.........|
> 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............|
> seg0 flags=0xd7 len=0x015000 addr=0x00000001843df000
> SGL for command 0xfffffe00010f19b0
> 0000 09 00 00 00 00 00 00 00 00 00 00 00 44 eb b6 bc |............D...|
> 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................|
> 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................|
> 0040 2a 00 05 41 3d 20 00 00 05 00 00 00 00 00 00 00 |*..A= ..........|
> 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
> 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........|
> 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |.. at .............|
> seg0 flags=0xd7 len=0x000a00 addr=0x00000001d070c000
> (da3:mps0:0:5:0): WRITE(6). CDB: 0a 00 c5 98 a8 00
> (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da3:mps0:0:5:0): Retrying command
> (da3:mps0:0:5:0): WRITE(10). CDB: 2a 00 05 41 3d 20 00 00 05 00
> (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error
> (da3:mps0:0:5:0): Retrying command
> (da3:mps0:0:5:0): WRITE(10). CDB: 2a 00 05 41 3d 20 00 00 05 00
> (da3:mps0:0:5:0): CAM status: SCSI Status Error
> (da3:mps0:0:5:0): SCSI status: Check Condition
> (da3:mps0:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred)
> (da3:mps0:0:5:0): Error 6, Retries exhausted
> (da3:mps0:0:5:0): Invalidating pack
> pid 6760 (bhyve), uid 0, was killed: out of swap space
> pid 1327 (ntpd), uid 0, was killed: out of swap space
> ahcich6: Timeout on slot 4 port 0
> ahcich6: is 00000000 cs 00000010 ss 00000000 rs 00000010 tfd 150 serr
> 00000000 cmd 0004c417
> (ada6:ahcich6:0:0:0): SETFEATURES ENABLE WCACHE. ACB: ef 02 00 00 00 40
> 00 00 00 00 00 00
> (ada6:ahcich6:0:0:0): CAM status: Command timeout
> (ada6:ahcich6:0:0:0): Error 5, Periph was invalidated
> ahcich6: Poll timeout on slot 5 port 0
> ahcich6: is 00000000 cs 00000020 ss 00000000 rs 00000020 tfd 150 serr
> 00000000 cmd 0004c517
> (aprobe0:ahcich6:0:0:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00
> 00 00
> (aprobe0:ahcich6:0:0:0): CAM status: Command timeout
> (aprobe0:ahcich6:0:0:0): Error 5, Retries exhausted
>