CAM timeouts at startup

Mahlon E. Smith mahlon at martini.nu
Mon Apr 10 17:56:42 UTC 2017


Hi.  Got some new machines running 11.0-RELEASE-p8 with a small pile of SSD in them.

Getting some strange CAM timeouts at boot, that dramatically delay
startup times.  These errors don't happen at all after boot, everything
seems just fine.

Any clues / tuning suggestions are appreciated.


Relevant stuff from dmesg:

	mpr0: <Avago Technologies (LSI) SAS3008> port 0x3000-0x30ff mem 0x92000000-0x9200ffff,0x91f00000-0x91ffffff at device 0.0 numa-domain 0 on pci3
	mpr0: IOCFacts  :
			MsgVersion: 0x205
			HeaderVersion: 0x2a00
			IOCNumber: 0
			IOCExceptions: 0x0
			MaxChainDepth: 128
			NumberOfPorts: 1
			RequestCredit: 9680
			ProductID: 0x2221
			IOCRequestFrameSize: 32
			MaxInitiators: 0
			MaxTargets: 544
			MaxSasExpanders: 125
			MaxEnclosures: 126
			HighPriorityCredit: 124
			MaxReplyDescriptorPostQueueDepth: 65504
			ReplyFrameSize: 32
			MaxVolumes: 0
			MaxDevHandle: 677
			MaxPersistentEntries: 240
	mpr0: Firmware: 13.00.00.00, Driver: 13.01.00.00-fbsd
	mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc>

	da0 at mpr0 bus 0 scbus0 target 19 lun 0
	da0: <ATA SAMSUNG MZ7KM960 GB32> Fixed Direct Access SPC-4 SCSI device
	da0: Serial Number S2HTNX0H701448      
	da0: 1200.000MB/s transfers
	da0: Command Queueing enabled
	da0: 915715MB (1875385008 512 byte sectors)
	da0: quirks=0x8<4K>


	mpr0: Sending reset from mprsas_send_abort for target ID 19
	mpr0: Unfreezing devq for target ID 19
	(da0:mpr0:0:19:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
	(da0:mpr0:0:19:0): CAM status: Command timeout
	(da0:mpr0:0:19:0): Retrying command
	(da0:mpr0:0:19:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
	(da0:mpr0:0:19:0): CAM status: SCSI Status Error
	(da0:mpr0:0:19:0): SCSI status: Check Condition
	(da0:mpr0:0:19:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
	(da0:mpr0:0:19:0): Retrying command (per sense data)
			(noperiph:mpr0:0:4294967295:0): SMID 2 Aborting command 0xfffffe00026066c0
	mpr0: Sending reset from mprsas_send_abort for target ID 20
	mpr0: Unfreezing devq for target ID 20
	(da1:mpr0:0:20:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
	(da1:mpr0:0:20:0): CAM status: Command timeout
	(da1:mpr0:0:20:0): Retrying command
	(da1:mpr0:0:20:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
	(da1:mpr0:0:20:0): CAM status: SCSI Status Error
	(da1:mpr0:0:20:0): SCSI status: Check Condition
	(da1:mpr0:0:20:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
	(da1:mpr0:0:20:0): Retrying command (per sense data)
			(noperiph:mpr0:0:4294967295:0): SMID 3 Aborting command 0xfffffe0002609750
	mpr0: Sending reset from mprsas_send_abort for target ID 21
	(da2:mpr0:0:21:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
	mpr0: (da2:mpr0:0:21:0): CAM status: Command timeout
	Unfreezing devq for target ID 21
	(da2:mpr0:0:21:0): Retrying command
	(da2:mpr0:0:21:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
	(da2:mpr0:0:21:0): CAM status: SCSI Status Error
	(da2:mpr0:0:21:0): SCSI status: Check Condition
	(da2:mpr0:0:21:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
	(da2:mpr0:0:21:0): Retrying command (per sense data)
			(noperiph:mpr0:0:4294967295:0): SMID 4 Aborting command 0xfffffe000260c7e0
	mpr0: Sending reset from mprsas_send_abort for target ID 22
	mpr0: Unfreezing devq for target ID 22
	(da3:mpr0:0:22:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
	(da3:mpr0:0:22:0): CAM status: Command timeout
	(da3:mpr0:0:22:0): Retrying command
	(da3:mpr0:0:22:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
	(da3:mpr0:0:22:0): CAM status: SCSI Status Error
	(da3:mpr0:0:22:0): SCSI status: Check Condition
	(da3:mpr0:0:22:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
	(da3:mpr0:0:22:0): Retrying command (per sense data)
			(noperiph:mpr0:0:4294967295:0): SMID 5 Aborting command 0xfffffe0002614f10
	mpr0: Sending reset from mprsas_send_abort for target ID 25
	mpr0: Unfreezing devq for target ID 25
	(da6:mpr0:0:25:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
	(da6:mpr0:0:25:0): CAM status: Command timeout
	(da6:mpr0:0:25:0): Retrying command
	(da6:mpr0:0:25:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
	(da6:mpr0:0:25:0): CAM status: SCSI Status Error
	(da6:mpr0:0:25:0): SCSI status: Check Condition
	(da6:mpr0:0:25:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
	(da6:mpr0:0:25:0): Retrying command (per sense data)
			(noperiph:mpr0:0:4294967295:0): SMID 6 Aborting command 0xfffffe0002617fa0
	mpr0: Sending reset from mprsas_send_abort for target ID 26
	mpr0: Unfreezing devq for target ID 26
	(da7:mpr0:0:26:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
	(da7:mpr0:0:26:0): CAM status: Command timeout
	(da7:mpr0:0:26:0): Retrying command
	(da7:mpr0:0:26:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
	(da7:mpr0:0:26:0): CAM status: SCSI Status Error
	(da7:mpr0:0:26:0): SCSI status: Check Condition
	(da7:mpr0:0:26:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
	(da7:mpr0:0:26:0): Retrying command (per sense data)


--
Mahlon E. Smith  
http://www.martini.nu/
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 819 bytes
Desc: not available
URL: <http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20170410/c651ce1b/attachment.sig>


More information about the freebsd-stable mailing list