RELENG_8 / mpt / zpool Errors

[Matt Thyer]

On 7 September 2011 19:07, Matt Thyer <matt.thyer at gmail.com> wrote:

> On 7 September 2011 13:54, Tim Gustafson <tjg at soe.ucsc.edu> wrote:
>
>> > What are the drives exactly? You may have issues like TLER or
>> > frequent head parking. Are these SATA, SCSI or SAS and are port
>> > multipliers in use?
>>
>> root at bsd-03: dmesg | grep da6
>> da6 at mpt0 bus 0 scbus1 target 1 lun 0
>> da6: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device
>> da6: 300.000MB/s transfers
>> da6: Command Queueing enabled
>> da6: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
>>
>> The drives are housed in two of the following enclosures:
>>
>> ses0 at mpt0 bus 0 scbus1 target 32 lun 0
>> ses0: <PROMISE 3U-SAS-16-D BP 0107> Fixed Enclosure Services SCSI-5 device
>> ses0: 300.000MB/s transfers
>> ses0: Command Queueing enabled
>> ses0: SCSI-3 SES Device
>>
>> Each enclosure is directly connected by a dedicated cable to the 2-port
>> controller:
>>
>> mps0: <LSI SAS2008> port 0xfc00-0xfcff mem
>> 0xef5f0000-0xef5fffff,0xef580000-0xef5bffff irq 44 at device 0.0 on pci1
>> mps0: Firmware: 07.15.04.00
>> mps0: IOCCapabilities:
>> 185c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR>
>> mps0: [ITHREAD]
>>
>>
>> -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
>> Tim Gustafson
>> tjg at soe.ucsc.edu
>> Baskin School of Engineering
>> 831-459-5354
>> UC Santa Cruz                                         Baskin Engineering
>> 317B
>>
>> -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
>>
>
> You'll be interested in the thread "PCIe SATA HBA for ZFS on -STABLE" on
> the FreeBSD-STABLE list between 31 May 2011 and 12 June 2011.
>
> Jeremy Chadwick's post on the 1st of June is particularly enlightening.
>
> Advice is:
>
> Use -STABLE and not -RELEASE
> Upgrade firmware
> Avoid port multipliers
>
> I'm having no troubles but with 8 identical SATA disks instead of SAS.
>
> As I'm using cheap 4K green drives I had to use wdidle3.exe to fix the 8
> second head parking and I also had to use gnop to force my ZFS pool to use
> 4K transfers.
>
> mps0: <LSI SAS2008> port 0xee00-0xeeff mem
> 0xfbdfc000-0xfbdfffff,0xfbd80000-0xfbdbffff irq 16 at device 0.0 on pci1
> mps0: Firmware: 07.00.00.00
> da0 at mps0 bus 0 scbus0 target 0 lun 0
> da0: <ATA WDC WD20EARS-00M AB51> Fixed Direct Access SCSI-5 device
> da0: 300.000MB/s transfers
> da0: Command Queueing enabled
> da0: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
>
>
A bit more info...

The mps driver has problems with the LSI SAS2008 when using port multipliers
(which are in the enclosures).
If you go to the previous SAS 3G version of that chip I think you'll be OK.
Either that or run Solaris Express or fix the driver.