Re: RELENG_8 / mpt / zpool Errors

On 7 September 2011 13:54, Tim Gustafson <tjg_at_soe.ucsc.edu> wrote:

> > What are the drives exactly? You may have issues like TLER or
> > frequent head parking. Are these SATA, SCSI or SAS and are port
> > multipliers in use?
>
> root_at_bsd-03: dmesg | grep da6
> da6 at mpt0 bus 0 scbus1 target 1 lun 0
> da6: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device
> da6: 300.000MB/s transfers
> da6: Command Queueing enabled
> da6: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
>
> The drives are housed in two of the following enclosures:
>
> ses0 at mpt0 bus 0 scbus1 target 32 lun 0
> ses0: <PROMISE 3U-SAS-16-D BP 0107> Fixed Enclosure Services SCSI-5 device
> ses0: 300.000MB/s transfers
> ses0: Command Queueing enabled
> ses0: SCSI-3 SES Device
>
> Each enclosure is directly connected by a dedicated cable to the 2-port
> controller:
>
> mps0: <LSI SAS2008> port 0xfc00-0xfcff mem
> 0xef5f0000-0xef5fffff,0xef580000-0xef5bffff irq 44 at device 0.0 on pci1
> mps0: Firmware: 07.15.04.00
> mps0: IOCCapabilities:
> 185c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR>
> mps0: [ITHREAD]
>
>
> -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
> Tim Gustafson
> tjg_at_soe.ucsc.edu
> Baskin School of Engineering
> 831-459-5354
> UC Santa Cruz                                         Baskin Engineering
> 317B
>
> -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
>

You'll be interested in the thread "PCIe SATA HBA for ZFS on -STABLE" on the
FreeBSD-STABLE list between 31 May 2011 and 12 June 2011.

Jeremy Chadwick's post on the 1st of June is particularly enlightening.

Advice is:

Use -STABLE and not -RELEASE
Upgrade firmware
Avoid port multipliers

I'm having no troubles but with 8 identical SATA disks instead of SAS.

As I'm using cheap 4K green drives I had to use wdidle3.exe to fix the 8
second head parking and I also had to use gnop to force my ZFS pool to use
4K transfers.

mps0: <LSI SAS2008> port 0xee00-0xeeff mem
0xfbdfc000-0xfbdfffff,0xfbd80000-0xfbdbffff irq 16 at device 0.0 on pci1
mps0: Firmware: 07.00.00.00
da0 at mps0 bus 0 scbus0 target 0 lun 0
da0: <ATA WDC WD20EARS-00M AB51> Fixed Direct Access SCSI-5 device
da0: 300.000MB/s transfers
da0: Command Queueing enabled
da0: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)