Re: LSI supported mps(4) driver available

On 28 March 2012 03:51, Kenneth D. Merry <ken_at_freebsd.org> wrote:

> On Tue, Mar 27, 2012 at 23:50:31 +1030, Matt Thyer wrote:
> > On 26 March 2012 23:55, Gary Palmer <gpalmer_at_freebsd.org> wrote:
> >
> > > On Mon, Mar 26, 2012 at 08:05:59PM +1030, Matt Thyer wrote:
> > > > On Mar 26, 2012 3:43 AM, "Garrett Cooper" <yanegomi_at_gmail.com>
> wrote:
> > > > >
> > > > > On Sun, Mar 25, 2012 at 5:16 AM, Matt Thyer <matt.thyer_at_gmail.com>
> > > wrote:
> > > > > > Has this driver been MFC to 8-STABLE yet ?
> > > > > >
> > > > > > I'm asking because I updated my NAS on the 4th of March from
> 8-STABLE
> > > > > > r225723 to r232477 and am now seeing 157,000 interrupts per
> second on
> > > > irq
> > > > > > 16 where my SuperMicro AOC-USAS2-L8i resides (this card uses the
> LSI
> > > > > > SAS2008 chip).
> > >
> >
> > [snip]
> >
> >
> > > > After encountering this problem I updated my firmware from phase 7 to
> > > phase
> > > > 11 but this did not fix things.
> > > >
> > > > My question is: "Is the LSI driver even in 8-STABLE yet?".
> > > >
> > > > If not I'll upgrade to 9-STABLE to get the new driver.
> > > >
> > > > If it is, then I want to downgrade to just before it came in to see
> if
> > > this
> > > > high interrupt rate problem is fixed.
> > >
> > > I'm no export in svn, however:
> > >
> > > http://svnweb.freebsd.org/base?view=revision&amp;revision=230922
> > >
> > > would appear to suggest that the new driver is in 8-Stable
> > >
> > > Gary
> > >
> >
> > It's painful to take this system back to r230921 due to intolerance for
> > downtime from it's users so I'd like to investigate the cause of the
> > problem and try patches/sysctls/whatever first.
> >
> > The drives I'm using are 7 x WDC WD20EARS-00M (3 are AB50, 4 are AB51)
> and
> > 1 x WD20EARX-00P AB51.
> > The WD20EARX-00P AB51 is a SATA 3 (6 Gbps) drive but the others are all
> > SATA 2 (3 Gbps).
> >
> > I know the driver doesn't like mixed speeds in IR mode but I'm flashed
> with
> > IT firmware as ZFS is doing my RAID (raidz2).
> >
> > I was having problems with the WD20EARX-00P AB51 drive being faulted by
> ZFS
> > until I updated the firmware to 11 and now ZFS is happy (I've also done a
> > full extended drive SMART test and the drive is fine).
> >
> > So what do people suggest (before reversion to r230921) ?
>
> If you're going to prove that it's the new LSI driver, you will probably
> have to go back to the old driver.
>
> You don't have to back out your entire tree, you can just back out the
> driver itself if you have an SVN tree.  You can go into sys/dev/mps and do:
>
> svn update -r 230714
>
> And then edit sys/conf/files and comment out these three lines:
>
> dev/mps/mps_config.c            optional mps
> dev/mps/mps_mapping.c           optional mps
> dev/mps/mps_sas_lsi.c           optional mps
>
> Then you should be able to rebuild your kernel with the old driver and see
> if the problem occurs again.
>
> Ken
> --
> Kenneth Merry
> ken_at_FreeBSD.ORG
>

This didn't work for me so I removed my /usr/src and checked out 8-STABLE
at revision 230921 (svn checkout -r 230921
http://svn.freebsd.org/base/stable/8 /usr/src).

I've built world, kernel etc and installed it using GENERIC kernel done my
mergemaster, delete old, delete old-libs and I still have the problem.

I'm wondering if it's due to the single 6 Gb drive in my raidz2 (the other
7 are 3 Gb).
I've heard that the new driver doesn't like mixed speeds in a raid set when
using -IR firmware but I wouldn't expect an issue with ZFS with -IT
firmware.

It seems that there may be a general incompatibility with both the old and
new drivers and the Western Digital WD20EARX-00P 6 Gbps drive.

Unfortunately I cannot get the old 3 Gb drive anymore.

I'll try moving the WD20EARX-00P drive to the on board SATA ports next.