Re: zpool scrub errors on 3ware 9550SXU

From: Ian J Hart <ianjhart_at_ntlworld.com>
Date: Sun, 19 Jul 2009 20:03:27 +0100
Quoting Kip Macy <kmacy_at_freebsd.org>:

> The reason why the results on 7-STABLE are so important is that it is
> now running the exact same version of ZFS as HEAD. So if you aren't
> seeing checksum errors on 7-STABLE then the problem lies elsewhere in
> the storage stack. There are so many things that could cause this that
> I won't even speculate.
>
> Thanks for the information. I'll try to figure out how to narrow it down.
>
> -Kip
> _______________________________________________
> freebsd-current_at_freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-current
> To unsubscribe, send any mail to "freebsd-current-unsubscribe_at_freebsd.org"
>

I realise this is not going anywhere unless someone else gets the same  
error (preferably on different hardware) but FWIW I still get the same  
error on 8.0-BETA2.

I only did one run so far but it took 3 hours rather than 40 minutes.  
Offset is roughly twice the typical value, although again, this may  
not be significant. Any commits in the storage stack?

I have a new mobo/cpu/ram/raid card on order which I'll be able to  
test the week after next. The old board etc will go into a system with  
a set of 500GB disks, so I'll get two sets of tests for the price of  
one.

Very soon after that I have to put both boxes into production.

Jul 19 19:12:54 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da14 offset=624129919488 size=22016
Jul 19 19:12:54 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da11 offset=624129591808 size=21504
Jul 19 19:12:54 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da9 offset=624130029568 size=22016
Jul 19 19:13:06 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da4 offset=624318266368 size=21504
Jul 19 19:13:06 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da15 offset=624317789696 size=22016
Jul 19 19:13:08 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da14 offset=624339560448 size=22016
Jul 19 19:13:10 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da10 offset=624369130496 size=22016
Jul 19 19:13:10 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da11 offset=624369171456 size=22016
Jul 19 19:13:14 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da0 offset=624426701824 size=22016
Jul 19 19:13:14 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da1 offset=624426701824 size=22016
Jul 19 19:13:14 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da2 offset=624426701824 size=22016
Jul 19 19:13:14 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da3 offset=624426701824 size=22016
Jul 19 19:13:14 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da4 offset=624426701824 size=22016
Jul 19 19:13:14 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da5 offset=624426701824 size=22016
Jul 19 19:13:14 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da6 offset=624426701824 size=21504
Jul 19 19:13:14 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da7 offset=624426701824 size=21504
Jul 19 19:13:16 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da10 offset=624469054464 size=21504
Jul 19 19:13:16 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da2 offset=624469552640 size=21504
Jul 19 19:13:16 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da3 offset=624469552640 size=21504
Jul 19 19:13:37 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da5 offset=626105954816 size=22016
Jul 19 19:13:53 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da2 offset=626296076800 size=22016
Jul 19 19:13:55 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da3 offset=626306811904 size=22016
Jul 19 19:13:55 data kernel: twa0: ERROR: (0x16: 0x1302): Unexpected  
status bit(s): status reg = 0xd00000 Unexpected bits:  
[PCI_ABRT,Q_ERR,PCI_PERR]
Jul 19 19:13:55 data kernel: twa0:  parity error: clearing...  
Re-seat/move/replace card: (0x49435000: 0x1303): PCI parity error:  
clearing... Re-seat/move/replace card: status reg = 0x30db64a7  
[MC_RDY,RESP_Q_EMPTY,RESP_INTR,CMD_INTR,HOS
T_INTR,PCI_ABRT,Q_ERR,PCI_PERR]
Jul 19 19:13:55 data kernel: twa0:  abort: clearing... : (0x49435000:  
0x1304): PCI abort: clearing... : status reg = 0x30db64a7  
[MC_RDY,RESP_Q_EMPTY,RESP_INTR,CMD_INTR,HOST_INTR,PCI_ABRT,Q_ERR,PCI_PERR]
Jul 19 19:13:55 data kernel: twa0: troller queue error: clearing... :  
(0x6E6F4300: 0x1305): Controller queue error: clearing... : status reg  
= 0x30db64a7  
[MC_RDY,RESP_Q_EMPTY,RESP_INTR,CMD_INTR,HOST_INTR,PCI_ABRT,Q_ERR,PCI_PERR]
Jul 19 19:13:55 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da6 offset=626306920960 size=22016
Jul 19 19:13:55 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da7 offset=626306920960 size=22016
Jul 19 19:13:56 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da7 offset=626316084224 size=16384
Jul 19 19:13:56 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da6 offset=626317622784 size=22016
Jul 19 19:13:56 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da13 offset=626316797440 size=22016
Jul 19 19:14:12 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da15 offset=626486498304 size=21504
Jul 19 19:14:12 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da2 offset=626486997504 size=21504
Jul 19 19:14:12 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da3 offset=626486756352 size=22016
Jul 19 19:14:43 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da2 offset=626830958592 size=21504
Jul 19 19:14:43 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da3 offset=626830980096 size=17920
Jul 19 19:14:43 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da12 offset=626830480384 size=22016
Jul 19 19:14:43 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da13 offset=626830480384 size=22016
Jul 19 19:14:43 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da14 offset=626830480384 size=22016
Jul 19 19:14:43 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da15 offset=626830480384 size=22016
Jul 19 19:14:43 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da8 offset=626830480896 size=22016
Jul 19 19:14:43 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da9 offset=626830480896 size=22016
Jul 19 19:14:43 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da10 offset=626830480896 size=21504
Jul 19 19:14:43 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da11 offset=626830480896 size=21504
Jul 19 19:14:44 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da7 offset=626839974400 size=17920
Jul 19 19:14:44 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da9 offset=626839497216 size=17920
Jul 19 19:14:44 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da8 offset=626839429120 size=18944
Jul 19 19:14:47 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da12 offset=626870235648 size=21504
Jul 19 19:14:47 data kernel: twa0: ERROR: (0x16: 0x1302): Unexpected  
status bit(s): status reg = 0x200000 Unexpected bits: [MC_ERR,]
Jul 19 19:14:47 data kernel: twa0: or! : (0x72726520: 0x1307):  
Micro-controller error! : status reg = 0x97273372  
[CMD_Q_EMPTY,MC_RDY,RESP_INTR,CMD_INTR,ATTN_INTR,MC_ERR,]
Jul 19 19:14:56 data root: ZFS: checksum mismatch, zpool=tank  
path=/dev/da4 offset=626964436992 size=21504

Cheers

-- 
ian j hart

----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.
Received on Sun Jul 19 2009 - 17:04:07 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:39:52 UTC