[Fwd: siis change]

From: James R. Van Artsdalen <james-freebsd-current_at_jrv.org>
Date: Thu, 08 Oct 2009 22:23:15 -0500
mav committed a change to SIIS so I tried it but still get the device
hangs as before.  I should have sent that report here instead of to mav.

ch1 below connects to a port multiplier and ada3 is one of four disks
behind ch1.

Does disk ada3 ever get reset, or the link between the port multiplier
behind ch1 and ada3 ever get reinitialized?  I'm wondering if the port
multiplier is the key.  I don't see any code to reset ada3 or at least
stop/start its PHY link.

It takes about an hour for "zpool scrub" to hang.

-------- Original Message --------
Subject: 	siis change
Date: 	Thu, 08 Oct 2009 18:06:01 -0500
From: 	James R. Van Artsdalen
To: 	Alexander Motin



I see you dropped in a change to SIIS for timeout errors so I decided to
give it a try.  It still hangs for me.

FreeBSD pygmy.housenet.jrv 9.0-CURRENT FreeBSD 9.0-CURRENT #1 r197866:
Thu Oct  8 16:32:18 CDT 2009    
root_at_pygmy.housenet.jrv:/usr/obj/usr/src/sys/GENERIC  amd64

I did a "zpool scrub" which was generally running at about 100 MB/s
across six 2 TB disks in two port multiplier enclosures.

Here is that complete /var/log/messages.

Oct  8 17:47:54 pygmy kernel: siisch1: Timeout on slot 3
Oct  8 17:47:54 pygmy kernel: siisch1: siis_timeout is 00000000 ss
00028308 rs 00028308 es 00000000 sts 80032000 serr 00000000
Oct  8 17:47:54 pygmy kernel: siisch1: ready wait time=0ms
Oct  8 17:47:54 pygmy kernel: siisch1: ready wait time=1ms
Oct  8 17:47:54 pygmy kernel: (ada3:siisch1:0:2:0): Command timed out
Oct  8 17:47:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:47:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:47:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:47:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:47:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:47:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:47:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:47:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:47:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:48:24 pygmy kernel: siisch1: Timeout on slot 29
Oct  8 17:48:24 pygmy kernel: siisch1: siis_timeout is 00040000 ss
60000007 rs 60000007 es 00000000 sts 801d2000 serr 00000000
Oct  8 17:48:24 pygmy kernel: siisch1: ready wait time=1ms
Oct  8 17:48:24 pygmy kernel: siisch1: ready wait time=0ms
Oct  8 17:48:24 pygmy kernel: (ada3:siisch1:0:2:0): Command timed out
Oct  8 17:48:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:48:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:48:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:48:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:48:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:48:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:48:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:48:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:48:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:48:54 pygmy kernel: siisch1: Timeout on slot 3
Oct  8 17:48:54 pygmy kernel: siisch1: siis_timeout is 00040000 ss
000000f8 rs 000000f8 es 00000000 sts 80032000 serr 00000000
Oct  8 17:48:54 pygmy kernel: siisch1: ready wait time=1ms
Oct  8 17:48:54 pygmy kernel: siisch1: ready wait time=1ms
Oct  8 17:48:54 pygmy kernel: (ada3:siisch1:0:2:0): Command timed out
Oct  8 17:48:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:48:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:48:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:48:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:48:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:48:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:48:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:48:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:48:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:49:24 pygmy kernel: siisch1: Timeout on slot 8
Oct  8 17:49:24 pygmy kernel: siisch1: siis_timeout is 00040000 ss
00001f00 rs 00001f00 es 00000000 sts 80082000 serr 00000000
Oct  8 17:49:24 pygmy kernel: siisch1: ready wait time=0ms
Oct  8 17:49:24 pygmy kernel: siisch1: ready wait time=0ms
Oct  8 17:49:24 pygmy kernel: (ada3:siisch1:0:2:0): Command timed out
Oct  8 17:49:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:49:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:49:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:49:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:49:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:49:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:49:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:49:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:49:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:49:54 pygmy kernel: siisch1: Timeout on slot 13
Oct  8 17:49:54 pygmy kernel: siisch1: siis_timeout is 00040000 ss
0003e000 rs 0003e000 es 00000000 sts 800d2000 serr 00000000
Oct  8 17:49:54 pygmy kernel: siisch1: ready wait time=1ms
Oct  8 17:49:54 pygmy kernel: siisch1: ready wait time=1ms
Oct  8 17:49:54 pygmy kernel: (ada3:siisch1:0:2:0): Command timed out
Oct  8 17:49:54 pygmy kernel: (ada3:siisch1:0:2:0): error 5
Oct  8 17:49:54 pygmy kernel: (ada3:siisch1:0:2:0): Retries Exhausted
Oct  8 17:49:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:49:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:49:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:49:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:49:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:49:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:49:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:49:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:50:24 pygmy kernel: siisch1: Timeout on slot 18
Oct  8 17:50:24 pygmy kernel: siisch1: siis_timeout is 00040000 ss
00fc0000 rs 00fc0000 es 00000000 sts 80122000 serr 00000000
Oct  8 17:50:24 pygmy kernel: siisch1: ready wait time=1ms
Oct  8 17:50:24 pygmy kernel: siisch1: ready wait time=1ms
Oct  8 17:50:24 pygmy kernel: (ada3:siisch1:0:2:0): Command timed out
Oct  8 17:50:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:50:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:50:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:50:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:50:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:50:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:50:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:50:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:50:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:50:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:50:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:50:54 pygmy kernel: siisch1: Timeout on slot 24
Oct  8 17:50:54 pygmy kernel: siisch1: siis_timeout is 00040000 ss
3f000000 rs 3f000000 es 00000000 sts 80182000 serr 00000000
Oct  8 17:50:54 pygmy kernel: siisch1: ready wait time=0ms
Oct  8 17:50:54 pygmy kernel: siisch1: ready wait time=0ms
Oct  8 17:50:54 pygmy kernel: (ada3:siisch1:0:2:0): Command timed out
Oct  8 17:50:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:50:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:50:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:50:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:50:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:50:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:50:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:50:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:50:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:50:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:50:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:51:24 pygmy kernel: siisch1: Timeout on slot 30
Oct  8 17:51:24 pygmy kernel: siisch1: siis_timeout is 00040000 ss
4000001f rs 4000001f es 00000000 sts 801e2000 serr 00000000
Oct  8 17:51:24 pygmy kernel: siisch1: ready wait time=1ms
Oct  8 17:51:24 pygmy kernel: siisch1: ready wait time=0ms
Oct  8 17:51:24 pygmy kernel: (ada3:siisch1:0:2:0): Command timed out
Oct  8 17:51:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:51:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:51:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:51:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:51:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:51:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:51:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:51:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:51:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:51:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:51:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:51:54 pygmy kernel: siisch1: Timeout on slot 5
Oct  8 17:51:54 pygmy kernel: siisch1: siis_timeout is 00040000 ss
000007e0 rs 000007e0 es 00000000 sts 80052000 serr 00000000
Oct  8 17:51:54 pygmy kernel: siisch1: ready wait time=1ms
Oct  8 17:51:54 pygmy kernel: siisch1: ready wait time=1ms
Oct  8 17:51:54 pygmy kernel: (ada3:siisch1:0:2:0): Command timed out
Oct  8 17:51:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:51:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:51:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:51:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:51:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:51:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:51:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:51:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:51:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:51:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:51:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:52:24 pygmy kernel: siisch1: Timeout on slot 11
Oct  8 17:52:24 pygmy kernel: siisch1: siis_timeout is 00040000 ss
0001f800 rs 0001f800 es 00000000 sts 800b2000 serr 00000000
Oct  8 17:52:24 pygmy kernel: siisch1: ready wait time=1ms
Oct  8 17:52:24 pygmy kernel: siisch1: ready wait time=0ms
Oct  8 17:52:24 pygmy kernel: (ada3:siisch1:0:2:0): Command timed out
Oct  8 17:52:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:52:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:52:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:52:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:52:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:52:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:52:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:52:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:52:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:52:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:52:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:52:54 pygmy kernel: siisch1: Timeout on slot 17
Oct  8 17:52:54 pygmy kernel: siisch1: siis_timeout is 00040000 ss
007e0000 rs 007e0000 es 00000000 sts 80112000 serr 00000000
Oct  8 17:52:54 pygmy kernel: siisch1: ready wait time=1ms
Oct  8 17:52:54 pygmy kernel: siisch1: ready wait time=0ms
Oct  8 17:52:54 pygmy kernel: (ada3:siisch1:0:2:0): Command timed out
Oct  8 17:52:54 pygmy kernel: (ada3:siisch1:0:2:0): error 5
Oct  8 17:52:54 pygmy kernel: (ada3:siisch1:0:2:0): Retries Exhausted
Oct  8 17:52:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:52:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:52:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:52:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:52:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:52:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:52:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:52:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:52:54 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:52:54 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:53:24 pygmy kernel: siisch1: Timeout on slot 23
Oct  8 17:53:24 pygmy kernel: siisch1: siis_timeout is 00040000 ss
3f800000 rs 3f800000 es 00000000 sts 80172000 serr 00000000
Oct  8 17:53:24 pygmy kernel: siisch1: ready wait time=0ms
Oct  8 17:53:24 pygmy kernel: siisch1: ready wait time=1ms
Oct  8 17:53:24 pygmy kernel: (ada3:siisch1:0:2:0): Command timed out
Oct  8 17:53:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:53:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:53:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:53:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:53:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:53:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:53:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:53:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:53:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:53:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:53:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
Oct  8 17:53:24 pygmy kernel: (ada3:siisch1:0:2:0): Request Requeued
Oct  8 17:53:24 pygmy kernel: (ada3:siisch1:0:2:0): Retrying Command
[root_at_pygmy ~]#
Received on Fri Oct 09 2009 - 01:23:18 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:39:56 UTC