Re: Data corruption with checksum offloading enabled

From: Dmitry Marakasov <amdmi3_at_amdmi3.ru>
Date: Wed, 28 Jan 2009 04:21:48 +0000
* Arno J. Klaassen (arno_at_heho.snv.jussieu.fr) wrote:

> >>  [ .. ]
> >>   07aa45c8 29 20
> >> 
> >> Does your corruption fulfill these characterisations as well?
> >
> > Nope, as I've written before, it's corruption of single 128 byte
> > block.
> 
> ok; I didn't quite understand that; so to be clear, 128 contitguous
> bytes are corrupt ?

Correct.

> > I've deleted samples during the upgrade process, but I think I'll turn
> > *xcsum back on and do some more tests with NFS, and netcat transfers.
> 
> Thanx; for me it took often hours to provoke the error
> 
> I'lll test later with -current again after having set up a newe
> server

Results. Each test was ran in a clean system just after reboot (via
rc.local). I used 512MB chunks, but I guess that was not enough, as
corruption didn't show itself in all the tests. Also there seem to be
some problems with NFS on current witch need specific attention - that's
why I lost one sample due to NFS lockup and reboot, and that's why I've
used 512MB data pieces.

1. 512MB zeroes with netcat: 5/5 correct
2. 512MB zeroes with NFS: 4/4 correct (there seem to also be some NFS
   lockups on -current, so I lost one sample; it's also the reason I ve
3. 512MB random bytes with NFS: 2/5 correct

also tried 512MB random bytes after 10MB via netcat and same 512MB after
that (to check for possible shifts). No corruptions here, though.

So I only have 3 corruptions. Will do more tests when I have some time.
Those reboots take quite a lot of time and need attention due to
possible NFS lockups...

For now guess is that corruption may be data from the other place
of the stream. So stream of zeroes is not affected (or is affected
with much lower possibility).

Diffs:

--- _r.0.h	2009-01-28 04:16:47.000000000 +0000
+++ _r.2.h	2009-01-28 04:16:57.000000000 +0000
_at__at_ -72519,15 +72519,15 _at__at_
 0011b460  6f 3e 2b a2 b9 d4 5f c6  69 df 4e 38 bc 96 7f ef  |o>+..._.i.N8....|
 0011b470  56 55 5e 65 e3 ab 1e 4b  7c d6 1d 8a a4 51 4e d2  |VU^e...K|....QN.|
 0011b480  9a 11 64 ec 39 be 86 2c  07 06 00 79 80 90 8b 70  |..d.9..,...y...p|
-0011b490  70 60 b4 97 4d 52 58 a8  e4 30 27 ce 87 90 a4 5e  |p`..MRX..0'....^|
-0011b4a0  db 4a 0e 03 3a 45 84 97  60 a4 80 3f 92 36 d1 5f  |.J..:E..`..?.6._|
-0011b4b0  86 90 0a c0 a7 ca 86 73  21 13 6c da 4f 8f 15 fc  |.......s!.l.O...|
-0011b4c0  c7 d9 61 b5 9e ac 39 79  c5 b3 99 df 9e aa a5 84  |..a...9y........|
-0011b4d0  5d 41 6d c2 05 9d 33 7d  71 78 7e 24 2c 83 98 55  |]Am...3}qx~$,..U|
-0011b4e0  3e 86 5d 13 8c 41 36 88  93 c8 d6 8f 38 f9 fe 42  |>.]..A6.....8..B|
-0011b4f0  21 e3 ef c2 71 8d d8 87  f3 b6 9c 21 08 fe 99 8c  |!...q......!....|
-0011b500  d4 84 c9 2f 68 ad a0 75  63 e9 16 7e e5 0a f0 d3  |.../h..uc..~....|
-0011b510  85 fa 39 e7 2b 3a 8a 93  58 08 29 b2 a0 0b af fc  |..9.+:..X.).....|
+0011b490  70 60 af 2e 74 ba 2f 2d  46 af 18 b3 c4 93 8b b2  |p`..t./-F.......|
+0011b4a0  47 24 9f 09 4d 5b 7b dc  b0 96 76 b0 b2 07 55 56  |G$..M[{...v...UV|
+0011b4b0  09 dd ad ac 8c be 92 87  83 92 02 ba b3 42 81 15  |.............B..|
+0011b4c0  49 5a 6e c5 4a b0 8a e5  c8 c2 bb e0 d8 ba f4 dc  |IZn.J...........|
+0011b4d0  6d 81 19 52 87 64 6e b0  6f c7 71 0c bc 75 4b e6  |m..R.dn.o.q..uK.|
+0011b4e0  02 1f 2e 3b 18 1b e8 d2  47 bb 01 e4 ed ad ac f5  |...;....G.......|
+0011b4f0  8f 13 4c bc 8a be 5a 2e  ee bd 2c 1f 1f 02 cd eb  |..L...Z...,.....|
+0011b500  bd 00 8f 1b 9e fa 7f 69  4a e9 16 a1 34 2d 73 7d  |.......iJ...4-s}|
+0011b510  e7 c0 39 e7 2b 3a 8a 93  58 08 29 b2 a0 0b af fc  |..9.+:..X.).....|
 0011b520  47 de 34 b7 99 31 80 58  52 d5 fa d0 b0 4e db 96  |G.4..1.XR....N..|
 0011b530  61 49 93 a6 03 a3 06 ca  28 da 29 f3 f1 16 ac 13  |aI......(.).....|
 0011b540  c3 53 6f 83 ce 15 8e 0c  e3 00 09 4d ae 59 4f 67  |.So........M.YOg|
--- _r.0.h	2009-01-28 04:16:47.000000000 +0000
+++ _r.3.h	2009-01-28 04:17:06.000000000 +0000
_at__at_ -27534,15 +27534,15 _at__at_
 0006b8d0  43 10 91 3b c6 90 77 31  55 23 f8 1a d1 aa 41 30  |C..;..w1U#....A0|
 0006b8e0  0c cd cc b8 6f 4a 0c 83  16 f8 e7 dc 47 cb a1 65  |....oJ......G..e|
 0006b8f0  5c f8 e5 f3 f2 b7 05 e4  cb ab a0 49 ea e3 f0 30  |\..........I...0|
-0006b900  21 ca d7 a9 10 06 57 f8  44 8b 82 36 b5 0f 03 33  |!.....W.D..6...3|
-0006b910  ba c0 ba bd a2 b1 e0 d1  a7 c5 a7 c4 d7 53 bc 80  |.............S..|
-0006b920  ea 1f 0e eb f2 aa fc 37  0e e8 67 35 65 78 65 ae  |.......7..g5exe.|
-0006b930  d6 41 a2 ed dd b6 58 46  26 17 a1 aa ab b5 13 67  |.A....XF&......g|
-0006b940  de bd 6f 97 69 f1 31 10  97 25 9d fc 0b e5 34 44  |..o.i.1..%....4D|
-0006b950  83 93 87 c5 34 6b 5b ab  1f 50 49 8c fe dc 87 77  |....4k[..PI....w|
-0006b960  9d e5 b6 4d 56 11 e3 e3  55 67 6f 9d fc fe b1 9a  |...MV...Ugo.....|
-0006b970  92 19 45 ba f8 4e 50 a0  ce bc a8 92 85 fe b8 c4  |..E..NP.........|
-0006b980  b1 c4 ef 2f c2 55 46 15  1e 01 f0 ff 66 22 e8 3e  |.../.UF.....f".>|
+0006b900  21 ca d7 a9 10 06 57 f8  44 8b 82 36 b5 0f 03 b1  |!.....W.D..6....|
+0006b910  0d 6b c7 31 21 8a 32 41  b2 40 06 c8 8a df 4b 44  |.k.1!.2A._at_....KD|
+0006b920  a1 3a 65 29 e9 60 07 63  83 03 f8 9f cd 68 e6 5c  |.:e).`.c.....h.\|
+0006b930  b3 4d ab f5 d6 71 07 60  b6 d0 e6 49 9e 12 61 25  |.M...q.`...I..a%|
+0006b940  d9 07 ac e5 2b 13 e2 56  33 5c 5a f3 3a 86 d3 16  |....+..V3\Z.:...|
+0006b950  a8 47 cb 91 f6 a2 45 eb  db 65 15 93 8a 44 2d 9f  |.G....E..e...D-.|
+0006b960  c5 22 d4 77 30 c8 e8 b2  dd 3a 7a 06 de 98 d7 66  |.".w0....:z....f|
+0006b970  c4 50 f4 96 32 f5 96 e4  e2 b5 1a 28 62 40 c3 4a  |.P..2......(b_at_.J|
+0006b980  d0 2e 75 4e f2 bb 7d b1  cb f9 7d 94 e0 dc da 3e  |..uN..}...}....>|
 0006b990  d9 f2 78 2b f4 5e 10 84  ff 0f 14 92 c4 96 03 66  |..x+.^.........f|
 0006b9a0  15 ed 21 38 46 b4 06 f8  c1 e3 90 b4 47 3c 7c ff  |..!8F.......G<|.|
 0006b9b0  61 e5 04 20 72 1a e2 1e  c7 4e 01 d2 d1 14 35 63  |a.. r....N....5c|
--- _r.0.h	2009-01-28 04:16:47.000000000 +0000
+++ _r.4.h	2009-01-28 04:17:10.000000000 +0000
_at__at_ -220065,15 +220065,15 _at__at_
 0035ba00  37 a2 34 91 86 cf d5 ba  f3 c0 69 18 17 51 c2 99  |7.4.......i..Q..|
 0035ba10  64 8c e6 e1 70 eb a5 bd  19 13 26 6e 12 d8 bf b2  |d...p.....&n....|
 0035ba20  1d f3 51 12 af ad 01 0b  d1 3e 32 4f d0 f7 41 59  |..Q......>2O..AY|
-0035ba30  ee 60 4a 2f 81 b9 ee ff  81 1a ef 0b a5 66 6a 6a  |.`J/.........fjj|
-0035ba40  58 a3 2b b2 a2 75 38 ad  92 c7 1b ec f5 51 14 79  |X.+..u8......Q.y|
-0035ba50  14 5e b9 12 c2 b6 0f ff  20 47 ed 2e bb 56 2b f7  |.^...... G...V+.|
-0035ba60  ce 10 fa 79 46 88 ed f5  88 a8 9d 1b 1f ba 3c ff  |...yF.........<.|
-0035ba70  5e 59 01 3e c7 69 0d ec  e9 58 49 b7 df 12 4f 59  |^Y.>.i...XI...OY|
-0035ba80  f4 12 df 36 d3 fa 99 e9  3c 96 68 81 6e 31 64 60  |...6....<.h.n1d`|
-0035ba90  07 b3 21 c7 da d8 b3 1c  7c ca 12 e9 57 ed b4 f6  |..!.....|...W...|
-0035baa0  1f e5 5c 96 ae cf 48 37  97 5b c7 9a f1 93 0f b0  |..\...H7.[......|
-0035bab0  10 d6 eb 89 33 56 75 6d  17 fc b3 a1 79 62 4c bc  |....3Vum....ybL.|
+0035ba30  ee 60 4a 2f 81 b9 ee ff  81 1a d1 88 fd 5f 7f 08  |.`J/........._..|
+0035ba40  c5 8e eb 07 00 b6 d4 de  92 e2 40 ab 9d 14 eb 84  |.........._at_.....|
+0035ba50  4f 46 e8 12 32 39 1a 85  8c bd 01 ac 49 c9 65 6b  |OF..29......I.ek|
+0035ba60  7a 3e c0 1e ca 2d e8 82  7b cf 36 69 41 df f7 ed  |z>...-..{.6iA...|
+0035ba70  c2 fe e1 43 09 01 c0 07  b8 13 01 65 57 bc eb c4  |...C.......eW...|
+0035ba80  af 40 dd bb 4e b4 ef 79  d5 fa e6 18 25 5a 9a 55  |._at_..N..y....%Z.U|
+0035ba90  33 89 62 d2 88 43 5f c5  b1 e1 8a 6d da 8b 5f b8  |3.b..C_....m.._.|
+0035baa0  41 bf c0 f2 42 3f 0d b8  61 b6 16 6e e9 1b 6d eb  |A...B?..a..n..m.|
+0035bab0  34 8f 31 d1 8b 35 52 91  9b 56 b3 a1 79 62 4c bc  |4.1..5R..V..ybL.|
 0035bac0  6d a0 49 d2 f9 dd f6 53  a1 6f 35 21 ee e8 03 88  |m.I....S.o5!....|
 0035bad0  cf 88 71 79 7c 23 20 a9  a2 31 a0 77 44 f3 63 95  |..qy|# ..1.wD.c.|
 0035bae0  da 3e b2 c0 7c c8 59 ed  bb 05 2a 12 a1 a8 4b c0  |.>..|.Y...*...K.|

-- 
Dmitry Marakasov   .   55B5 0596 FF1E 8D84 5F56  9510 D35A 80DD F9D2 F77D
amdmi3_at_amdmi3.ru  ..:  jabber: amdmi3_at_jabber.ru    http://www.amdmi3.ru
Received on Wed Jan 28 2009 - 00:20:52 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:39:41 UTC