[Bug 286869] ctld randomly corrupted data
- In reply to: bugzilla-noreply_a_freebsd.org: "[Bug 286869] ctld randomly corrupted data"
- Go to: [ bottom of page ] [ top of archives ] [ this month ]
Date: Thu, 29 May 2025 17:19:56 UTC
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=286869
--- Comment #2 from Martin Birgmeier <d8zNeCFG@aon.at> ---
I just tried running Windows 10 under VirtualBox again, with the iSCSI server
booted under FreeBSD. It failed immediately with a blue screen.
Then I attached the same iSCSI-exported disk directly on the iSCSI client where
it appears as da0. On the iSCSI server the ctld backing device is
/dev/zvol/orion.12/50/vdisks/914. With this, I ran the following command on the
iSCSI client (this is using the zsh):
cmp -x <(dd if=/dev/da0 bs=1m count=1024) <(ssh -n orion "dd
if=/dev/zvol/orion.12/50/vdisks/914 bs=1m count=1024") | less
This resulted in very many differences. Mostly, on the client the data has been
replaced with zeros, but sometimes there is other stuff in it.
Then I tried running this command:
diff =(dd if=/dev/da0 bs=1m count=64 | hd) =(ssh -n orion "dd
if=/dev/zvol/orion.12/50/vdisks/914 bs=1m count=64 | hd") | less
No differences anymore, although there certainly were differences in this
initial 64m part before!
Then running the exact "cmp -x ..." command shown above more times, and the
first difference would initially start at ever higher addresses, but then again
at lower ones.
Doing the exact same diff =(...) =(...) command as above again yields (only the
first few lines are shown):
145,156d144
< 00226000 00 00 20 00 00 00 00 00 00 00 00 00 00 00 00 00 |..
.............|
< 00226010 ff ef a0 03 00 00 00 00 80 a8 b0 b6 ca 2f 00 00
|............./..|
< 00226020 80 57 0f 00 00 00 00 00 00 00 00 00 00 00 00 00
|.W..............|
< 00226030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
|................|
< *
< 002260c0 00 00 00 00 00 00 00 00 f8 3e 19 29 0d 20 00 00 |.........>.).
..|
< 002260d0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
|................|
< *
< 00226120 00 00 00 00 00 00 00 00 00 00 00 00 25 00 00 00
|............%...|
< 00226130 02 00 00 00 00 00 00 00 00 00 e0 b6 ca 2f 00 00
|............./..|
< 00226140 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
|................|
< *
141938,141949c141926,141968
< 00726000 00 00 20 00 00 00 00 00 00 00 00 00 00 00 00 00 |..
.............|
< 00726010 ff ef a0 03 00 00 00 00 80 a8 b0 b6 ca 2f 00 00
|............./..|
< 00726020 80 57 0f 00 00 00 00 00 00 00 00 00 00 00 00 00
|.W..............|
< 00726030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
|................|
< *
< 007260c0 00 00 00 00 00 00 00 00 f8 3e 19 29 0d 20 00 00 |.........>.).
..|
< 007260d0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
|................|
< *
< 00726120 00 00 00 00 00 00 00 00 00 00 00 00 25 00 00 00
|............%...|
< 00726130 02 00 00 00 00 00 00 00 00 00 e0 b6 ca 2f 00 00
|............./..|
< 00726140 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
|................|
< *
---
> 00726000 30 48 8b 74 24 38 48 8b 7c 24 40 48 83 c4 20 41 |0H.t$8H.|$@H.. A|
> 00726010 5e c3 cc cc 48 89 5c 24 08 48 89 6c 24 10 48 89 |^...H.\$.H.l$.H.|
> 00726020 74 24 18 57 41 56 41 57 48 83 ec 20 33 db 49 8b |t$.WAVAWH.. 3.I.|
> 00726030 e9 38 1d 25 94 10 00 4d 8b f0 48 8b f2 8b f9 75 |.8.%...M..H....u|
> 00726040 0a bb 01 00 00 c0 e9 b4 00 00 00 85 ff 0f 84 a7 |................|
> 00726050 00 00 00 8b c7 c1 e8 1c ff c8 83 f8 01 0f 87 97 |................|
> 00726060 00 00 00 48 85 f6 0f 84 8e 00 00 00 48 8b 05 bd |...H........H...|
> 00726070 d4 11 00 4c 8d 3d b6 d4 11 00 48 8b cb 49 3b c7 |...L.=....H..I;.|
> 00726080 74 13 39 78 10 75 06 48 39 70 18 74 05 48 8b 00 |t.9x.u.H9p.t.H..|
> 00726090 eb eb 48 8b c8 48 85 c9 74 07 bb 18 07 00 c0 eb |..H..H..t.......|
> 007260a0 5e b9 30 00 00 00 e8 89 5e 01 00 48 85 c0 75 07 |^.0.....^..H..u.|
> 007260b0 bb 9a 00 00 c0 eb 48 0f 57 c0 0f 11 00 0f 11 40 |......H.W......@|
> 007260c0 10 0f 11 40 20 48 8b 0d 6c d4 11 00 4c 39 39 74 |...@ H..l...L99t|
> 007260d0 07 b9 03 00 00 00 cd 29 4c 89 38 48 89 48 08 48 |.......)L.8H.H.H|
> 007260e0 89 01 48 89 05 4f d4 11 00 89 78 10 48 89 70 18 |..H..O....x.H.p.|
> 007260f0 4c 89 70 20 48 89 68 28 eb 05 bb 0d 00 00 c0 48 |L.p H.h(.......H|
> 00726100 8b 6c 24 48 8b c3 48 8b 5c 24 40 48 8b 74 24 50 |.l$H..H.\$@H.t$P|
> 00726110 48 83 c4 20 41 5f 41 5e 5f c3 cc cc 48 83 ec 28 |H.. A_A^_...H..(|
> 00726120 80 3d 35 93 10 00 00 44 8b c1 75 0a b9 01 00 00 |.=5....D..u.....|
> 00726130 c0 e9 85 00 00 00 b9 0d 00 00 c0 45 85 c0 74 7b |...........E..t{|
> 00726140 41 8b c0 c1 e8 1c ff c8 83 f8 01 77 6e 48 85 d2 |A..........wnH..|
> 00726150 74 69 48 8b 05 d7 d3 11 00 4c 8d 0d d0 d3 11 00 |tiH......L......|
> 00726160 49 3b c1 74 56 44 39 40 10 75 06 48 39 50 18 74 |I;.tVD9@.u.H9P.t|
> 00726170 05 48 8b 00 eb ea 48 85 c0 74 40 83 3d d6 92 10 |.H....H..t@.=...|
> 00726180 00 00 77 2a 48 8b 08 48 39 41 08 75 1a 48 8b 50 |..w*H..H9A.u.H.P|
> 00726190 08 48 39 02 75 11 48 89 0a 48 89 51 08 48 8b c8 |.H9.u.H..H.Q.H..|
> 007261a0 e8 3b 5f 01 00 eb 12 b9 03 00 00 00 cd 29 83 60 |.;_..........).`|
> 007261b0 10 00 c6 05 a4 92 10 00 01 33 c9 8b c1 48 83 c4 |.........3...H..|
> 007261c0 28 c3 cc cc 40 53 48 83 ec 20 48 8d 1d 5f d3 11 |(...@SH.. H.._..|
> 007261d0 00 eb 21 48 8b 10 48 39 42 08 75 42 48 8b 48 08 |..!H..H9B.uBH.H.|
> 007261e0 48 39 01 75 39 48 89 11 48 89 4a 08 48 8b c8 e8 |H9.u9H..H.J.H...|
> 007261f0 ec 5e 01 00 48 8b 05 35 d3 11 00 48 3b c3 75 d3 |.^..H..5...H;.u.|
> 00726200 48 89 1d 31 d3 11 00 33 c0 48 89 1d 20 d3 11 00 |H..1...3.H.. ...|
> 00726210 c6 05 45 92 10 00 00 48 83 c4 20 5b c3 cc b9 03 |..E....H.. [....|
> 00726220 00 00 00 cd 29 cc cc cc 48 89 5c 24 18 48 89 74 |....)...H.\$.H.t|
> 00726230 24 20 57 48 83 ec 20 48 8b 0d 6a 42 0e 00 33 db |$ WH.. H..jB..3.|
> 00726240 48 89 1d 59 42 0e 00 89 1d 63 42 0e 00 48 89 1d |H..YB....cB..H..|
> 00726250 44 42 0e 00 89 1d 32 42 0e 00 48 89 1d 2f 42 0e |DB....2B..H../B.|
> 00726260 00 48 89 1d 50 42 0e 00 48 89 1d 41 d2 11 00 89 |.H..PB..H..A....|
> 00726270 1d 4b d2 11 00 48 89 1d 24 d2 11 00 48 89 1d 35 |.K...H..$...H..5|
> 00726280 d2 11 00 48 89 1d 46 d2 11 00 89 1d 18 d2 11 00 |...H..F.........|
> 00726290 48 89 1d 31 d2 11 00 48 89 1d fa d1 11 00 88 1d |H..1...H........|
> 007262a0 e5 41 0e 00 48 85 c9 74 0c e8 32 5e 01 00 48 89 |.A..H..t..2^..H.|
589712,589723c589731,589773
< 00e26000 00 00 20 00 00 00 00 00 00 00 00 00 00 00 00 00 |..
.............|
Running the exact same command again immediately yields:
145,156d144
< 00326000 00 00 20 00 00 00 00 00 00 00 00 00 00 00 00 00 |..
.............|
< 00326010 ff ef a0 03 00 00 00 00 80 a8 b0 b6 ca 2f 00 00
|............./..|
< 00326020 80 57 0f 00 00 00 00 00 00 00 00 00 00 00 00 00
|.W..............|
< 00326030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
|................|
< *
< 003260c0 00 00 00 00 00 00 00 00 f8 3e 19 29 0d 20 00 00 |.........>.).
..|
< 003260d0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
|................|
< *
< 00326120 00 00 00 00 00 00 00 00 00 00 00 00 25 00 00 00
|............%...|
< 00326130 02 00 00 00 00 00 00 00 00 00 e0 b6 ca 2f 00 00
|............./..|
< 00326140 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
|................|
< *
335498,335509c335486,335528
< 00a26000 00 00 20 00 00 00 00 00 00 00 00 00 00 00 00 00 |..
.............|
< 00a26010 ff ef a0 03 00 00 00 00 80 a8 b0 b6 ca 2f 00 00
|............./..|
< 00a26020 80 57 0f 00 00 00 00 00 00 00 00 00 00 00 00 00
|.W..............|
< 00a26030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
|................|
< *
< 00a260c0 00 00 00 00 00 00 00 00 f8 3e 19 29 0d 20 00 00 |.........>.).
..|
< 00a260d0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
|................|
< *
< 00a26120 00 00 00 00 00 00 00 00 00 00 00 00 25 00 00 00
|............%...|
< 00a26130 02 00 00 00 00 00 00 00 00 00 e0 b6 ca 2f 00 00
|............./..|
< 00a26140 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
|................|
< *
---
> 00a26000 0d 00 0a 00 0d 00 0a 00 3c 00 78 00 73 00 6c 00 |........<.x.s.l.|
> 00a26010 3a 00 74 00 65 00 6d 00 70 00 6c 00 61 00 74 00 |:.t.e.m.p.l.a.t.|
> 00a26020 65 00 20 00 6d 00 61 00 74 00 63 00 68 00 3d 00 |e. .m.a.t.c.h.=.|
> 00a26030 22 00 62 00 6f 00 6f 00 74 00 6d 00 67 00 72 00 |".b.o.o.t.m.g.r.|
> 00a26040 2d 00 63 00 6c 00 65 00 61 00 72 00 2d 00 73 00 |-.c.l.e.a.r.-.s.|
> 00a26050 63 00 72 00 65 00 65 00 6e 00 22 00 3e 00 0d 00 |c.r.e.e.n.".>...|
> 00a26060 0a 00 3c 00 6f 00 73 00 78 00 6d 00 6c 00 3a 00 |..<.o.s.x.m.l.:.|
> 00a26070 74 00 65 00 78 00 74 00 2d 00 6d 00 6f 00 64 00 |t.e.x.t.-.m.o.d.|
> 00a26080 65 00 2d 00 75 00 69 00 3e 00 0d 00 0a 00 20 00 |e.-.u.i.>..... .|
> 00a26090 20 00 3c 00 62 00 6f 00 64 00 79 00 20 00 62 00 | .<.b.o.d.y. .b.|
> 00a260a0 61 00 63 00 6b 00 67 00 72 00 6f 00 75 00 6e 00 |a.c.k.g.r.o.u.n.|
> 00a260b0 64 00 2d 00 63 00 6f 00 6c 00 6f 00 72 00 3d 00 |d.-.c.o.l.o.r.=.|
> 00a260c0 22 00 58 00 58 00 58 00 58 00 22 00 20 00 66 00 |".X.X.X.X.". .f.|
> 00a260d0 6f 00 72 00 65 00 67 00 72 00 6f 00 75 00 6e 00 |o.r.e.g.r.o.u.n.|
> 00a260e0 64 00 2d 00 63 00 6f 00 6c 00 6f 00 72 00 3d 00 |d.-.c.o.l.o.r.=.|
> 00a260f0 22 00 52 00 47 00 42 00 58 00 22 00 3e 00 0d 00 |".R.G.B.X.".>...|
> 00a26100 0a 00 20 00 20 00 3c 00 62 00 72 00 2f 00 3e 00 |.. . .<.b.r./.>.|
> 00a26110 0d 00 0a 00 20 00 20 00 3c 00 2f 00 62 00 6f 00 |.... . .<./.b.o.|
> 00a26120 64 00 79 00 3e 00 0d 00 0a 00 3c 00 2f 00 6f 00 |d.y.>.....<./.o.|
> 00a26130 73 00 78 00 6d 00 6c 00 3a 00 74 00 65 00 78 00 |s.x.m.l.:.t.e.x.|
> 00a26140 74 00 2d 00 6d 00 6f 00 64 00 65 00 2d 00 75 00 |t.-.m.o.d.e.-.u.|
> 00a26150 69 00 3e 00 0d 00 0a 00 3c 00 2f 00 78 00 73 00 |i.>.....<./.x.s.|
> 00a26160 6c 00 3a 00 74 00 65 00 6d 00 70 00 6c 00 61 00 |l.:.t.e.m.p.l.a.|
> 00a26170 74 00 65 00 3e 00 0d 00 0a 00 0d 00 0a 00 3c 00 |t.e.>.........<.|
> 00a26180 78 00 73 00 6c 00 3a 00 74 00 65 00 6d 00 70 00 |x.s.l.:.t.e.m.p.|
> 00a26190 6c 00 61 00 74 00 65 00 20 00 6d 00 61 00 74 00 |l.a.t.e. .m.a.t.|
> 00a261a0 63 00 68 00 3d 00 22 00 2a 00 7c 00 40 00 2a 00 |c.h.=.".*.|.@.*.|
> 00a261b0 7c 00 74 00 65 00 78 00 74 00 28 00 29 00 22 00 ||.t.e.x.t.(.).".|
> 00a261c0 2f 00 3e 00 0d 00 0a 00 0d 00 0a 00 3c 00 2f 00 |/.>.........<./.|
> 00a261d0 78 00 73 00 6c 00 3a 00 73 00 74 00 79 00 6c 00 |x.s.l.:.s.t.y.l.|
> 00a261e0 65 00 73 00 68 00 65 00 65 00 74 00 3e 00 0d 00 |e.s.h.e.e.t.>...|
> 00a261f0 0a 00 50 41 50 41 44 44 49 4e 47 58 58 50 41 44 |..PAPADDINGXXPAD|
> 00a26200 80 25 00 00 00 02 02 00 30 82 25 72 06 09 2a 86 |.%......0.%r..*.|
> 00a26210 48 86 f7 0d 01 07 02 a0 82 25 63 30 82 25 5f 02 |H........%c0.%_.|
> 00a26220 01 01 31 0f 30 0d 06 09 60 86 48 01 65 03 04 02 |..1.0...`.H.e...|
> 00a26230 01 05 00 30 5c 06 0a 2b 06 01 04 01 82 37 02 01 |...0\..+.....7..|
> 00a26240 04 a0 4e 30 4c 30 17 06 0a 2b 06 01 04 01 82 37 |..N0L0...+.....7|
> 00a26250 02 01 0f 30 09 03 01 00 a0 04 a2 02 80 00 30 31 |...0..........01|
> 00a26260 30 0d 06 09 60 86 48 01 65 03 04 02 01 05 00 04 |0...`.H.e.......|
> 00a26270 20 b8 46 fa 44 a4 bb bd 3f f4 dd c3 08 72 4e 29 | .F.D...?....rN)|
> 00a26280 b7 0d 80 66 8f 02 27 ed 90 24 0b 74 ab 34 79 03 |...f..'..$.t.4y.|
> 00a26290 a6 a0 82 0a e8 30 82 05 09 30 82 03 f1 a0 03 02 |.....0...0......|
> 00a262a0 01 02 02 13 33 00 00 04 5f f3 c9 6c 1a 7f f7 da |....3..._..l....|
654181,654184c654200,654210
< 00f26000 00 00 20 00 00 00 00 00 00 00 00 00 00 00 00 00 |..
.............|
Not good.
-- Martin
--
You are receiving this mail because:
You are the assignee for the bug.