[GEOM] Disk IO error when resyncing gmirror -> massive hang in D state

[Dmitry Morozovsky]

Dear colleagues,

unfortunately, the machine in question is in productin, so I have no clear 
reproduce case. I do have console logs, however.

prerequisites:
- rather fresh stable/10, amd64, SuperMicro MicroCloud 1150, X10SLD-F/HF
- su+j ufs2 on top of gmirror of two SATA Toshiba drives
- one disk died some time ago, so gmirror works in degraded state

trouble:
- inserted new drive, labelled, started gmirror resync
- apparently remaining drive also has read issues:
(ada0:ahcich1:0:0:0): READ_FPDMA_QUEUED. ACB: 60 00 10 b2 c3 40 01 00 00 01 00 00
(ada0:ahcich1:0:0:0): CAM status: ATA Status Error
(ada0:ahcich1:0:0:0): ATA status: 41 (DRDY ERR), error: 40 (UNC )
(ada0:ahcich1:0:0:0): RES: 41 40 04 b3 c3 40 01 00 00 00 01
(ada0:ahcich1:0:0:0): Error 5, Retries exhausted
GEOM_MIRROR: Request failed (error=5). ada0a[READ(offset=6566445056, length=131072)]
GEOM_MIRROR: Synchronization request failed (error=5). mirror/m0a[READ(offset=6566445056, length=131072)]

at this point, all requests to disk I/O are stalled, all cron jobs, syslogd, 
dchpd, etc.

Situation reproduce itself at least two times, then as an emergency new drive 
had been labelled independently and rsynced over.

Any thoughts?

Thanks in advance!


-- 
Sincerely,
D.Marck                                     [DM5020, MCK-RIPE, DM3-RIPN]
[ FreeBSD committer:                                 marck at FreeBSD.org ]
------------------------------------------------------------------------
*** Dmitry Morozovsky --- D.Marck --- Wild Woozle --- marck at rinet.ru ***
------------------------------------------------------------------------