gmirror over ggate{d,c}

[Dmitriy Kirhlarov]

Hi Pawel!

On Mon, 28 Feb 2005, Pawel Jakub Dawidek wrote:

> +> I trying create distributed mirror.
> +> 
> +> Machines interconnect 1Gbit.
> +> I exporting slice /dev/ar0s1g via ggated on first node.
> +> Import them via ggatec on second node.
> +> Include ggate0 in gmirrored slice data and run "gmirror rebuild".
> +> After some time I get messages on console:
> +> GEOM_MIRROR: Synchronization request failed (error=5). ggate0[WRITE(offse
> +> t=511442944, length=131072)]
> +> GEOM_MIRROR: Device data: provider ggate0 disconnected.
> +> GEOM_MIRROR: Device data: rebuilding provider ggate0 stopped.
> +> 
> +> First node -- 5.3-STABLE. Second -- 5.3-RELEASE.
> +> 
> +> Any ideas?
> +> May be some enhanced information needed?
> 
> Please set kern.geom.gate.debug sysctl to 1, rerun your test and send
> console output.

I importing device from clh1 to clh0 and mirroring data from clh1 device to clh0 device.

clh1 -- FreeBSD 5.3-RELEASE
ggated running

clh0 -- FreeBSD 5.3-STABLE
ggatec and gmirror running

On the clh1:
Mar  3 16:01:00 clh1 ggated: Error while receiving hdr packet: Connection reset by peer.
Mar  3 16:01:00 clh1 ggated: Exiting.

On the clh0:
GEOM_MIRROR: Device data: provider ar0s1g detected.
GEOM_MIRROR: Device data: rebuilding provider ar0s1g.
GEOM_GATE[1]: Request timeout. ggate0[WRITE(offset=34684698624, length=16384)]
GEOM_GATE[1]: Request timeout. ggate0[WRITE(offset=34684715008, length=16384)]
GEOM_GATE[1]: Request timeout. ggate0[WRITE(offset=34692628480, length=131072)]
GEOM_GATE[1]: Request timeout. ggate0[WRITE(offset=34693120000, length=114688)]
GEOM_GATE[1]: Request timeout. ggate0[WRITE(offset=34693562368, length=131072)]
GEOM_GATE[1]: Request timeout. ggate0[WRITE(offset=34693971968, length=114688)]
GEOM_GATE[1]: Request timeout. ggate0[WRITE(offset=34696445952, length=131072)]
GEOM_GATE[1]: Request timeout. ggate0[WRITE(offset=34698330112, length=131072)]
GEOM_GATE[1]: Request timeout. ggate0[WRITE(offset=34698608640, length=131072)]
GEOM_GATE[1]: Request timeout. ggate0[WRITE(offset=34699100160, length=131072)]
GEOM_GATE[1]: Request timeout. ggate0[WRITE(offset=34699313152, length=131072)]
GEOM_GATE[1]: Request timeout. ggate0[WRITE(offset=34699460608, length=131072)]
GEOM_GATE[1]: Request timeout. ggate0[WRITE(offset=34699919360, length=131072)]
GEOM_GATE[1]: Request timeout. ggate0[WRITE(offset=34700263424, length=131072)]
GEOM_GATE[1]: Request timeout. ggate0[READ(offset=802684928, length=131072)]
GEOM_MIRROR: Request failed (error=5). ggate0[WRITE(offset=34684698624, length=16384)]
GEOM_MIRROR: Device data: provider ggate0 disconnected.
GEOM_MIRROR: Device data: provider mirror/data destroyed.
GEOM_MIRROR: Device data: rebuilding provider ar0s1g stopped.

After that clh0 is hanging -- keyboard work and I can ping machine, but can't login:
$ ssh -v clh0
OpenSSH_3.6.1p1 FreeBSD-20030924, SSH protocols 1.5/2.0, OpenSSL 0x0090703f
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: Rhosts Authentication disabled, originating port will not be trusted.
debug1: Connecting to clh0.office.higis.ru [192.168.0.221] port 22.
debug1: Connection established.
debug1: identity file /home/dimma/.ssh/identity type -1
debug1: identity file /home/dimma/.ssh/id_rsa type -1
debug1: identity file /home/dimma/.ssh/id_dsa type -1

On the console:
login: dimma
Password:
That's all -- no shell prompt.

By.
Dmitriy