rsync locks for very long periods (indefinitely?) when using suj over raid5

Ollivier Robert roberto at keltia.freenix.fr
Fri Apr 30 14:48:35 UTC 2010


9.0-CURRENT as of two hours ago (with latest SUJ fixes then) running on a bi-Xeon @2.8 GHz (5 year old) w/ HT, 32-bit mode (no LM). 4 GB, no PAE

4 72 GB disks in a raid5 with gvinum, block size: 128 KB
UFS2 + SUJ, mounted async.

420 [15:40] root at vcs:/data# gvinum list
4 drives:
D gvinumdrive0          State: up	/dev/da2	A: 6/69459 MB (0%)
D gvinumdrive3          State: up	/dev/da5	A: 6/69459 MB (0%)
D gvinumdrive2          State: up	/dev/da4	A: 6/69459 MB (0%)
D gvinumdrive1          State: up	/dev/da3	A: 0/69452 MB (0%)

1 volume:
V data0                 State: up	Plexes:       1	Size:        203 GB

1 plex:
P data0.p0           R5 State: up	Subdisks:     4	Size:        203 GB

4 subdisks:
S data0.p0.s3           State: up	D: gvinumdrive3 Size:         67 GB
S data0.p0.s2           State: up	D: gvinumdrive2 Size:         67 GB
S data0.p0.s1           State: up	D: gvinumdrive1 Size:         67 GB
S data0.p0.s0           State: up	D: gvinumdrive0 Size:         67 GB


rsync from / (plain UFS2) to /data (UFS2+SUJ over raid5) locks in a matter of seconds. Stay in "getblk" state.

ps / show pcpu / show alllocks / show threads / show lockedvnods
http://sparc64.pastebin.com/NBNQJJXs

bt on rsync
http://sparc64.pastebin.com/cCZx0FU7

Kernel compiled with
INVARIANTS
INVARIANT_SUPPORT
WITNESS
WITNESS_SKIPSPIN

Anything else?

-- 
Ollivier ROBERT -=- FreeBSD: The Power to Serve! -=- roberto at keltia.freenix.fr
In memoriam to Ondine : http://ondine.keltia.net/



More information about the freebsd-current mailing list