resilvering takes ages on 8.2 (amd64 from 18.04.2011)

[Artem Belevich]

On Fri, May 6, 2011 at 5:43 AM, Holger Kipp <Holger.Kipp at alogis.com> wrote:
> Resilvering a disk in raidz2 ZFS is taking ages. Any ideas? I had replaced a different disk this morning (da7) and it took only about 1 hour alltogether. Any ideas? Or did I do something very wrong (tm)?

Don't believe everything you see. On my pool I often see scrub time
estimates of few hundred hours even though it always takes about 6
hours.
Once ZFS is done thrashing disks while it scrubs metadata and starts
doing bulk data transfer, estimates would eventually converge to a
sensible value.

> Disks   da0   da1   da2   da3   da4   da5   da6    328004 wire
> KB/t   0.67  4.92  4.68  4.46  4.53  4.66  4.91     84728 act
> tps     151   138   150   151   146   149   140     39788 inact
> MB/s   0.10  0.66  0.69  0.66  0.65  0.68  0.67      1520 cache
> %busy   101    41    44    42    41    40    39   7647296 free

Yup. It does look like your pool is in "thrashing" stage -- lots of seeking.

--Artem

>
> Best regards,
> Holger
>
> --------------------
>
>  8.2-STABLE FreeBSD 8.2-STABLE #12: Mon Apr 18 12:48:56 CEST 2011
>
> # zpool status
>  pool: tank
>  state: DEGRADED
> status: One or more devices is currently being resilvered.  The pool will
>        continue to function, possibly in a degraded state.
> action: Wait for the resilver to complete.
>  scrub: resilver in progress for 0h21m, 1.10% done, 32h19m to go
> config:
>
>        NAME           STATE     READ WRITE CKSUM
>        tank           DEGRADED     0     0     0
>          raidz2       DEGRADED     0     0     0
>            replacing  DEGRADED     0     0     0
>              da0/old  OFFLINE      0     0     0
>              da0      ONLINE       0     0     0  158M resilvered
>            da1        ONLINE       0     0     0
>            da2        ONLINE       0     0     0
>            da7        ONLINE       0     0     0
>            da3        ONLINE       0     0     0
>            da4        ONLINE       0     0     0
>            da5        ONLINE       0     0     0
>            da6        ONLINE       0     0     0
>
> errors: No known data errors
>
>
>
> -----------------
>    1 users    Load  0.00  0.00  0.00                  May  6 14:37
>
> Mem:KB    REAL            VIRTUAL                       VN PAGER   SWAP PAGER
>        Tot   Share      Tot    Share    Free           in   out     in   out
> Act  119320   18980  1362144    25756 7648824  count
> All  344920   23296 1075218k    57012          pages
> Proc:                                                            Interrupts
>  r   p   d   s   w   Csw  Trp  Sys  Int  Sof  Flt        cow    4765 total
>             76      9171   11  130  766  952             zfod        atkbd0 1
>                                                          ozfod       ata0 irq14
>  0.7%Sys   0.3%Intr  0.0%User  0.0%Nice 99.0%Idle        %ozfod     1 uhci0 16
> |    |    |    |    |    |    |    |    |    |    |       daefr       uhci1 17
>                                                          prcfr     1 twe0 irq24
>                                         7 dtbuf     1106 totfr  1999 cpu0: time
> Namei     Name-cache   Dir-cache    206492 desvn          react   763 isp0 256
>   Calls    hits   %    hits   %      3598 numvn          pdwak     2 em0 irq257
>      12      11  92                  1382 frevn          pdpgs  1999 cpu1: time
>                                                          intrn
> Disks   da0   da1   da2   da3   da4   da5   da6    328004 wire
> KB/t   0.67  4.92  4.68  4.46  4.53  4.66  4.91     84728 act
> tps     151   138   150   151   146   149   140     39788 inact
> MB/s   0.10  0.66  0.69  0.66  0.65  0.68  0.67      1520 cache
> %busy   101    41    44    42    41    40    39   7647296 free
>                                                    60464 buf
>
>
> --
>
>
> Holger Kipp
> Diplom-Mathematiker
> Senior Consultant
>
>
>                [alogis]
>
> Tel.    :       +49 30 436 58 114
> Fax     :       +49 30 436 58 214
> Mobil   :       +49 178 36 58 114
>
> E-Mail  :       holger.kipp at alogis.com
>                alogis AG
> Alt-Moabit 90 B
> D- 10559 Berlin
>
> Web: www.alogis.com<http://www.alogis.com>
>
>
>
> alogis AG
> Sitz/Registergericht: Berlin/AG Charlottenburg, HRB 71484
> Vorstand: Arne Friedrichs, Joern Samuelson
> Aufsichtsratsvorsitzender: Reinhard Mielke
>
>
> _______________________________________________
> freebsd-stable at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stable-unsubscribe at freebsd.org"
>