[Bug 197516] TRIM on gmirror is slow and results in inresponsive system

bugzilla-noreply at freebsd.org bugzilla-noreply at freebsd.org
Fri Feb 13 14:02:14 UTC 2015


https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=197516

Robert Schulze <rs at bytecamp.net> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                URL|                            |https://forums.freebsd.org/
                   |                            |threads/bonnie-causes-ssd-b
                   |                            |acked-gmirror-to-freeze-hig
                   |                            |h-i-o-busy-with-no-throughp
                   |                            |ut.50272/

--- Comment #3 from Robert Schulze <rs at bytecamp.net> ---
One more thing to add: the behaviour of the delete calls varies extremely. I
subsequently created and deleted a 1G file and the whole delete procedure
(monitored via iostat) took 32, 14, 10, 80 seconds to complete.

I've disabled everything except syslog and ssh.
Here is the script:

--- 8< ----------------------------------------------
#!/bin/sh

FSZ=1000
FILE=/usr/${FSZ}M

echo "creating ${FSZ}M file $FILE..."
dd if=/dev/random of=$FILE bs=1k count=${FSZ}k
sync
echo "done, hit enter to delete file..."
read noop

echo "deleting file..."
unlink $FILE
sync
echo "done"
echo "running iostat -w1 ada0 ada1"

iostat -w1 ada0 ada1
--- 8< ----------------------------------------------

And the results:
1) 00:32.231

       tty            ada0             ada1             cpu
 tin  tout  KB/t tps  MB/s   KB/t tps  MB/s  us ni sy in id
   1   115 52.20 591 30.13  52.13 592 30.15   0  0  8  0 91
   0   343 32.00 4040 126.24  32.00 4033 126.04   0  0 22  0 78
   0   223 32.00 1791 55.98  32.00 1796 56.12   0  0 24  0 76
   0   203 32.00 1567 48.98  32.00 1567 48.95   0  0 19  0 81
   0   184 32.00 4414 137.94  32.00 4426 138.30   0  0 21  0 79
   0   333 32.00 2098 65.57  32.00 2092 65.36   0  0 24  0 75
   0   168 32.00 1556 48.61  32.00 1567 48.96   0  0 24  0 76
   0   177 32.00 1311 40.98  32.00 1310 40.95   0  0 24  0 76
   0   191 32.00 1153 36.04  32.00 1150 35.95   0  0 23  0 77
   0   182 32.00 1052 32.88  32.00 1040 32.51   0  0 21  0 78
   0   178 32.00 944 29.51  32.00 971 30.33   0  0 24  0 76
   0   181 32.00 889 27.78  32.00 882 27.57   0  0 23  0 77
   0   179 32.00 811 25.34  32.00 829 25.90   0  0 24  0 76
   0   189 32.00 778 24.33  32.00 755 23.58   0  0 24  0 76
   0   191 32.00 640 19.99  32.00 624 19.49   0  0 23  0 77
   0   164 32.00 469 14.67  32.00 470 14.70   0  0 21  0 79
   0   177 32.00 500 15.61  32.00 596 18.64   0  0 22  0 77
   0   175 32.00 605 18.90  32.00 572 17.87   0  0 24  0 76
   0   183 32.00 565 17.65  32.00 523 16.35   0  0 23  0 77
   0   186 32.00 701 21.92  32.00 729 22.77   0  0 23  0 77
   0   189 32.00 445 13.91  32.00 491 15.35   0  0 24  0 76
   0   177 32.00 467 14.58  32.00 403 12.61   0  0 24  0 76
   0   313 32.00 385 12.02  32.00 437 13.65   0  0 24  0 76
   0   181 32.00 419 13.11  32.00 351 10.96   0  0 24  0 76
   0   175 32.00 366 11.44  32.00 361 11.29   0  0 23  0 77
   0   180 32.00 300  9.39  32.00 387 12.10   0  0 25  0 75
   0   187 32.00 363 11.34  32.00 285  8.91   0  0 22  0 78
   0   178 32.00 310  9.67  32.00 307  9.58   0  0 24  0 76
   0   191 32.00 260  8.14  32.00 320  9.99   0  0 24  0 76
   0   177 32.00 319  9.96  32.00 254  7.93   0  0 18  0 82
   0   194 31.95 1134 35.38  31.95 1125 35.11   0  0 17  0 83
   0   210  0.00   0  0.00   0.00   0  0.00   0  0  0  0 100
   0   197  0.00   0  0.00   4.00   2  0.01   0  0  0  0 100
   0    93  0.00   0  0.00   0.00   0  0.00   0  0  0  0 100
   0    94  0.00   0  0.00   0.00   0  0.00   0  0  0  0 100

2) 00:14.720

       tty            ada0             ada1             cpu
 tin  tout  KB/t tps  MB/s   KB/t tps  MB/s  us ni sy in id
   1   113 52.12 564 28.69  52.06 565 28.71   0  0  8  0 92
   0   340 32.00 4035 126.11  32.00 4035 126.11   0  0 23  0 77
   0   227 32.00 1867 58.36  32.00 1868 58.38   0  0 23  0 77
   0   200 32.00 1602 50.05  32.00 1600 49.99   0  0 19  0 81
   0   238 31.99 4647 145.16  31.99 4629 144.60   0  0 22  0 78
   0   215 32.00 2156 67.38  32.00 2187 68.35   0  0 25  0 75
   0   193 32.00 1618 50.56  32.00 1687 52.71   0  0 24  0 76
   0   195 32.00 1305 40.79  32.00 1401 43.77   0  0 25  0 75
   0   193 32.00 1194 37.33  32.00 1178 36.80   0  0 25  0 75
   0   156 32.00 1180 36.86  32.00 1035 32.34   0  0 22  0 77
   0   193 32.00 5468 170.89  32.00 5085 158.89   0  0 21  0 78
   0   203 32.00 3108 97.14  32.00 3496 109.24   0  0 23  0 76
   0   206 32.00 1798 56.19  32.00 1797 56.16   0  0 21  0 78
   0   175 32.00 768 23.99  32.00 767 23.96   0  0  7  0 92
   0   165  0.00   0  0.00   0.00   0  0.00   0  0  0  0 100
   0    71  0.00   0  0.00   0.00   0  0.00   0  0  0  0 100
   0    58  0.00   0  0.00   0.00   0  0.00   0  0  0  0 100

3) 00:10.303

       tty            ada0             ada1             cpu
 tin  tout  KB/t tps  MB/s   KB/t tps  MB/s  us ni sy in id
   1   111 52.06 560 28.46  52.00 561 28.47   0  0  8  0 92
   0   328 32.00 10263 320.71  32.00 10138 316.80   0  0 27  0 73
   0   232 32.00 3957 123.65  32.00 3881 121.27   0  0 26  0 74
   0   161 32.00 3015 94.21  32.00 2946 92.06   0  0 25  0 75
   0   157 32.00 2593 81.02  32.00 2531 79.09   0  0 26  0 74
   0   156 32.00 3482 108.82  32.00 3558 111.19   0  0 22  0 78
   0   159 32.00 2002 62.57  32.00 1923 60.09   0  0 26  0 74
   0   148 32.00 1780 55.62  32.00 1935 60.47   0  0 22  0 78
   0   181 32.00 1985 62.03  32.00 2152 67.26   0  0 19  0 81
   0   181 32.00 1898 59.33  32.00 1899 59.36   0  0  9  0 91
   0   183  0.00   0  0.00   0.00   0  0.00   0  0  0  0 100
   0   168  0.00   0  0.00   0.00   0  0.00   0  0  0  0 100
   0    58  0.00   0  0.00   0.00   0  0.00   0  0  0  0 100

4) 01:20.279

       tty            ada0             ada1             cpu
 tin  tout  KB/t tps  MB/s   KB/t tps  MB/s  us ni sy in id
   1   110 52.00 562 28.52  51.94 563 28.54   0  0  8  0 92
   0   350 32.00 4955 154.83  32.00 5004 156.39   0  0 27  0 73
   0   218 32.00 1917 59.92  32.00 1934 60.45   0  0 26  0 74
   0   160 32.00 1483 46.35  32.00 1477 46.14   0  0 25  0 75
   0   156 32.00 1226 38.32  32.00 1269 39.67   0  0 24  0 76
   0   137 32.00 1104 34.51  32.00 1097 34.28   0  0 25  0 75
   0   139 32.00 998 31.19  32.00 994 31.07   0  0 26  0 74
   0   138 32.00 908 28.37  32.00 920 28.75   0  0 26  0 74
   0   153 32.00 832 25.99  32.00 858 26.81   0  0 25  0 75
   0   153 32.00 773 24.17  32.00 786 24.55   0  0 24  0 76
   0   142 32.00 721 22.54  32.00 737 23.05   0  0 25  0 75
   0   161 32.00 679 21.22  32.00 670 20.95   0  0 25  0 75
   0   156 32.00 646 20.20  32.00 608 18.99   0  0 26  0 74
   0   183 32.00 584 18.26  32.00 565 17.65   0  0 25  0 75
   0   190 32.00 551 17.23  32.00 528 16.51   0  0 26  0 74
   0   167 32.00 500 15.63  32.00 496 15.50   0  0 25  0 75
   0   173 32.00 460 14.37  32.00 468 14.64   0  0 24  0 76
   0   169 32.00 423 13.22  32.00 444 13.87   0  0 24  0 76
   0   168 32.00 393 12.29  32.00 413 12.91   0  0 25  0 75
   0   172 32.00 379 11.85  32.00 375 11.73   0  0 25  0 75
   0   168 32.00 341 10.67  32.00 364 11.37   0  0 26  0 74
   0   149 32.00 348 10.88  32.00 318  9.94   0  0 25  0 75
   0   280 32.00 303  9.47  32.00 325 10.17   0  0 25  0 75
   0   169 32.00 298  9.32  32.00 297  9.29   0  0 24  0 76
   0   171 32.00 290  9.05  32.00 271  8.47   0  0 25  0 75
   0   177 32.00 269  8.41  32.00 263  8.23   0  0 25  0 75
   0   176 32.00 246  7.67  32.00 230  7.20   0  0 25  0 75
   0   179 32.00 188  5.88  32.00 191  5.97   0  0 25  0 75
   0   175 32.00 185  5.79  32.00 194  6.06   0  0 25  0 75
   0   201 31.98 1368 42.72  31.98 1429 44.63   0  0 23  0 77
   0   190 32.00 198  6.17  32.00 257  8.03   0  0 26  0 74
   0   172 32.00 159  4.97  32.00 233  7.28   0  0 26  0 74
   0   170 32.00 151  4.73  32.00 229  7.17   0  0 25  0 75
   0   181 32.00 143  4.47  31.88 227  7.06   0  0 26  0 74
   0   196 32.00 132  4.14  32.00 228  7.11   0  0 25  0 75
   0   133 32.00 125  3.92  32.00 225  7.05   0  0 25  0 75
   0   168 32.00 123  3.85  32.00 220  6.88   0  0 25  0 75
   0   184 32.00 113  3.53  32.00 221  6.91   0  0 25  0 75
   0   188 32.00 116  3.62  32.00 214  6.67   0  0 23  0 77
   0   214 31.85 180  5.59  32.00 145  4.53   0  0 24  0 76
   0   190 32.00 183  5.70  32.00 135  4.20   0  0 24  0 76
   0   161 32.00 182  5.67  32.00 127  3.97   0  0 23  0 77
   0   175 32.00 485 15.17  32.00 185  5.78   0  0 24  0 76
   0   286 32.00 279  8.73  32.00 261  8.17   0  0 23  0 77
   0   173 32.00 171  5.35  32.00 179  5.59   0  0 25  0 75
   0   168 32.00 167  5.23  32.00 110  3.44   0  0 24  0 76
   0   173 32.00 150  4.68  32.00 123  3.84   0  0 24  0 76
   0   169 32.00 152  4.75  32.00 118  3.68   0  0 23  0 77
   0   177 32.00 151  4.73  32.00 112  3.51   0  0 24  0 76
   0   173 32.00 154  4.81  32.00 109  3.40   0  0 24  0 76
   0   171 32.00 151  4.73  32.00 105  3.29   0  0 24  0 76
   0   133 32.00 151  4.73  32.00 103  3.20   0  0 24  0 76
   0   151 32.00 149  4.64  32.00 101  3.15   0  0 23  0 77
   0   185 32.00 132  4.12  32.00 116  3.63   0  0 24  0 76
   0   181 32.00 140  4.37  32.00 107  3.35   0  0 24  0 76
   0   180 32.00 138  4.30  32.00 104  3.24   0  0 23  0 77
   0   183 32.00 137  4.30  32.00 104  3.24   0  0 24  0 76
   0   177 32.00 120  3.75  32.00 118  3.69   0  0 24  0 76
   0   144 32.00 121  3.79  32.00 115  3.59   0  0 23  0 77
   0   174 32.00 123  3.84  32.00 111  3.47   0  0 24  0 76
   0    58 32.00 113  3.52  32.00 120  3.76   0  0 25  0 75
   0   188 32.00 114  3.57  32.00 113  3.54   0  0 24  0 75
   0   292 32.00 123  3.85  32.00 103  3.20   0  0 23  0 77
   0   171 32.00 113  3.53  32.00 111  3.47   0  0 25  0 75
   0   291 32.00 113  3.53  32.00 109  3.41   0  0 25  0 75
   0   174 32.00  87  2.73  32.00 135  4.20   0  0 26  0 74
   0   164 32.00  87  2.73  32.00 133  4.15   0  0 24  0 76
   0   169 32.00 100  3.12  32.00 118  3.67   0  0 24  0 76
   0   172 32.00 120  3.76  32.00  94  2.94   0  0 24  0 76
   0   167 32.00 122  3.80  32.00  91  2.85   0  0 20  0 80
   0   163 32.00 126  3.94  32.00  87  2.71   0  0 17  0 83
   0   207 32.00 124  3.89  32.00 101  3.14   0  0 18  0 82
   0   224 32.00 102  3.19  32.00 102  3.19   0  0 19  0 81
   0   156 32.00 102  3.20  32.00 101  3.17   0  0 18  0 82
   0    60 32.00 101  3.15  32.00 101  3.15   0  0 17  0 83
   0   177 32.00 160  5.00  32.00 145  4.52   0  0 21  0 79
   0   213 31.90 548 17.08  31.91 563 17.55   0  0  6  0 94
   0   209  0.00   0  0.00   0.00   0  0.00   0  0  0  0 100
   0   193  0.00   0  0.00   0.00   0  0.00   0  0  0  0 100

Please note that this issue is also mentioned in the forums.

-- 
You are receiving this mail because:
You are the assignee for the bug.


More information about the freebsd-bugs mailing list