FreeBSD 5.3 I/O Performance / Linux 2.6.10 | Continued Discussion

Jon Noack noackjr at alumni.rice.edu
Mon Jan 31 10:06:10 PST 2005


Mike Tancsa wrote:
>
> OK, I re-ran the tests on the same box using CURRENT as of this
> morning.  There does not seem to be any large difference speed wise
> between
> RELENG_5 and HEAD, at least as it relates to the 3ware driver.  Both
> RELENG_5 and HEAD are behind RELENG_4 and Linux 2.6.10 which are pretty
> equal in the tests that I did.

Did you enable mpsafevfs on HEAD (as rwatson@ mentioned earlier in this
thread)?  If not, I would be very curious to see how it impacts
performance.  To enable it, set debug.mpsafevfs="1" in /boot/loader.conf
and reboot (mpsafevm is required, but it is enabled by default).

Jon

> I could not run the full NFS tests, and async nfs mounts are broken in
> RELENG_5 and HEAD.
>
> F=RELENG_5
> L=Linux 2.6.10
> H=FreeBSD Current Jan 31/2005
>
>                -------Sequential Output-------- ---Sequential
> Input--  --Random--
>                -Per Char- --Block--- -Rewrite-- -Per Char-
> --Block---  --Seeks---
> Machine    MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU
> /sec
> %CPU
> F        2000 33789 25.8 34065  8.3 14038  3.8 47484
> 44.6  67316  9.5  2873.7  5.7
> L        2000 28073 62.0 22391  4.3 12189  2.0 17577 35.5
> 102132  5.5  1853.7  2.5
> H        2000 33301 27.9 34832  8.3 12872  3.4 49762
> 46.8  67274  9.2  8078.1 15.1
>
>
> HEAD
>
> PostMark v1.5 : 3/27/01
> pm>set location /mnt
> pm>set size 300 100000
> pm>set transactions 400000
> pm>run
> Creating files...Done
> Performing transactions..........Done
> Deleting files...Done
> Time:
>          2435 seconds total
>          2432 seconds of transactions (164 per second)
>
> Files:
>          200107 created (82 per second)
>                  Creation alone: 500 files (250 per second)
>                  Mixed with transactions: 199607 files (82 per second)
>          199905 read (82 per second)
>          199384 appended (81 per second)
>          200107 deleted (82 per second)
>                  Deletion alone: 889 files (889 per second)
>                  Mixed with transactions: 199218 files (81 per second)
>
> Data:
>          12715.55 megabytes read (5.22 megabytes per second)
>          12728.92 megabytes written (5.23 megabytes per second)
> pm>
>
>
> LINUX 2.6.10 (EXT3 filesystem)
>
> pm>set size 300 100000
> pm>set location /mnt
> pm>set transactions 400000
> pm>run
> Creating files...Done
> Performing transactions..........Done
> Deleting files...Done
> Time:
>          1504 seconds total
>          1503 seconds of transactions (266 per second)
>
> Files:
>          200107 created (133 per second)
>                  Creation alone: 500 files (500 per second)
>                  Mixed with transactions: 199607 files (132 per second)
>          199905 read (133 per second)
>          199384 appended (132 per second)
>          200107 deleted (133 per second)
>                  Deletion alone: 889 files (889 per second)
>                  Mixed with transactions: 199218 files (132 per second)
>
> Data:
>          12715.55 megabytes read (8.45 megabytes per second)
>          12728.92 megabytes written (8.46 megabytes per second)
> pm>
>
>
> RELENG_5.
> PostMark v1.5 : 3/27/01
> pm>set location /mnt
> pm>size 300 100000
> Eh?
> pm>set size 300 100000
> pm>set location /mnt
> pm>set transactions 400000
> pm>run
> Creating files...Done
> Performing transactions..........Done
> Deleting files...Done
> Time:
>          2490 seconds total
>          2487 seconds of transactions (160 per second)
>
> Files:
>          200107 created (80 per second)
>                  Creation alone: 500 files (500 per second)
>                  Mixed with transactions: 199607 files (80 per second)
>          199905 read (80 per second)
>          199384 appended (80 per second)
>          200107 deleted (80 per second)
>                  Deletion alone: 889 files (444 per second)
>                  Mixed with transactions: 199218 files (80 per second)
>
> Data:
>          12715.55 megabytes read (5.11 megabytes per second)
>          12728.92 megabytes written (5.11 megabytes per second)
> pm>
>
>
> HEAD
>
> [nfs]# time dd if=/dev/zero of=/mnt/test bs=16k count=2000
> 2000+0 records in
> 2000+0 records out
> 32768000 bytes transferred in 0.761311 secs (43041540 bytes/sec)
> 0.008u 0.048s 0:00.84 4.7%      35+291k 0+258io 0pf+0w
> [nfs]# time dd if=/dev/zero of=/mnt/test bs=32k count=2000
> 2000+0 records in
> 2000+0 records out
> 65536000 bytes transferred in 2.080178 secs (31504996 bytes/sec)
> 0.000u 0.116s 0:02.08 5.2%      29+285k 1+500io 0pf+0w
> [nfs]# time dd if=/dev/zero of=/mnt/test bs=64k count=2000
> 2000+0 records in
> 2000+0 records out
> 131072000 bytes transferred in 3.381287 secs (38763940 bytes/sec)
> 0.000u 0.232s 0:03.39 6.7%      20+262k 2+1000io 0pf+0w
> [nfs]# time dd if=/dev/zero of=/mnt/test bs=128k count=2000
> time dd if=/dev/zero of=/mnt/test bs=256k count=2000
> 2000+0 records in
> 2000+0 records out
> 262144000 bytes transferred in 6.768166 secs (38731910 bytes/sec)
> 0.007u 0.477s 0:06.80 6.9%      26+495k 7+2000io 0pf+0w
> [nfs]# time dd if=/dev/zero of=/mnt/test bs=256k count=2000
> time dd if=/dev/zero of=/mnt/test bs=512k count=2000
> 2000+0 records in
> 2000+0 records out
> 524288000 bytes transferred in 14.230285 secs (36843113 bytes/sec)
> 0.000u 0.988s 0:14.29 6.8%      26+833k 6+4000io 0pf+0w
> [nfs]#
> [nfs]# time dd if=/dev/zero of=/mnt/test bs=512k count=2000
> 2000+0 records in
> 2000+0 records out
> 1048576000 bytes transferred in 28.617657 secs (36640875 bytes/sec)
> 0.000u 2.113s 0:28.72 7.3%      25+1430k 29+8000io 0pf+0w
> [nfs]#
>
> RELENG_5
>
> [nfs]# time dd if=/dev/zero of=/mnt/test bs=16k count=2000
> 32768000 bytes transferred in 0.724865 secs (45205661 bytes/sec)
> 0.000u 0.066s 0:00.73 8.2%      33+281k 0+250io 0pf+0w
> [nfs]# time dd if=/dev/zero of=/mnt/test bs=32k count=2000
> 65536000 bytes transferred in 1.731888 secs (37840788 bytes/sec)
> 0.000u 0.122s 0:01.74 6.8%      28+283k 0+500io 0pf+0w
> [nfs]# time dd if=/dev/zero of=/mnt/test bs=64k count=2000
> 131072000 bytes transferred in 3.131403 secs (41857273 bytes/sec)
> 0.000u 0.245s 0:03.14 7.6%      25+335k 0+1000io 0pf+0w
> [nfs]# time dd if=/dev/zero of=/mnt/test bs=128k count=2000
> 262144000 bytes transferred in 6.973014 secs (37594073 bytes/sec)
> 0.000u 0.509s 0:07.00 7.1%      26+510k 0+2000io 0pf+0w
> [nfs]# time dd if=/dev/zero of=/mnt/test bs=256k count=2000
> 524288000 bytes transferred in 14.253915 secs (36782035 bytes/sec)
> 0.000u 1.003s 0:14.30 6.9%      25+784k 0+4000io 0pf+0w
> [nfs]# time dd if=/dev/zero of=/mnt/test bs=512k count=2000
> 1048576000 bytes transferred in 28.135716 secs (37268502 bytes/sec)
> 0.008u 2.165s 0:28.21 7.6%      24+1386k 0+8000io 0pf+0w
> [nfs]#
>
>
>
> NFS tests done from a RELENG_5 client with testfile.new in the servers
> cache
>
>
> [ns4-new]# time dd if=/dev/zero of=/mnt/testfile bs=16k count=16384
> 16384+0 records in
> 16384+0 records out
> 268435456 bytes transferred in 80.830089 secs (3320984 bytes/sec)
> 0.020u 0.442s 1:20.90 0.5%      29+254k 0+32768io 0pf+0w
> [ns4-new]# time dd if=/mnt/testfile.new of=/dev/null bs=16k
> 16384+0 records in
> 16384+0 records out
> 268435456 bytes transferred in 0.290720 secs (923347100 bytes/sec)
> 0.007u 0.283s 0:00.29 96.5%     26+227k 0+0io 0pf+0w
>
> postmark on nfs
>
> PostMark v1.5 : 3/27/01
> pm>set size 300 100000
> pm>set location /mnt
> pm>set transactions 400
> pm>run
> Creating files...Done
> Performing transactions..........Done
> Deleting files...Done
> Time:
>          68 seconds total
>          64 seconds of transactions (6 per second)
>
> Files:
>          697 created (10 per second)
>                  Creation alone: 500 files (125 per second)
>                  Mixed with transactions: 197 files (3 per second)
>          194 read (3 per second)
>          206 appended (3 per second)
>          697 deleted (10 per second)
>                  Deletion alone: 494 files (494 per second)
>                  Mixed with transactions: 203 files (3 per second)
>
> Data:
>          10.26 megabytes read (154.52 kilobytes per second)
>          36.87 megabytes written (555.26 kilobytes per second)
>
>
>
> NFS on HEAD
>
> [ns4-new]# time dd if=/dev/zero of=/mnt/testfile bs=16k count=16384
> 16384+0 records in
> 16384+0 records out
> 268435456 bytes transferred in 52.172368 secs (5145165 bytes/sec)
> 0.016u 0.465s 0:52.23 0.8%      24+208k 0+32768io 0pf+0w
> [ns4-new]# time dd if=/mnt/testfile.new of=/dev/null bs=16k
> 16384+1 records in
> 16384+1 records out
> 268435774 bytes transferred in 6.328295 secs (42418341 bytes/sec)
> 0.023u 0.363s 0:06.36 5.9%      35+298k 0+0io 0pf+0w
> [ns4-new]#
>
> PostMark v1.5 : 3/27/01
> pm>set location /mnt
> pm>set size 300 100000
> pm>set transactions 400
> pm>run
> Creating files...Done
> Performing transactions..........Done
> Deleting files...Done
> Time:
>          68 seconds total
>          63 seconds of transactions (6 per second)
>
> Files:
>          697 created (10 per second)
>                  Creation alone: 500 files (125 per second)
>                  Mixed with transactions: 197 files (3 per second)
>          194 read (3 per second)
>          206 appended (3 per second)
>          697 deleted (10 per second)
>                  Deletion alone: 494 files (494 per second)
>                  Mixed with transactions: 203 files (3 per second)
>
> Data:
>          10.26 megabytes read (154.52 kilobytes per second)
>          36.87 megabytes written (555.26 kilobytes per second)
> pm>
>
> NFS on head with vfs.nfsrv.async=1
>
> [ns4-new]# time dd if=/dev/zero of=/mnt/testfile.async bs=16k count=16384
> 16384+0 records in
> 16384+0 records out
> 268435456 bytes transferred in 500.301252 secs (536548 bytes/sec)
> 0.018u 0.453s 8:20.53 0.0%      22+194k 0+32768io 0pf+0w
> [ns4-new]#
>
> _______________________________________________
> freebsd-performance at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> To unsubscribe, send any mail to
> "freebsd-performance-unsubscribe at freebsd.org"
>
>




More information about the freebsd-performance mailing list