NFS small files

[Peter Hessler]

On Tue, 08 Mar 2005 20:22:25 -0600
Eric Anderson <anderson at centtech.com> wrote:

:Peter Hessler wrote:
:> I should mention that copying the same directory on the nfs server takes
:> 15s, rather than the 54s over nfs.
:
:
:Are you using TCP or UDP NFS connection, version 2 or 3?
:

TCP and v3.  I didn't see a difference between TCP and UDP.

:
:
:> On Tue, 8 Mar 2005 17:46:31 -0800
:> Peter Hessler <phessler at coverity.com> wrote:
:> 
:> : These files are sitting right next to each other on disk, I created
:> them
:> : at the same time: """for i in `jot 10000`; do dd if=/dev/random of=$i
:> : bs=128 count=128; done""".  Then I timed the copy of that directory.
:> : 
:> : Does seek really cause an 11x performance penalty?
:> : 
:> : On Tue, 08 Mar 2005 17:40:44 -0800
:> : Peter Kieser <pfak at telus.net> wrote:
:> : 
:> : : Copying single files are always going to take longer, because the
:> : drive 
:> : : has to seek more thus latency is introduced.
:> : : 
:> : : --Peter
:> : : 
:> : : Peter Hessler wrote:
:> : : 
:> : : >I'm setting up an NFS server to be used for compiling, and it seems
:> : that
:> : : >while speeds are acceptable for large files, small files take much
:> : : >longer than expected.
:> : : >
:> : : >Copying 10000 16K files (in a directory) takes 54seconds, while
:> : copying
:> : : >a 170M single file takes 5s.
:> : : >
:> : : >Are there any tricks for speeding up small file performance?  I'm
:> : : >willing to give up large file performance.
:> : : >
:> : : >/etc/sysctl.conf:
:> : : > vfs.vmiodirenable=1
:> : : > kern.ipc.somaxconn=2048
:> : : > kern.maxfiles=65536
:> : : > net.isr.enable=1
:> : : >
:> : : >/boot/loader.conf:
:> : : > kern.ipc.nmbclusters=32768
:> : : >
:> : : >Kernel Conf:
:> : : > include GENERIC
:> : : > ident NFS
:> : : > options DEVICE_POLLING
:> : : > options HZ=1000
:> : : >_______________________________________________
:> : : >freebsd-performance at freebsd.org mailing list
:> : : >http://lists.freebsd.org/mailman/listinfo/freebsd-performance
:> : : >To unsubscribe, send any mail to
:> : "freebsd-performance-unsubscribe at freebsd.org"
:> : : >
:> : : >  
:> : : >
:> : : 
:> : : _______________________________________________
:> : : freebsd-performance at freebsd.org mailing list
:> : : http://lists.freebsd.org/mailman/listinfo/freebsd-performance
:> : : To unsubscribe, send any mail to
:> : "freebsd-performance-unsubscribe at freebsd.org"
:> : _______________________________________________
:> : freebsd-performance at freebsd.org mailing list
:> : http://lists.freebsd.org/mailman/listinfo/freebsd-performance
:> : To unsubscribe, send any mail to
:> "freebsd-performance-unsubscribe at freebsd.org"
:> _______________________________________________
:> freebsd-performance at freebsd.org mailing list
:> http://lists.freebsd.org/mailman/listinfo/freebsd-performance
:> To unsubscribe, send any mail to
:"freebsd-performance-unsubscribe at freebsd.org"
:
:
:-- 
:------------------------------------------------------------------------
:Eric Anderson        Sr. Systems Administrator        Centaur Technology
:I have seen the future and it is just like the present, only longer.
:------------------------------------------------------------------------
:_______________________________________________
:freebsd-performance at freebsd.org mailing list
:http://lists.freebsd.org/mailman/listinfo/freebsd-performance
:To unsubscribe, send any mail to
:"freebsd-performance-unsubscribe at freebsd.org"