NFS small files

[Eric Anderson]

Peter Hessler wrote:
> I should mention that copying the same directory on the nfs server takes
> 15s, rather than the 54s over nfs.


Are you using TCP or UDP NFS connection, version 2 or 3?



> On Tue, 8 Mar 2005 17:46:31 -0800
> Peter Hessler <phessler at coverity.com> wrote:
> 
> : These files are sitting right next to each other on disk, I created
> them
> : at the same time: """for i in `jot 10000`; do dd if=/dev/random of=$i
> : bs=128 count=128; done""".  Then I timed the copy of that directory.
> : 
> : Does seek really cause an 11x performance penalty?
> : 
> : On Tue, 08 Mar 2005 17:40:44 -0800
> : Peter Kieser <pfak at telus.net> wrote:
> : 
> : : Copying single files are always going to take longer, because the
> : drive 
> : : has to seek more thus latency is introduced.
> : : 
> : : --Peter
> : : 
> : : Peter Hessler wrote:
> : : 
> : : >I'm setting up an NFS server to be used for compiling, and it seems
> : that
> : : >while speeds are acceptable for large files, small files take much
> : : >longer than expected.
> : : >
> : : >Copying 10000 16K files (in a directory) takes 54seconds, while
> : copying
> : : >a 170M single file takes 5s.
> : : >
> : : >Are there any tricks for speeding up small file performance?  I'm
> : : >willing to give up large file performance.
> : : >
> : : >/etc/sysctl.conf:
> : : > vfs.vmiodirenable=1
> : : > kern.ipc.somaxconn=2048
> : : > kern.maxfiles=65536
> : : > net.isr.enable=1
> : : >
> : : >/boot/loader.conf:
> : : > kern.ipc.nmbclusters=32768
> : : >
> : : >Kernel Conf:
> : : > include GENERIC
> : : > ident NFS
> : : > options DEVICE_POLLING
> : : > options HZ=1000
> : : >_______________________________________________
> : : >freebsd-performance at freebsd.org mailing list
> : : >http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> : : >To unsubscribe, send any mail to
> : "freebsd-performance-unsubscribe at freebsd.org"
> : : >
> : : >  
> : : >
> : : 
> : : _______________________________________________
> : : freebsd-performance at freebsd.org mailing list
> : : http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> : : To unsubscribe, send any mail to
> : "freebsd-performance-unsubscribe at freebsd.org"
> : _______________________________________________
> : freebsd-performance at freebsd.org mailing list
> : http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> : To unsubscribe, send any mail to
> "freebsd-performance-unsubscribe at freebsd.org"
> _______________________________________________
> freebsd-performance at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> To unsubscribe, send any mail to "freebsd-performance-unsubscribe at freebsd.org"


-- 
------------------------------------------------------------------------
Eric Anderson        Sr. Systems Administrator        Centaur Technology
I have seen the future and it is just like the present, only longer.
------------------------------------------------------------------------