nfsd server cache flooded, try to increase nfsrc_floodlevel

[Clinton Adams]

On Wed, Jul 20, 2011 at 1:09 AM, Rick Macklem <rmacklem at uoguelph.ca> wrote:
> Please try the patch, which is at:
>   http://people.freebsd.org/~rmacklem/noopen.patch
> (This patch is against the file in -current, so patch may not like it, but
>  it should be easy to do by hand, if patch fails.)
>
> Again, good luck with it and please let me know how it goes, rick
>

Thanks for your help with this, trying the patches now. Tests with one
client look good so far, values for OpenOwner and CacheSize are more
in line, we'll test with more clients later today. We were hitting the
nfsrc_floodlevel with just three clients before, all using nfs4
mounted home and other directories. Clients are running Ubuntu 10.04.2
LTS.  Usage has been general desktop usage, nothing unusual that we
could see.

Relevant snippet of /proc/mounts on client (rsize,wsize are being
automatically negotiated, not specified in the automount options):
pez.votesmart.org:/public /export/public nfs4
rw,relatime,vers=4,rsize=65536,wsize=65536,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=krb5,clientaddr=192.168.255.112,minorversion=0,addr=192.168.255.25
0 0
pez.votesmart.org:/home/clinton /home/clinton nfs4
rw,relatime,vers=4,rsize=65536,wsize=65536,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=krb5,clientaddr=192.168.255.112,minorversion=0,addr=192.168.255.25
0 0

nfsstat -e -s, with patches, after some stress testing:
Server Info:
  Getattr   Setattr    Lookup  Readlink      Read     Write    Create    Remove
    95334         1     28004        50    297125         2         0         0
   Rename      Link   Symlink     Mkdir     Rmdir   Readdir  RdirPlus    Access
        0         0         0         0         0      1242         0      1444
    Mknod    Fsstat    Fsinfo  PathConf    Commit   LookupP   SetClId SetClIdCf
        0         0         0         0         2         0         4         4
     Open  OpenAttr OpenDwnGr  OpenCfrm DelePurge   DeleRet     GetFH      Lock
   176735         0         0     21175         0         0     49171         0
    LockT     LockU     Close    Verify   NVerify     PutFH  PutPubFH PutRootFH
        0         0     21184         0         0    549853         0        17
    Renew RestoreFH    SaveFH   Secinfo RelLckOwn  V4Create
        0     21186    176735         0         0         0
Server:
Retfailed    Faults   Clients
        0         0         1
OpenOwner     Opens LockOwner     Locks    Delegs
      291         2         0         0         0
Server Cache Stats:
   Inprog      Idem  Non-idem    Misses CacheSize   TCPPeak
        0         0         0    549969       291      2827

nfsstat -e -s, prior to patches, general usage:

Server Info:
  Getattr   Setattr    Lookup  Readlink      Read     Write    Create    Remove
  2813477     62661    382636      1419    837492   2115422         0     33976
   Rename      Link   Symlink     Mkdir     Rmdir   Readdir  RdirPlus    Access
    31164      1310         0         0         0     15678        10    307236
    Mknod    Fsstat    Fsinfo  PathConf    Commit   LookupP   SetClId SetClIdCf
        0         0         2         1    144550         0        43        43
     Open  OpenAttr OpenDwnGr  OpenCfrm DelePurge   DeleRet     GetFH      Lock
  1462595         0       595     11267         0         0    550761    280674
    LockT     LockU     Close    Verify   NVerify     PutFH  PutPubFH PutRootFH
      155    212299    286615         0         0   6651006         0      1234
    Renew RestoreFH    SaveFH   Secinfo RelLckOwn  V4Create
   256784    320761   1495805         0         0       738
Server:
Retfailed    Faults   Clients
        0         0         3
OpenOwner     Opens LockOwner     Locks    Delegs
        6       178      8012         2         0
Server Cache Stats:
   Inprog      Idem  Non-idem    Misses CacheSize   TCPPeak
        0         0        96   6876610      8084     13429


> _______________________________________________
> freebsd-fs at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-fs
> To unsubscribe, send any mail to "freebsd-fs-unsubscribe at freebsd.org"
>