NFS client over udp

Kirill Yelizarov ykirill at yahoo.com
Sat Feb 19 16:56:47 UTC 2011



--- On Fri, 2/18/11, Kirill Yelizarov <ykirill at yahoo.com> wrote:

> From: Kirill Yelizarov <ykirill at yahoo.com>
> Subject: Re: NFS client over udp
> To: freebsd-stable at freebsd.org
> Date: Friday, February 18, 2011, 5:09 PM
> 
> 
> --- On Fri, 2/18/11, Jeremy Chadwick <freebsd at jdc.parodius.com>
> wrote:
> 
> > From: Jeremy Chadwick <freebsd at jdc.parodius.com>
> > Subject: Re: NFS client over udp
> > To: "Kirill Yelizarov" <ykirill at yahoo.com>
> > Cc: freebsd-stable at freebsd.org
> > Date: Friday, February 18, 2011, 5:05 PM
> > On Fri, Feb 18, 2011 at 05:27:00AM
> > -0800, Kirill Yelizarov wrote:
> > > I have a reproducible memory leak when using nfs
> > client with an old
> > > nfs server using udp protocol. I'm running rsync
> every
> > hour from a
> > > mounted nfs volume to an ufs local volume. Each
> time
> > rsync is running
> > > wired memory is increased. Wired memory is rising
> when
> > rsync is in
> > > getblk or biord state. When rsync is complete
> memory
> > is not freed and
> > > lately all memory is in active or wired state
> and
> > system starts
> > > swapping. I didn't see such behavior when client
> os
> > was RELEASE-8.0.
> > > Then i switched to STABLE-8.1 of late summer and
> found
> > this leak so i
> > > upgraded to STABLE-8.2Prerelease and got the
> same
> > leak. vmstat -m
> > > shows nothing big. 
> > > 
> > > client version: FreeBSD imap1.***.com
> 8.2-PRERELEASE
> > FreeBSD
> > > 8.2-PRERELEASE #0: Thu Feb 17 13:54:25 MSK 2011
> > > root at imap1.****.com:/usr/obj/usr/src/sys/IMAP1 
> > amd64
> > > 
> > > i tried different mounting options:   
> >    1 -
> > >
> >
> rw,rsize=32768,wsize=32768,nfsv3,intr,mntudp,rdirplus,
> > > readdirsize=65536,noauto,noexec 2 -
> > rw,nfsv3,mntudp,noexec
> > > 
> > > i also tried setting -tso -txcsum -rxcsum for
> igb
> > network card
> > 
> > Is ZFS in use on the system which sees rising wired
> > memory?
> No, ufs only. 
I found an old post stating there is a leak with nfs udp client over zfs:
http://lists.freebsd.org/pipermail/freebsd-fs/2010-February/007876.html
In my case i don't have zfs on server or client but the mount is over udp.
Here is top after a day of hourly rsync
last pid: 17306;  load averages:  0.00,  0.00,  0.00    up 0+22:07:34  19:52:53
53 processes:  1 running, 52 sleeping
CPU:     % user,     % nice,     % system,     % interrupt,     % idle
Mem: 12G Active, 1306M Inact, 1609M Wired, 748M Cache, 1641M Buf, 55M Free
Swap: 16G Total, 14M Used, 16G Free

and mbufs used
8193/1722/9915 mbufs in use (current/cache/total)
8192/1264/9456/25600 mbuf clusters in use (current/cache/total/max)
8192/605 mbuf+clusters out of packet secondary zone in use (current/cache)
0/768/768/12800 4k (page size) jumbo clusters in use (current/cache/total/max)
0/0/0/6400 9k jumbo clusters in use (current/cache/total/max)
0/0/0/3200 16k jumbo clusters in use (current/cache/total/max)
18432K/6030K/24462K bytes allocated to network (current/cache/total)
0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
0/0/0 requests for jumbo clusters denied (4k/9k/16k)
0/0/0 sfbufs in use (current/peak/max)
0 requests for sfbufs denied
0 requests for sfbufs delayed
0 requests for I/O initiated by sendfile
0 calls to protocol drain routines

Kirill


      


More information about the freebsd-stable mailing list