Squid memory leaks in -stable using libc malloc

[Anders Nordby]

Hi,

On Sat, Sep 06, 2003 at 08:17:19AM -0700, Mike Harding wrote:
> Squid uses more memory than you assign to cache_mem, this is
> documented in the Squid FAQ, section 8.  cache_mem is sort of a
> 'suggested' value, it's normal for squid to use a lot more memory than
> cache_mem.

I know this, and I know the contents of the FAQ. However, there's a huge
difference between what top reports as memory used (SIZE) and what cache
manager reports as total allocated KB. In a running process I have just
now, top says Squid uses 1235 MB of memory, while cache manager reports
663 MB allocated (contents of /proc/<pid>/map attached). That's after
running for around 10 hours. If I use dlmalloc (I do on one system), the
numbers are 2291 MB according to top and 2221 MB according to cache
manager after running for 30 hours. Do you see the difference? To me,
there seems to be a leak, or at least very unfavourable results with
phkmalloc and Squid.

BTW, in the first example I gave here, I (still) use phkmalloc with H
configured in malloc.conf, although H did not seem to make a difference.

> If you are happy with dmalloc, though, go ahead and use it, just check
> out the squid FAQ about memory usage.  I don't think that there is
> anything wrong with FreeBSD's malloc, it just has different
> performance characteristics.

I agree that there doesn't have to be something technically wrong with
(phk)malloc. However, if there is, someone may have an interest in
following this up (tjr@ seems to be - I talked to him on IRC about
this).

Cheers,

-- 
Anders.
-------------- next part --------------
0x8048000 0x80d6000 125 0 0xf2d28b40 r-x 4 2 0x0 COW NC vnode
0x80d6000 0x80d7000 1 0 0xf2d28240 rw- 1 0 0x2180 COW NNC vnode
0x80d7000 0x81f6000 241 0 0xf2de6e40 rw- 1 0 0x2180 COW NNC default
0x81f6000 0x842b000 561 0 0xf2de6de0 rwx 1 0 0x2180 COW NNC default
0x842b000 0x8776000 843 0 0xf2de6d80 rwx 1 0 0x2180 COW NNC default
0x8776000 0x8777000 1 0 0xf2de6cc0 rwx 1 0 0x2180 COW NNC default
0x8777000 0x54f54000 313309 0 0xf2dd3c60 rwx 1 0 0x2180 NCOW NNC default
0xb70d6000 0xb70e8000 12 0 0xc044f680 r-x 53 26 0x0 COW NC vnode
0xb70e8000 0xb70e9000 1 0 0xf2d71300 rw- 1 0 0x2180 COW NC vnode
0xb70e9000 0xb70eb000 2 0 0xf2d7a1e0 rw- 1 0 0x2180 COW NNC default
0xb70eb000 0xb70f3000 6 0 0xf2d7a240 rwx 1 0 0x2180 COW NNC default
0xb70f3000 0xb70f9000 1 0 0xc044d040 r-x 20 12 0x0 COW NC vnode
0xb70f9000 0xb70fa000 1 0 0xf2d71c00 r-x 1 0 0x2180 COW NC vnode
0xb70fa000 0xb70fb000 1 0 0xf2d716c0 rwx 1 0 0x2180 COW NC vnode
0xb70fb000 0xb710c000 0 0 0 rwx 0 0 0x0 NCOW NNC none
0xb710c000 0xb7122000 9 0 0xf2cf9240 r-x 24 16 0x0 COW NC vnode
0xb7122000 0xb7123000 1 0 0xf2d715a0 r-x 1 0 0x2180 COW NC vnode
0xb7123000 0xb7127000 3 0 0xf2d717e0 rwx 1 0 0x2180 COW NNC vnode
0xb7127000 0xb71a7000 100 0 0xc044f980 r-x 77 50 0x0 COW NC vnode
0xb71a7000 0xb71a8000 1 0 0xf2d71420 r-x 1 0 0x2180 COW NC vnode
0xb71a8000 0xb71ad000 5 0 0xf2dc8c00 rwx 1 0 0x2180 COW NNC vnode
0xb71ad000 0xb71c0000 14 0 0xf2db6420 rwx 1 0 0x2180 COW NNC default
0xb71c0000 0xb72f4000 308 0 0xf6a34c00 rwx 1 0 0x2180 NCOW NNC default
0xbf048000 0xbf0a8000 68 0 0xf2d96f60 rwx 3 0 0x190 NCOW NNC default
0xbf0a8000 0xbf108000 68 0 0xf2d99240 rwx 3 0 0x190 NCOW NNC default
0xbf108000 0xbf168000 67 0 0xf2db6480 rwx 3 0 0x190 NCOW NNC default
0xbfbc0000 0xbfbe0000 8 0 0xf2dd46c0 rwx 1 0 0x2180 NCOW NNC default
0xbfbe0000 0xbfc00000 4 0 0xf2de6ea0 rwx 1 0 0x2180 COW NNC default