memory limit in cron

Alexey Sveshnikov a.sveshnikov at mail.ru
Wed Dec 6 02:49:40 PST 2006


Hi!!


I have some problems with running perl script from cron. 
My script works with huge log files and it's size grows up to 300-1500Mb. It's necessity and can't be done in other ways than collecting data into hashes. When memory usage reaches 256Mb, error happens:

Out of memory during request for 4084 bytes, total sbrk() is 264271872 bytes!
Callback called exit, <LOG> line 5635900.
END failed--call queue aborted, <LOG> line 5635900. 


Same script with same data works fine when running from console, and it's size grows up to 290Mb.
Also, very same script successfully works in cron on another server, it processes 4Gb files. 

IMHO, one thing that can be reason, is the version of FreeBSD. Script fails on FreeBSD 6.x and works fine on FreeBSD 4.x

How can I make it work on FreeBSD 6.2? 


Hardware (almost same on every servers)

CPU: Intel(R) Xeon(TM) CPU 2.80GHz (2793.01-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0xf41  Stepping = 1
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,
SSE2,SS,HTT,TM,PBE>
  Hyperthreading: 2 logical CPUs
real memory  = 2147352576 (2097024K bytes)
avail memory = 2087211008 (2038292K bytes)

OS: FreeBSD 4.11-RELEASE, FreeBSD 6.2-PRERELEASE

#ulimit
unlimited


Thanks for your attention :)


More information about the freebsd-questions mailing list