Re: (ITS#4702) out-of-memory on huge DB ?

[quanah@stanford.edu]

--On Sunday, October 08, 2006 4:35 AM +0000 hyc@symas.com wrote:

>> Then I've tried to syncrepl the entire DB, turning on the empty
>> consumers (crazy idea ;) i know ) but the provider memory allocated,
>> again reached 4GB and... bum
>>
>> some ideas?

4GB is the memory limit on 32-bit Solaris, IIRC.  Just like it is 2GB on 
32-bit linux.  Try building everything 64-bit.  Another thing to try, from 
when I ran my servers on Solaris, is to fix the limits in /etc/system for 
the maximum amount of memory that can be allocated.  I vaguely recall 
having to do this for my Solaris systems.  Oh, and with BDB on Solaris, you 
want to use the "shm_key" flag in slapd.conf to use shared memory segments, 
when running on SPARC.


Here's the last portions of /etc/system on my old Solaris LDAP servers:

* turn off executable stacks
set noexec_user_stack     = 1
set noexec_user_stack_log = 1
* increase the size of the kernel stack to 24k for Solaris 8/64-bit
set rpcmod:svc_default_stksize=0x6000
set lwp_default_stksize=0x6000
* force load the shared module kernel information.
forceload: sys/shmsys
* allow shared memory segments of up to 3 GB (default 1MB)
* See http://www.sun.com/sun-on-net/itworld/UIR960101perf.html
set shmsys:shminfo_shmmax=3221225472
* Increase memory performance when filesystem is being heavily used.
* See http://www.sun.com/sun-on-net/performance/priority_paging.html
set priority_paging=1
* Increase memory performance when filesystem is being heavily used.
* See http://www.samag.com/documents/s=1323/sam0110e/0110e.htm
set maxpgio=25468
set slowscan=500
* autoup influences how much RAM is checked by fsflush every 5 seconds.
* Default = 30. Increase autoup to decrease mem management overhead.
* See http://docs.sun.com/db/doc/806-7009/6jftnqsin?a=view
set autoup = 60
* Up tcp conn hash size.  Defaults to 256.
* See http://www.deny-all.com/en/solsecu/tech/tuning.html
set tcp:tcp_conn_hash_size = 16384
* Up file descriptor limit.  Defaults to 1024.
set rlim_fd_max = 16384


--Quanah

--
Quanah Gibson-Mount
Principal Software Developer
ITS/Shared Application Services
Stanford University
GnuPG Public Key: http://www.stanford.edu/~quanah/pgp.html