Re: Serious performance problems

[Mikel.Santos@idom.com]

Hi Buchan,

I have tested ldap performance with both slapcat and ldapsearch redirecting
the output to /dev/null. The searches returning lots of matches, take from
less than a second to three seconds max, which I guess it is the "expected"
performance. Performance decreases when output is shown on the screen,
though (which I find normal).
So the bottleneck seems to be apache+PHP. Actually, I am pretty sure about
this, since I have been watching slapd and apache processes and their CPU
consumption lately, and apache raises up to 99-100% when these ldap
searches are performed.
I know this might not be the place to ask, but if anyone has experienced
similar problems, please let me know.

Thank you for your time

Mikel



                                                                           
             Buchan Milne                                                  
             <bgmilne@staff.te                                             
             lkomsa.net>                                              Para 
                                       openldap-technical@openldap.org     
             25/04/2008 16:13                                           cc 
                                       Mikel.Santos@idom.com               
                                                                    Asunto 
                                       Re: Serious performance problems    
                                                                           
                                                                           
                                                                           
                                                                           
                                                                           
                                                                           




On Friday 25 April 2008 11:28:44 Mikel.Santos@idom.com wrote:
> Hi guys,
>
> First of all, I would like to thank the community for such a great piece
of
> software and encourage the developers to keep up the good work.
>
> Until now, the setup of the ldap and the file configuration has been
pretty
> straightforward. The ldap was performing great with few entries, but
things
> got worse as the number of entries in the ldap increased.
> Currently we are experiencing serious performance problems when the
> searches performed exceed certain amount of entries. The "ldap_search"
> calls usually return after a few seconds but as the number of results
> matching the filter entered increases, the waiting time varies from one
> minute to many minutes.

This would appear to be a client-side problem. In my experience, the
performance (rate at which entries are returned, minus overhead of
connection
setup) on an LDAP server will degrade as the number of entries in the
database increases, not as the number of entries returned increases
(assuming
your cache is not interfering).

> The scenario is the following:
> *  We are accessing openldap via PHP function calls

I think you should test via some other method to ensure that PHP is not the

bottleneck. For example, maybe the amount of memory available to PHP is not

sufficient for the number of entries you are returning.

You can easily determine this by running the ldapsearch utility with
equivalent parameters to your php case. To eliminate any IO issues,
redirect
the results to /dev/null, e.g.:

$ time ldapsearch -x -D $binddn -b $basedn -w $pass -z $entries >/dev/null

(set the environment variables appropriately or replace them)

> * The number of entries in the ldap is close to 100.000
> * The hardware is the following: Intel(R) Xeon(TM) CPU 3.33GHz 1Gb RAM
> * The slapd.conf file is the following:
>
>
/**************************************************************************
>**********************************/ modulepath      /usr/lib/ldap
> moduleload      back_bdb
> sizelimit -1
> tool-threads 1
> backend         bdb
> checkpoint 512 30
> database        bdb
> directory       "/var/lib/ldap"
> dbconfig set_cachesize 0 2097152 0
> cachesize       100000
>
/**************************************************************************
>**********************************/
>
> We have tried to increase both set_cachesize and cachesize (multiplying
> both by 100) and have not noticed a performance increase.
> I hope any of you can point us in the right direction since we are
> beginning to get desperated...

Unless you can reproduce the problem without php, I point you in the
direction
of php ...

Regards,
Buchan