Re: slapindex performance?

[Howard Chu <hyc@symas.com>]

Quanah Gibson-Mount wrote:
> --On Friday, February 24, 2006 7:52 PM -0800 Krishna Sivaramapuram 
> <krishna@everyone.net> wrote:
>
> > I'm trying to reindex my slapd database (bdb) since I added one more
> > equality index. My db has more than 6M entries. I'm trying to see how
> > long this will take... I didn't find any proper reference in the web. 
> > Has
> > anyone done something similar and have any performance data on 
> > slapindex?
>
> What version of OpenLDAP are you using?
>
> I would suggest (of course) OpenLDAP 2.3.  In OpenLDAP 2.3, there are 
> two things that massively improve the speed of slapindex (which is 
> slower than slapadd in all previous releases).  They are:
>
> The "-q" option, to run it via "quick"
> The ability to set "tool-threads", which will allow slapindex to use 
> multiple CPU's while indexing your DB.
>
> Also, if you are adding a brand new index, there is no need to 
> re-index all your existing indices.  You only need to index what is 
> new, which will also speed up slapindex. I.e.,
>
> stop slapd
>
> edit slapd.conf, commenting out all indices except the new one(s).
>
> Run slapindex -q with an appropriate amount of tool-threads (1 per 
> CPU, so on a 2 CPU system, tool-threads 2, etc)
>
> After it is done, edit slapd.conf, uncommenting your pre-existing 
> indices.
>
> restart slapd.

Or, using 2.3, just add the index to cn=config and let the database 
update itself automatically.

--
 -- Howard Chu
 Chief Architect, Symas Corp.  http://www.symas.com
 Director, Highland Sun        http://highlandsun.com/hyc
 OpenLDAP Core Team            http://www.openldap.org/project/