[Date Prev][Date Next] [Chronological] [Thread] [Top]

Re: slapindex performance?

I'm seeing one issue after doing this... While doing recoverability testing, I purposefully killed slapd and tried db_recover with -c option... It ran for a long time and then did a segmentation fault. I tried it again and it immediately gave me segment fault. I tried this a bunch of times and the result was the same...

Then I tried restarting slapd... And to my surprise it started fine... I did a few searches and it looked like it searched fine. But the db_recover always crashes now and I don't know if I should consider my bdb db's valid or not.

Krish

Quanah Gibson-Mount wrote:



--On Friday, February 24, 2006 7:52 PM -0800 Krishna Sivaramapuram <krishna@everyone.net> wrote:

I'm trying to reindex my slapd database (bdb) since I added one more
equality index. My db has more than 6M entries. I'm trying to see how
long this will take... I didn't find any proper reference in the web. Has
anyone done something similar and have any performance data on slapindex? 


What version of OpenLDAP are you using?

I would suggest (of course) OpenLDAP 2.3. In OpenLDAP 2.3, there are two things that massively improve the speed of slapindex (which is slower than slapadd in all previous releases). They are:

The "-q" option, to run it via "quick"
The ability to set "tool-threads", which will allow slapindex to use multiple CPU's while indexing your DB.

Also, if you are adding a brand new index, there is no need to re-index all your existing indices. You only need to index what is new, which will also speed up slapindex. I.e.,

stop slapd

edit slapd.conf, commenting out all indices except the new one(s).

Run slapindex -q with an appropriate amount of tool-threads (1 per CPU, so on a 2 CPU system, tool-threads 2, etc)

After it is done, edit slapd.conf, uncommenting your pre-existing indices.

restart slapd.

--Quanah

--
Quanah Gibson-Mount
Principal Software Developer
ITS/Shared Application Services
Stanford University
GnuPG Public Key: http://www.stanford.edu/~quanah/pgp.html