Re: Performance of MDB and BDB Please suggest?

Yajuvendra

On Fri, Aug 31, 2012 at 12:32 PM, Yajuvendra Singh <yajuvendra.singh@gmail.com> wrote:

Hi Howard,

I am attaching the wireshark logs for the search request. Also attaching the conf file which we are currently using for load and performance run.

Startup logs.

50405dd3 line 20 (pidfile /root/haroon/openldap/new1/OnBoardSPR/var/run/slapd.pid)
50405dd3 line 21 (argsfile /root/haroon/openldap/new1/OnBoardSPR/var/run/slapd.args)

50405dd3 line 23 (logfile /tmp/log/onboardspr.log)
50405dd3 line 26 (sizelimit 10000)
50405dd3 line 27 (timelimit 2)
50405dd3 line 29 (database mdb)
50405dd3 line 30 (suffix "dc=C-NTDB")

50405dd3 line 31 (rootdn "dc=C-NTDB")
50405dd3 line 32 (rootpw ***)
50405dd3 line 37 (access to dn.subtree="dc=MSISDN, dc=C-NTDB" filter=(objectClass=*) by group.exact="cn=pcsAccess,ou=groups,dc=C-NTDB" write by group.exact="cn=sdfAccess,ou=groups,dc=C-NTDB" write by * read)

50405dd3 line 41 (access to dn.subtree="ds=DEVICE, dc=C-NTDB" filter=(objectClass=*) by group.exact="cn=sdfAccess,ou=groups,dc=C-NTDB" write by * read)
50405dd3 line 45 (access to dn.subtree="o=service, dc=C-NTDB" filter=(objectClass=*) by group.exact="cn=sdfAccess,ou=groups,dc=C-NTDB" write by * read)

50405dd3 line 50 (access to * by users read by dn="dc=C-NTDB" write by * read)
50405dd3 /root/haroon/openldap/new1/OnBoardSPR/etc/openldap/onboardSPR.conf: line 50: rootdn is always granted unlimited privileges.

50405dd3 line 52 (index objectClass eq)
50405dd3 index objectClass 0x0004
50405dd3 line 54 (index msisdn eq)
50405dd3 index msisdn 0x0004
50405dd3 line 56 (index entryCSN,entryUUID eq)

50405dd3 index entryCSN 0x0004
50405dd3 index entryUUID 0x0004
50405dd3 line 57 (maxsize 16106127360)
50405dd3 line 60 (directory /root/haroon/openldap/new1/OnBoardSPR/database)

50405dd3 config_back_db_open: No explicit ACL for back-config configured. Using hardcoded default
50405dd3 mdb_monitor_db_open: monitoring disabled; configure monitor database to enable
50405dd3 slapd starting

Regards,
Yajuvendra

On Fri, Aug 31, 2012 at 12:07 PM, Howard Chu <hyc@symas.com> wrote:

Yajuvendra Singh wrote:
> Hi,
>

> I feel search is indexed, last time in one of your replies you had mentioned
> mdb_stat tool and i think the indexes are present.

What you feel is irrelevant. Give us facts.

What is the actual search request? What filter is in the request? You post no
useful information in any of your emails.

In the slapd.conf you posted previously, some of your index directives were
commented out. It sounds like you actually have no idea what is or isn't indexed.

>
> Regards,
> Yajuvendra
>
>
> On Fri, Aug 31, 2012 at 11:05 AM, Howard Chu <hyc@symas.com

> <mailto:hyc@symas.com>> wrote:
>
> Yajuvendra Singh wrote:
> > Hi,
> >
> > I did some profiling on the 2.4.32 build and the output of callgrind is
> > attached as graph.
> >
> > below four functions are coming as bottleneck while searching
> >
> > mdb_cursor_set
> > mdb_entry_decode
> > mdb_i2dl_insert
> > mdb_i2dl_search
> >
> > Can anyone help why below functions are taking too much CPU. Why
> > mdb_entry_decode mdb_cursor_set and mdb_i2dl_search are taking all most
> all CPU.
>
> Looks like your search is not indexed.

--
-- Howard Chu
CTO, Symas Corp. http://www.symas.com
Director, Highland Sun http://highlandsun.com/hyc/
Chief Architect, OpenLDAP http://www.openldap.org/project/