[Date Prev][Date Next] [Chronological] [Thread] [Top]
Re: Tweaking "threads"

To: Buchan Milne <bgmilne@obsidian.co.za>
Subject: Re: Tweaking "threads"
From: Ben Beuchler <insyte@gmail.com>
Date: Thu, 1 Sep 2005 09:01:53 -0500
Cc: openldap <openldap-software@OpenLDAP.org>
Content-disposition: inline
Domainkey-signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=tJb+NHS3PHp+aAHLCCm8KymS+ldWennHV2G8SOciEg1DfjykQM6MaBe9A2pXHMm81E9XQuhDY7tREsfxlqYjN/I6s/n3ieDZdS6STLPGw8X7NtEI4Pr1HVJunU9oryJXaSWXW6MhEToSa5qC/LimG4wtsQm13X/7EkZLez+kpdk=
In-reply-to: <4316B5A8.80601@obsidian.co.za>
References: <479b70ed05083122426518045@mail.gmail.com> <4316B5A8.80601@obsidian.co.za>
On 9/1/05, Buchan Milne <bgmilne@obsidian.co.za> wrote:

> What does 'db_stat -m -h /var/lib/ldap' say?
10MB 1KB 604B   Total cache size.
1       Number of caches.
10MB 8KB        Pool individual cache size.
0       Requested pages mapped into the process' address space.
2241787 Requested pages found in the cache (100%).
1034    Requested pages not found in the cache.
0       Pages created in the cache.
1034    Pages read into the cache.
1       Pages written from the cache to the backing file.
0       Clean pages forced from the cache.
0       Dirty pages forced from the cache.
0       Dirty pages written by trickle-sync thread.
1034    Current total page count.
1008    Current clean page count.
26      Current dirty page count.
1031    Number of hash buckets used for page location.
2243855 Total number of times hash chains searched for a page.
4       The longest hash chain searched for a page.
2921065 Total number of hash buckets examined for page location.
4487715 The number of hash bucket locks granted without waiting.
1       The number of hash bucket locks granted after waiting.
1       The maximum number of times any hash bucket lock was waited for.
2248    The number of region locks granted without waiting.
0       The number of region locks granted after waiting.
1130    The number of page allocations.
0       The number of hash buckets examined during allocations
0       The max number of hash buckets examined for an allocation
0       The number of pages examined during allocations
0       The max number of pages examined for an allocation
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: employeeType.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
88      Requested pages found in the cache (97%).
3       Requested pages not found in the cache.
0       Pages created in the cache.
3       Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: apple-computers.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
43      Requested pages found in the cache (88%).
6       Requested pages not found in the cache.
0       Pages created in the cache.
6       Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: employeeNumber.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
0       Requested pages found in the cache (0%).
1       Requested pages not found in the cache.
0       Pages created in the cache.
1       Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: givenName.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
220     Requested pages found in the cache (87%).
33      Requested pages not found in the cache.
0       Pages created in the cache.
33      Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: sn.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
199     Requested pages found in the cache (86%).
33      Requested pages not found in the cache.
0       Pages created in the cache.
33      Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: apple-group-nestedgroup.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
1850    Requested pages found in the cache (100%).
2       Requested pages not found in the cache.
0       Pages created in the cache.
2       Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: apple-mcxflags.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
118     Requested pages found in the cache (93%).
9       Requested pages not found in the cache.
0       Pages created in the cache.
9       Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: displayName.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
576     Requested pages found in the cache (91%).
57      Requested pages not found in the cache.
0       Pages created in the cache.
57      Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: mail.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
12505   Requested pages found in the cache (99%).
155     Requested pages not found in the cache.
0       Pages created in the cache.
155     Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: activeSmtp.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
36051   Requested pages found in the cache (100%).
7       Requested pages not found in the cache.
0       Pages created in the cache.
7       Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: mailAlias.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
11293   Requested pages found in the cache (100%).
26      Requested pages not found in the cache.
0       Pages created in the cache.
26      Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: apple-group-memberguid.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
966     Requested pages found in the cache (100%).
2       Requested pages not found in the cache.
0       Pages created in the cache.
2       Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: memberUid.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
1124    Requested pages found in the cache (100%).
2       Requested pages not found in the cache.
0       Pages created in the cache.
2       Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: gidNumber.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
2104    Requested pages found in the cache (100%).
8       Requested pages not found in the cache.
0       Pages created in the cache.
8       Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: uidNumber.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
8175    Requested pages found in the cache (100%).
10      Requested pages not found in the cache.
0       Pages created in the cache.
10      Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: uid.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
70627   Requested pages found in the cache (100%).
117     Requested pages not found in the cache.
0       Pages created in the cache.
117     Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: activePopImap.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
97154   Requested pages found in the cache (100%).
7       Requested pages not found in the cache.
0       Pages created in the cache.
7       Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: macAddress.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
3262    Requested pages found in the cache (100%).
2       Requested pages not found in the cache.
0       Pages created in the cache.
2       Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: ou.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
8556    Requested pages found in the cache (100%).
6       Requested pages not found in the cache.
0       Pages created in the cache.
6       Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: cn.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
62779   Requested pages found in the cache (100%).
163     Requested pages not found in the cache.
0       Pages created in the cache.
163     Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: apple-generateduid.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
130183  Requested pages found in the cache (100%).
6       Requested pages not found in the cache.
0       Pages created in the cache.
6       Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: objectClass.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
1272624 Requested pages found in the cache (100%).
42      Requested pages not found in the cache.
0       Pages created in the cache.
42      Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: dn2id.bdb
4096    Page size.
0       Requested pages mapped into the process' address space.
510514  Requested pages found in the cache (100%).
78      Requested pages not found in the cache.
0       Pages created in the cache.
78      Pages read into the cache.
0       Pages written from the cache to the backing file.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Pool File: id2entry.bdb
16384   Page size.
0       Requested pages mapped into the process' address space.
10776   Requested pages found in the cache (98%).
259     Requested pages not found in the cache.
0       Pages created in the cache.
259     Pages read into the cache.
1       Pages written from the cache to the backing file.

> You don't show any information on which attributes you are indexing ...
> have you checked that all the search filters clients are using have all
> the attributes which are used for searching indexed appropriately?

I watched the log file for the entries that indicate a search on a
non-indexed attribute and kept adding attributes until all the common
ones were covered.

For what it's worth:

index   objectClass             eq
index   cn,sn,uid               pres,eq,approx,sub
index   givenName               eq,sub
index   displayName             eq,sub
index   mail,mailAlias          eq,sub
index   activePopImap           eq
index   activeSmtp              eq
index   ceridianID              eq
index   jenzabarID              eq
index   ou                      eq
index   employeeNumber          eq
index   employeeType            eq
index   uidNumber,gidNumber     eq
index   memberUid               eq
index   macAddress              eq
index   apple-generateduid      eq
index   apple-group-realname    eq
index   apple-computers         eq
index   apple-mcxflags          sub
index   apple-category          eq
index   apple-networkview       eq
index   apple-group-memberguid  eq
index   apple-group-nestedgroup eq

-Ben
References:
- Tweaking "threads"
  - From: Ben Beuchler <insyte@gmail.com>
- Re: Tweaking "threads"
  - From: Buchan Milne <bgmilne@obsidian.co.za>
Prev by Date: Re: Fault-tolerance for master OpenLDAP server
Next by Date: Re: Tweaking "threads"
Index(es):
- Chronological
- Thread