RE: slapadd, 1 million entries, some numbers

["Howard Chu" <hyc@symas.com>]

> -----Original Message-----
> From: owner-openldap-software@OpenLDAP.org
> [mailto:owner-openldap-software@OpenLDAP.org]On Behalf Of Andreas

> I noticed via top (and according to the time output above) that slapd
> spends a considerable amount of time in the D state, that is,
> waiting for
> a system call to complete if I'm not mistaken.

slapd should not be running at all when you're using slapadd.
D state is a device wait - most likely disk in this case.

> DB_CONFIG:
> set_flags       DB_TXN_NOSYNC
> #set_lg_dir     /storage/ldap
> set_lg_max      104857600
>
> (I will repeat the test with the log dir set to another disk)

> Meanwhile (again :), does anybody see any obvious mistake
> besides the ones I
> already mentioned (ide disk, log in the same disk as the
> database)?

Yes.

> Is cache relevant for bulk loading data?

Read this:
http://www.openldap.org/faq/data/cache/893.html

IDE is not a problem if you have multiple drives dedicated to the purpose. If
your drives are being used by anything else on the system, then you really
lose, and SCSI's advantages come into play.

  -- Howard Chu
  Chief Architect, Symas Corp.       Director, Highland Sun
  http://www.symas.com               http://highlandsun.com/hyc
  Symas: Premier OpenSource Development and Support