RE : how optimize importation ?

["Pierre FERT" <pfe@calo.ath.cx>]

Thank you, 
I was sure that the slapadd did not produce attributes. in fact I tested
importation LDIF without attribute in DIB, but that did not worked, may be
this file was badly formed ...




-----Message d'origine-----
De : Howard Chu [mailto:hyc@symas.com] 
Envoyé : mercredi 18 octobre 2006 17:12
À : Pierre FERT
Cc : openldap-software@openldap.org
Objet : Re: how optimize importation ?

Pierre FERT wrote:
> Hello,
>  I seek to make an importation in openldap of more than 3.000.000 of
entries
> within the shortest times. 

Use OpenLDAP 2.3.27.
Use slapadd -q

Read the slapadd(8) and slapd-bdb(5) manpages.

> Then well on I have some questions has to pose to you.
>  The importation is carried out starting from a ldapadd and not a slapadd
> because I do not have the data timestamps UIDS etc?.

The timestamps and entryUUIDs are generated automatically by slapadd.

> How can I to make differently? I noted to make an indexing after an
> importation LDIF is faster but, I have the impression that the objectclass
> are indexed in any event has the importation even if `index objectClass
eq'
> is not specified in slapd.conf. 

You must specify "index objectClass eq".

> What wants to thus say that the objectclass are still indexed by
slapindex,

slapadd already generates the indices, so slapindex is not needed here.
slapindex is only useful when adding new indices to an existing database.

> it is thus a waste of time, how can I to make differently?
>  To optimize the importation I have: 
> Slapd.conf :
> Backend bdb
> Loglevel = 0
> put that 3 shemas necessary A the importation (core/cosine/private) 
> schemacheck     off
> dbnosync
> dbnolocking 
> # replogfile
> disabeled the monitor and indexs DB
> DB_CONFIG :
> set_flags DB_TXN_NOSYNC (but it seems to me that dbnosync of slapd.conf is
> equivalent) 
> set_cachesize 0 268435456 1 (for 1Go of memory 512 was slower)
> and I did not modify the repertory of the logs because I nothing gained
> there, I found that odd besides
> 
> since I make db_archive - D to remove the whole of the logs, would not
have
> it there not a means of avoiding creating them? 
> kind to make an importation with a backend which is faster to make a
> slapcat. to go up a backend bdb and to import the LDIF directly in the DIB
> without passing by the DSA?
> 
> Thank you for your councils.
> 
> and sorry for translater

You should probably get help from someone who understands English, 
especially if you have more complex questions later.

-- 
   -- Howard Chu
   Chief Architect, Symas Corp.  http://www.symas.com
   Director, Highland Sun        http://highlandsun.com/hyc
   OpenLDAP Core Team            http://www.openldap.org/project/