Antw: Re: Slow to add 1 million items

["Ulrich Windl" <Ulrich.Windl@rz.uni-regensburg.de>]

>>> Andrew Eross <eross@locatrix.com> schrieb am 05.02.2014 um 16:30 in Nachricht
<CAL_tfFf2qW5BcT=Xs4uFOSUO=wL0AN=9CyfS+D-XYPLitMZ_aw@mail.gmail.com>:
> Hi Quanah,
> 
> Ubuntu 10.04 LTS
> Linux 2.6.32-43-generic-pae #97-Ubuntu SMP Wed Sep 5 16:59:17 UTC 2012 i686
> GNU/Linux
> The latest OpenLDAP 2.4.39
> All of those tests done with the mdb backend, of course, and the actual
> file system is ext4

Did you try btrfs? I'd guess it could be faster for massive random writes.

> 
> It's a fairly stock 10.04 system, no special config/kernel changes.
> 
> Cheers,
> Andrew
> 
> Andrew Eross
> CTO
> Locatrix Communications
> Office: +61 7 3123 1469
> Mobile: +55 37 9858 9815
> eross@locatrix.com 
> 
> 
> On Wed, Feb 5, 2014 at 1:26 PM, Quanah Gibson-Mount <quanah@zimbra.com>wrote:
> 
>> --On Tuesday, February 04, 2014 6:52 PM -0200 Andrew Eross <
>> eross@locatrix.com> wrote:
>>
>>
>>>
>>> Thanks, Dieter, Quanah.
>>>
>>>
>>> I've been doing some experimenting with those mdb options.
>>>
>>>
>>> I ran a few tests with inserting 10,000 records, wiping the DB in
>>> between, and changing just the one option at a time:
>>>
>>>
>>> Base-line, no extra options: 4m8sWith "writemap" enabled: 8m55s
>>>
>>> With "writemap+mapasync" enabled: 5m12s
>>> With "dbnosync+checkpoint 0kb/1min": 0m14s
>>>
>>
>> I know you answered some of this before, but please update with:
>>
>> What kernel?
>> What OpenLDAP version?
>> What Ubuntu release?
>> What filesystem for the LDAP DB?
>>
>> Thanks,
>>
>> Quanah
>>
>>
>> --
>>
>> Quanah Gibson-Mount
>> Architect - Server
>> Zimbra, Inc.
>> --------------------
>> Zimbra ::  the leader in open source messaging and collaboration
>>