Increasing memory usage on successive LMDB reads

To: openldap-technical@openldap.org

Subject: Increasing memory usage on successive LMDB reads

From: Rohit Girdhar <rohit.iiith@gmail.com>

Date: Thu, 23 Jul 2015 15:24:10 -0400

Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=cMxcZ50p1Xj+mmq6k9RfMuiXQLvS2PmcPOVk8RbusDo=; b=N8VG40znJxHjqDu9Fc/4uI45/61zNjAbCf1V8Sj44ZSUGFUvv0fDgP+9JK4yfTmINH zLj90g/2bvDDAXhk3lir883yfWo7qQBs9R408ZBpon6JaxFqOF/ZYKirl/IdzbEVy3Gp Hc/WXsKxxd+iF4VWnP9IYHKs2i53q2gn+CuZYEOci126ILw1o9EyRoTKecT41GBVpilc 65sUUOZfAlM8LoLEZpTDRIfUKLwtk16wN40c/88oE0/WR+GtB8oqXVg14+kWwrLHg4tL aCoFLdp1Nd32N/QdSkscRiw1XxEsa9G7N45A57KHKw3Y1NjP7H7xz6VuXA+IXBb4FMn7 1/Aw==

I'm using LMDB (original C interface) to store and read some data. However, I notice that my resident memory usage (RES in `htop`) keeps rising with each call to mdb_get with unique keys. It does not change if I do a repeated call to mdb_get with a key I've used before.

It looks like mdb_get is caching the reads, but I want to make sure what effect it is really having on my system. Is there some way to limit the amount of memory lmdb can use for this? Or is it something strange and should not be happening?

Thanks

Rohit