[Date Prev][Date Next] [Chronological] [Thread] [Top]

Re: Strange hang scenario, resumes after idletimeout, but plenty of FDs available

To: Howard Chu <hyc@symas.com>
Subject: Re: Strange hang scenario, resumes after idletimeout, but plenty of FDs available
From: Kartik Subbarao <subbarao@computer.org>
Date: Thu, 02 Jun 2011 09:20:18 -0400
Cc: openldap-technical@openldap.org
In-reply-to: <4DE67EB9.6000704@symas.com>
References: <4DE633E1.4090508@computer.org> <4DE639E3.1090302@computer.org> <4DE66688.6080600@computer.org> <4DE67EB9.6000704@symas.com>
User-agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.17) Gecko/20110428 Fedora/3.1.10-1.fc14 Thunderbird/3.1.10

On 06/01/2011 02:02 PM, Howard Chu wrote:

Kartik Subbarao wrote:

On 06/01/2011 09:08 AM, Kartik Subbarao wrote:

Update: It's not a locks issue.


Another update -- after I reduced the idletimeout to 60 seconds, the
problem seems to have gone away. It would still be useful to know what
might be causing this problem and to be able to support higher levels of
idletimeout, but at least I have another workable option now.


As usual, when investigating a hang, you should attach to slapd with gdb
and get a snapshot of what all the threads are doing. Working around it
before you know what caused it isn't all that useful in the long run.

Attached is the gdb stack trace from the hang state. It looks like thethe threads are stuck in pthread_cond_wait() from send_ldap_ber(). Arethere other relevant variables/structures to inspect for this scenario?


	-Kartik

GNU gdb 6.8-debian
Copyright (C) 2008 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu"...
(gdb) attach 28127
Attaching to program: /usr/sbin/slapd, process 28127
Reading symbols from /usr/lib/libldap_r-2.4.so.2...done.
Loaded symbols for /usr/lib/libldap_r-2.4.so.2
Reading symbols from /usr/lib/liblber-2.4.so.2...done.
Loaded symbols for /usr/lib/liblber-2.4.so.2
Reading symbols from /lib/libuuid.so.1...done.
Loaded symbols for /lib/libuuid.so.1
Reading symbols from /usr/lib/libdb-4.8.so...done.
Loaded symbols for /usr/lib/libdb-4.8.so
Reading symbols from /usr/lib/libodbc.so.1...done.
Loaded symbols for /usr/lib/libodbc.so.1
Reading symbols from /usr/lib/libslp.so.1...done.
Loaded symbols for /usr/lib/libslp.so.1
Reading symbols from /usr/lib/libsasl2.so.2...done.
Loaded symbols for /usr/lib/libsasl2.so.2
Reading symbols from /usr/lib/libssl.so.0.9.8...done.
Loaded symbols for /usr/lib/libssl.so.0.9.8
Reading symbols from /usr/lib/libcrypto.so.0.9.8...done.
Loaded symbols for /usr/lib/libcrypto.so.0.9.8
Reading symbols from /lib/libcrypt.so.1...done.
Loaded symbols for /lib/libcrypt.so.1
Reading symbols from /lib/libresolv.so.2...done.
Loaded symbols for /lib/libresolv.so.2
Reading symbols from /usr/lib/libltdl.so.3...done.
Loaded symbols for /usr/lib/libltdl.so.3
Reading symbols from /lib/libwrap.so.0...done.
Loaded symbols for /lib/libwrap.so.0
Reading symbols from /lib/libpthread.so.0...done.
[Thread debugging using libthread_db enabled]
[New Thread 0x7ff0899cb730 (LWP 28127)]
[New Thread 0x492ab950 (LWP 28155)]
[New Thread 0x48aaa950 (LWP 28154)]
[New Thread 0x482a9950 (LWP 28153)]
[New Thread 0x47aa8950 (LWP 28152)]
[New Thread 0x472a7950 (LWP 28151)]
[New Thread 0x46aa6950 (LWP 28150)]
[New Thread 0x462a5950 (LWP 28149)]
[New Thread 0x45aa4950 (LWP 28148)]
[New Thread 0x452a3950 (LWP 28147)]
[New Thread 0x44aa2950 (LWP 28146)]
[New Thread 0x442a1950 (LWP 28145)]
[New Thread 0x43aa0950 (LWP 28139)]
[New Thread 0x4329f950 (LWP 28138)]
[New Thread 0x42a9e950 (LWP 28137)]
[New Thread 0x40aea950 (LWP 28135)]
[New Thread 0x4154d950 (LWP 28134)]
[New Thread 0x4229d950 (LWP 28133)]
Loaded symbols for /lib/libpthread.so.0
Reading symbols from /lib/libc.so.6...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/ld-linux-x86-64.so.2...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib/libnsl.so.1...done.
Loaded symbols for /lib/libnsl.so.1
Reading symbols from /lib/libdl.so.2...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /usr/lib/libz.so.1...done.
Loaded symbols for /usr/lib/libz.so.1
Reading symbols from /lib/libnss_files.so.2...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /lib/libnss_ldap.so.2...done.
Loaded symbols for /lib/libnss_ldap.so.2
Reading symbols from /usr/lib/sasl2/libanonymous.so.2...done.
Loaded symbols for /usr/lib/sasl2/libanonymous.so.2
Reading symbols from /usr/lib/sasl2/libplain.so.2...done.
Loaded symbols for /usr/lib/sasl2/libplain.so.2
Reading symbols from /usr/lib/sasl2/libntlm.so.2...done.
Loaded symbols for /usr/lib/sasl2/libntlm.so.2
Reading symbols from /usr/lib/sasl2/libgssapiv2.so.2...done.
Loaded symbols for /usr/lib/sasl2/libgssapiv2.so.2
Reading symbols from /usr/lib/libgssapi.so.2...done.
Loaded symbols for /usr/lib/libgssapi.so.2
Reading symbols from /usr/lib/libkrb5.so.25...done.
Loaded symbols for /usr/lib/libkrb5.so.25
Reading symbols from /usr/lib/libasn1.so.8...done.
Loaded symbols for /usr/lib/libasn1.so.8
Reading symbols from /usr/lib/libroken.so.18...done.
Loaded symbols for /usr/lib/libroken.so.18
Reading symbols from /lib/libcom_err.so.2...done.
Loaded symbols for /lib/libcom_err.so.2
Reading symbols from /usr/lib/libheimntlm.so.0...done.
Loaded symbols for /usr/lib/libheimntlm.so.0
Reading symbols from /usr/lib/libhx509.so.3...done.
Loaded symbols for /usr/lib/libhx509.so.3
Reading symbols from /usr/lib/libwind.so.0...done.
Loaded symbols for /usr/lib/libwind.so.0
Reading symbols from /usr/lib/sasl2/libcrammd5.so.2...done.
Loaded symbols for /usr/lib/sasl2/libcrammd5.so.2
Reading symbols from /usr/lib/sasl2/liblogin.so.2...done.
Loaded symbols for /usr/lib/sasl2/liblogin.so.2
Reading symbols from /usr/lib/sasl2/libsasldb.so.2...done.
Loaded symbols for /usr/lib/sasl2/libsasldb.so.2
Reading symbols from /usr/lib/libdb-4.6.so...done.
Loaded symbols for /usr/lib/libdb-4.6.so
Reading symbols from /usr/lib/sasl2/libdigestmd5.so.2...done.
Loaded symbols for /usr/lib/sasl2/libdigestmd5.so.2
Reading symbols from /usr/lib/ldap/back_hdb-2.4.so.2...Reading symbols from /usr/lib/debug/usr/lib/ldap/back_hdb-2.4.so.2.7.0...done.
done.
Loaded symbols for /usr/lib/ldap/back_hdb-2.4.so.2
Reading symbols from /usr/lib/ldap/back_ldap-2.4.so.2...Reading symbols from /usr/lib/debug/usr/lib/ldap/back_ldap-2.4.so.2.7.0...done.
done.
Loaded symbols for /usr/lib/ldap/back_ldap-2.4.so.2
Reading symbols from /usr/lib/ldap/back_monitor-2.4.so.2...Reading symbols from /usr/lib/debug/usr/lib/ldap/back_monitor-2.4.so.2.7.0...done.
done.
Loaded symbols for /usr/lib/ldap/back_monitor-2.4.so.2
Reading symbols from /usr/lib/ldap/auditlog-2.4.so.2...Reading symbols from /usr/lib/debug/usr/lib/ldap/auditlog-2.4.so.2.7.0...done.
done.
Loaded symbols for /usr/lib/ldap/auditlog-2.4.so.2
Reading symbols from /usr/lib/ldap/memberof-2.4.so.2...Reading symbols from /usr/lib/debug/usr/lib/ldap/memberof-2.4.so.2.7.0...done.
done.
Loaded symbols for /usr/lib/ldap/memberof-2.4.so.2
Reading symbols from /usr/lib/ldap/dynlist-2.4.so.2...Reading symbols from /usr/lib/debug/usr/lib/ldap/dynlist-2.4.so.2.7.0...done.
done.
Loaded symbols for /usr/lib/ldap/dynlist-2.4.so.2
Reading symbols from /usr/lib/ldap/ppolicy-2.4.so.2...Reading symbols from /usr/lib/debug/usr/lib/ldap/ppolicy-2.4.so.2.7.0...done.
done.
Loaded symbols for /usr/lib/ldap/ppolicy-2.4.so.2
Reading symbols from /usr/lib/ldap/accesslog-2.4.so.2...Reading symbols from /usr/lib/debug/usr/lib/ldap/accesslog-2.4.so.2.7.0...done.
done.
Loaded symbols for /usr/lib/ldap/accesslog-2.4.so.2
Reading symbols from /lib/libnss_dns.so.2...done.
Loaded symbols for /lib/libnss_dns.so.2
0x00007ff0876fa715 in pthread_join () from /lib/libpthread.so.0
(gdb) thread apply all backtrace

Thread 18 (Thread 0x4229d950 (LWP 28133)):
#0  0x00007ff08746fc18 in epoll_wait () from /lib/libc.so.6
#1  0x0000000000431584 in slapd_daemon_task (ptr=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/daemon.c:2528
#2  0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#3  0x00007ff08746f64d in clone () from /lib/libc.so.6
#4  0x0000000000000000 in ?? ()

Thread 17 (Thread 0x4154d950 (LWP 28134)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x413cb1a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x7ff0500017d0, 
    rs=0x4154cc50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x7ff0500017d0, rs=0x4154cc50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x7ff0500017d0, rs=0x4154cc50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x7ff0500017d0, rs=0x0, 
    which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x7ff0500017d0, rs=0x4154cc50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x7ff0500017d0, rs=0x4154cc50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x7ff0500017d0, rs=0x0, 
    which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x7ff0500017d0, rs=0x4154cc50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x4154cdb0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x4154cdb0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 16 (Thread 0x40aea950 (LWP 28135)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x409681a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x44e03f0, rs=0x40ae9c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x44e03f0, rs=0x40ae9c50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x44e03f0, rs=0x40ae9c50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x44e03f0, rs=0x0, which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x44e03f0, rs=0x40ae9c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x44e03f0, rs=0x40ae9c50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x44e03f0, rs=0x0, which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x44e03f0, rs=0x40ae9c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x40ae9db0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x40ae9db0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 15 (Thread 0x42a9e950 (LWP 28137)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x4291c1a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x7ff061b5b0f0, 
    rs=0x42a9dc50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x7ff061b5b0f0, rs=0x42a9dc50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x7ff061b5b0f0, rs=0x42a9dc50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x7ff061b5b0f0, rs=0x0, 
    which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x7ff061b5b0f0, rs=0x42a9dc50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x7ff061b5b0f0, rs=0x42a9dc50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x7ff061b5b0f0, rs=0x0, 
    which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x7ff061b5b0f0, rs=0x42a9dc50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x42a9ddb0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x42a9ddb0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 14 (Thread 0x4329f950 (LWP 28138)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x4311d1a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x3a7e9f0, rs=0x4329ec50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x3a7e9f0, rs=0x4329ec50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x3a7e9f0, rs=0x4329ec50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x3a7e9f0, rs=0x0, which=op_modrdn)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x3a7e9f0, rs=0x4329ec50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x3a7e9f0, rs=0x4329ec50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x3a7e9f0, rs=0x0, which=op_modrdn)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x3a7e9f0, rs=0x4329ec50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x4329edb0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x4329edb0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 13 (Thread 0x43aa0950 (LWP 28139)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x4391e1a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x2dd57d0, rs=0x43a9fc50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x2dd57d0, rs=0x43a9fc50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x2dd57d0, rs=0x43a9fc50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x2dd57d0, rs=0x0, which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x2dd57d0, rs=0x43a9fc50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x2dd57d0, rs=0x43a9fc50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x2dd57d0, rs=0x0, which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x2dd57d0, rs=0x43a9fc50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x43a9fdb0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x43a9fdb0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 12 (Thread 0x442a1950 (LWP 28145)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x4411f1a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x46a6730, rs=0x442a0c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x46a6730, rs=0x442a0c50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x46a6730, rs=0x442a0c50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x46a6730, rs=0x0, which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x46a6730, rs=0x442a0c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x46a6730, rs=0x442a0c50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x46a6730, rs=0x0, which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x46a6730, rs=0x442a0c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x442a0db0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x442a0db0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 11 (Thread 0x44aa2950 (LWP 28146)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x449201a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x7ff06901b060, 
    rs=0x44aa1c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x7ff06901b060, rs=0x44aa1c50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x7ff06901b060, rs=0x44aa1c50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x7ff06901b060, rs=0x0, 
    which=op_modrdn)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x7ff06901b060, rs=0x44aa1c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x7ff06901b060, rs=0x44aa1c50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x7ff06901b060, rs=0x0, 
    which=op_modrdn)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x7ff06901b060, rs=0x44aa1c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x44aa1db0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x44aa1db0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 10 (Thread 0x452a3950 (LWP 28147)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x451211a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x7ff06009da20, 
    rs=0x452a2c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x7ff06009da20, rs=0x452a2c50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x7ff06009da20, rs=0x452a2c50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x7ff06009da20, rs=0x0, 
    which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x7ff06009da20, rs=0x452a2c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x7ff06009da20, rs=0x452a2c50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x7ff06009da20, rs=0x0, 
    which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x7ff06009da20, rs=0x452a2c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x452a2db0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x452a2db0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 9 (Thread 0x45aa4950 (LWP 28148)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x459221a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x7ff061fd4e00, 
    rs=0x45aa3c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x7ff061fd4e00, rs=0x45aa3c50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x7ff061fd4e00, rs=0x45aa3c50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x7ff061fd4e00, rs=0x0, 
    which=op_compare)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x7ff061fd4e00, rs=0x45aa3c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x7ff061fd4e00, rs=0x45aa3c50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x7ff061fd4e00, rs=0x0, 
    which=op_compare)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x7ff061fd4e00, rs=0x45aa3c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x45aa3db0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x45aa3db0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 8 (Thread 0x462a5950 (LWP 28149)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x461231a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x4643b20, rs=0x462a4c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x4643b20, rs=0x462a4c50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x4643b20, rs=0x462a4c50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x4643b20, rs=0x0, which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x4643b20, rs=0x462a4c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x4643b20, rs=0x462a4c50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x4643b20, rs=0x0, which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x4643b20, rs=0x462a4c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x462a4db0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x462a4db0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 7 (Thread 0x46aa6950 (LWP 28150)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x469241a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x7ff06917c8d0, 
    rs=0x46aa5c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x7ff06917c8d0, rs=0x46aa5c50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x7ff06917c8d0, rs=0x46aa5c50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x7ff06917c8d0, rs=0x0, 
    which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x7ff06917c8d0, rs=0x46aa5c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x7ff06917c8d0, rs=0x46aa5c50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x7ff06917c8d0, rs=0x0, 
    which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x7ff06917c8d0, rs=0x46aa5c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x46aa5db0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x46aa5db0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 6 (Thread 0x472a7950 (LWP 28151)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x471251a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x44b60e0, rs=0x472a6c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x44b60e0, rs=0x472a6c50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x44b60e0, rs=0x472a6c50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x44b60e0, rs=0x0, which=op_compare)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x44b60e0, rs=0x472a6c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x44b60e0, rs=0x472a6c50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x44b60e0, rs=0x0, which=op_compare)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x44b60e0, rs=0x472a6c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x472a6db0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x472a6db0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 5 (Thread 0x47aa8950 (LWP 28152)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x479261a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x7ff062312d80, 
    rs=0x47aa7c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x7ff062312d80, rs=0x47aa7c50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x7ff062312d80, rs=0x47aa7c50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x7ff062312d80, rs=0x0, 
    which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x7ff062312d80, rs=0x47aa7c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x7ff062312d80, rs=0x47aa7c50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x7ff062312d80, rs=0x0, 
    which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x7ff062312d80, rs=0x47aa7c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x47aa7db0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x47aa7db0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 4 (Thread 0x482a9950 (LWP 28153)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x481271a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x440ed50, rs=0x482a8c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x440ed50, rs=0x482a8c50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x440ed50, rs=0x482a8c50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x440ed50, rs=0x0, which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x440ed50, rs=0x482a8c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x440ed50, rs=0x482a8c50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x440ed50, rs=0x0, which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x440ed50, rs=0x482a8c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x482a8db0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x482a8db0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 3 (Thread 0x48aaa950 (LWP 28154)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x489281a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x7ff06901a4f0, 
    rs=0x48aa9c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x7ff06901a4f0, rs=0x48aa9c50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x7ff06901a4f0, rs=0x48aa9c50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x7ff06901a4f0, rs=0x0, 
    which=op_compare)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x7ff06901a4f0, rs=0x48aa9c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x7ff06901a4f0, rs=0x48aa9c50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x7ff06901a4f0, rs=0x0, 
    which=op_compare)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x7ff06901a4f0, rs=0x48aa9c50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x48aa9db0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x48aa9db0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 2 (Thread 0x492ab950 (LWP 28155)):
#0  0x00007ff0876fdd29 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/libpthread.so.0
#1  0x0000000000444605 in send_ldap_ber (op=<value optimized out>, 
    ber=0x491291a0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:372
#2  0x0000000000447556 in slap_send_search_entry (op=0x495a3a0, rs=0x492aac50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/result.c:1410
#3  0x00007ff08419255e in hdb_search (op=0x495a3a0, rs=0x492aac50)
    at search.c:962
#4  0x000000000049bc87 in overlay_op_walk (op=0x495a3a0, rs=0x492aac50, 
    which=op_search, oi=0x20d81b0, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#5  0x000000000049c6f0 in over_op_func (op=0x495a3a0, rs=0x0, which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#6  0x00000000004368a1 in fe_op_search (op=0x495a3a0, rs=0x492aac50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:372
#7  0x000000000049bc87 in overlay_op_walk (op=0x495a3a0, rs=0x492aac50, 
    which=op_search, oi=0x20d3560, on=0x0)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:669
#8  0x000000000049c6f0 in over_op_func (op=0x495a3a0, rs=0x0, which=op_unbind)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/backover.c:721
#9  0x00000000004370ac in do_search (op=0x495a3a0, rs=0x492aac50)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/search.c:217
#10 0x00000000004342af in connection_operation (ctx=0x492aadb0, 
    arg_v=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1113
#11 0x0000000000434ea5 in connection_read_thread (ctx=0x492aadb0, 
    argv=<value optimized out>)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/connection.c:1249
#12 0x00007ff0895815e0 in ?? () from /usr/lib/libldap_r-2.4.so.2
#13 0x00007ff0876f9fc7 in start_thread () from /lib/libpthread.so.0
#14 0x00007ff08746f64d in clone () from /lib/libc.so.6
#15 0x0000000000000000 in ?? ()

Thread 1 (Thread 0x7ff0899cb730 (LWP 28127)):
#0  0x00007ff0876fa715 in pthread_join () from /lib/libpthread.so.0
#1  0x000000000042e472 in slapd_daemon ()
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/daemon.c:2922
#2  0x000000000041b0b9 in main (argc=9, argv=0x7fff4208ceb8)
    at /home/ksubbarao/openldap-2.4.25/servers/slapd/main.c:1012
#0  0x00007ff0876fa715 in pthread_join () from /lib/libpthread.so.0
(gdb)

Follow-Ups:
- Re: Strange hang scenario, resumes after idletimeout, but plenty of FDs available
  - From: Kartik Subbarao <subbarao@computer.org>
- Re: Strange hang scenario, resumes after idletimeout, but plenty of FDs available
  - From: Howard Chu <hyc@symas.com>

References:
- Strange hang scenario, resumes after idletimeout, but plenty of FDs available
  - From: Kartik Subbarao <subbarao@computer.org>
- Re: Strange hang scenario, resumes after idletimeout, but plenty of FDs available
  - From: Kartik Subbarao <subbarao@computer.org>
- Re: Strange hang scenario, resumes after idletimeout, but plenty of FDs available
  - From: Kartik Subbarao <subbarao@computer.org>
- Re: Strange hang scenario, resumes after idletimeout, but plenty of FDs available
  - From: Howard Chu <hyc@symas.com>

Prev by Date: Re: Combining dynlist + memberOf overlay?
Next by Date: Re: Strange hang scenario, resumes after idletimeout, but plenty of FDs available
Index(es):
- Chronological
- Thread