[Date Prev][Date Next] [Chronological] [Thread] [Top]

slapd shutdown during load test (ITS#3295)



Full_Name: Ashish Gawarikar
Version: 2.1.30
OS: Solaris 9
URL: ftp://ftp.openldap.org/incoming/
Submission from: (NULL) (63.211.143.38)


Test steps, 

1) test machine running CDS 1.7 (openldap 2.1.30 DB 4.2.52 patch 2) has 4 x 450
MHz, 1024M RAM.
2) the test script queries against slapd at the rate ~200 queries/second. After
~~385930 successful queries, slapd died.
the log level set in slapd.conf file is 256. Only thing logged in syslog file
is,

......
Aug 10 18:52:55 testmachine slapd[6606]: [ID 542995 local4.debug] slapd
shutdown: waiting for 2 threads to terminate
Aug 10 18:52:55 testmachine slapd[6606]: [ID 952275 local4.debug] conn=385934
fd=22 closed
Aug 10 18:52:55 testmachine slapd[6606]: [ID 952275 local4.debug] conn=385931
fd=16 closed
Aug 10 18:52:55 testmachine slapd[6606]: [ID 486161 local4.debug] slapd
stopped.


3) can't find core file.
4) extra information about the test machine before slapd died, the following was
recorded from a earlier run,
recorded data every 2 mins for slapd process size (using ps -eo vsz), vmstat,
open files for slapd (using lsof command).

Mon Aug  9 15:10:00 PDT 2004
===========================================
3:10pm  up 2 day(s),  3:28,  2 users,  load average: 2.74, 2.94, 2.75
26281 slapd                                        107120 (VSZ)

kthr      memory            page            disk          faults      cpu
r b w   swap  free  re  mf pi po fr de sr s0 s1 s6 --   in   sy   cs us sy id
0 0 0 1331840 810152 3  29  1  0  0  0  0  1  0  0  0  797 1258  807  1  1 98
1 0 0 1221136 777288 0   7  0  0  0  0  0  1  0  0  0 2758 21075 9736 10 12 79

open files for slapd pid 26281:  19


Mon Aug  9 15:12:03 PDT 2004
===========================================
3:12pm  up 2 day(s),  3:30,  2 users,  load average: 1.52, 2.42, 2.58
26281 slapd                                        123632

kthr      memory            page            disk          faults      cpu
r b w   swap  free  re  mf pi po fr de sr s0 s1 s6 --   in   sy   cs us sy id
0 0 0 1331768 810128 3  29  1  0  0  0  0  1  0  0  0  798 1272  813  1  1 98
1 0 0 1204520 776032 0   7  0  0  0  0  0 39  0  0  0 3105 20460 8894 18 9 73

open files for pid 26281:  19

Mon Aug  9 15:14:07 PDT 2004
===========================================
 3:14pm  up 2 day(s),  3:32,  2 users,  load average: 1.42, 2.08, 2.43
26281 slapd                                        123632

kthr      memory            page            disk          faults      cpu
r b w   swap  free  re  mf pi po fr de sr s0 s1 s6 --   in   sy   cs us sy id
0 0 0 1331680 810104 3  29  1  0  0  0  0  1  0  0  0  799 1285  819  1  1 98
0 0 0 1204448 775888 0   7  0  0  0  0  0  1  0  0  0 2750 20936 9712 18 4 78

open files for pid 26281:  20
total handles:  20

PS: I will send you the query script I used for the load test if you need it for
debugging the problem.