[Date Prev][Date Next] [Chronological] [Thread] [Top]

Re: n-way multi master and mirror mode

On 12/04/2016 04:49 PM, Quanah Gibson-Mount wrote:
--On Sunday, December 04, 2016 3:42 PM -0500 Brendan Kearney <bpk678@gmail.com> wrote:
my line of thinking was that if mirror mode was not appropriate for multi 
master replication, then i would remove the setting and eliminate the
item from my list of potential contributing factors.  if mirror mode is
not needed, there are potential efforts and cpu cycles being spent on
doing work that is unnecessary or even detrimental to the performance of
slapd.  i am looking make sure mirror mode is safe to remove from my
configs, so i can test the theory.


Hi Brendan,
Again, Mirror Mode is a concept, not a setting. The setting you refer to, is, as I previously noted, misnamed. Either your servers are configured to do multimaster replication, or they aren't.
The only time /any/ type of replication, whether it is multimaster or provider/consumer, is really going to have an impact is if you have a significant amount of sustained writes happening. So far, it sounds like your traffic is almost entirely reads. 



ReceivedAt SysLogtag        Message
2016-11-15 20:35:05    slapd[1514]:     connection_input: conn=6836
deferring operation: too many executing
2016-11-15 20:35:05    slapd[1514]:     connection_input: conn=6836
deferring operation: pending operations
2016-11-15 20:35:11    slapd[1514]:     connection_input: conn=6836
deferring operation: too many executing
2016-11-15 20:35:11    slapd[1514]:     connection_input: conn=6836
deferring operation: too many executing
2016-11-15 20:35:11    slapd[1514]:     connection_input: conn=6836
deferring operation: too many executing
2016-11-15 20:35:11    slapd[1514]:     connection_input: conn=6836
deferring operation: too many executing
2016-11-15 20:35:11    slapd[1514]:     connection_input: conn=6836
deferring operation: too many executing
2016-11-15 20:35:11    slapd[1514]:     connection_input: conn=6836
deferring operation: too many executing
2016-11-15 20:35:11    slapd[1514]:     connection_input: conn=6836
deferring operation: too many executing
2016-11-15 20:35:11    slapd[1514]:     connection_input: conn=6836
deferring operation: too many executing
2016-11-15 20:35:11    slapd[1514]:     connection_input: conn=6836
deferring operation: too many executing
2016-11-15 20:35:11    slapd[1514]:     connection_input: conn=6836
deferring operation: too many executing
Yes, you'd need stats logging, and it appears that all of those were only deferred for fractions of a second, which is why you see multiple messages per second. So there's not really any indication here of a problem that I can see. 



i am running OpenLDAP: slapd 2.4.44 on fedora 24 using lmdb.




listener threads are the default of 1, and the value is not set.
I was asking about "threads/olcThreads", not the listener threads value. That default is 16. 


Regards,
Quanah

--

Quanah Gibson-Mount
Product Architect
Symas Corporation
Packaged, certified, and supported LDAP solutions powered by OpenLDAP:
<http://www.symas.com>
yes, i seem to be in the trap about the mirror mode misnomer. though ambiguous, your statements indicate that mirror mode the setting is required for n-way multi master replication.
i agree most of my traffic is reads. i have 7 examples of connections with deferred operations. they are all SRCH's (i.e. reads). I seem to misrember the source of the deferred connections. bind-dyndb-ldap does not show in my logs. sssd access is what 6 of 7 examples show. below is one sample. 

ReceivedAt    FromHost    SysLogTag    Message
12/04/16 04:00 PM server1 slapd[5033]: conn=2434 fd=29 ACCEPT from IP=192.168.88.4:59233 (IP=192.168.88.1:389) 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=0 SRCH base="" scope=0 deref=0 filter="(objectClass=*)" 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=0 SRCH attr=* altServer namingContexts supportedControl supportedExtension supportedFeatures supportedLDAPVersion supportedSASLMechanisms domainControllerFunctionality defaultNamingContext lastUSN highestCommittedUSN 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=0 SEARCH RESULT tag=101 err=0 nentries=1 text= 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=1 BIND dn="" method=163 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=1 RESULT tag=97 err=14 text=SASL(0): successful result: 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=2 BIND dn="" method=163 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=2 RESULT tag=97 err=14 text=SASL(0): successful result: 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=3 BIND dn="" method=163 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=3 BIND authcid="host/hypervisor.bpk2.com@BPK2.COM" authzid="host/hypervisor.bpk2.com@BPK2.COM" 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=3 BIND dn="cn=hypervisor,ou=computers,dc=bpk2,dc=com" mech=GSSAPI sasl_ssf=56 ssf=56 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=3 RESULT tag=97 err=0 text= 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=4 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=4 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=8 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=8 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=9 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=9 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=10 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=10 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=6 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=6 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=7 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=7 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=5 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=5 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:00 PM server1 slapd[5033]: connection_input: conn=2434 deferring operation: too many executing 12/04/16 04:00 PM server1 slapd[5033]: connection_input: conn=2434 deferring operation: too many executing 12/04/16 04:00 PM server1 slapd[5033]: connection_input: conn=2434 deferring operation: too many executing 12/04/16 04:00 PM server1 slapd[5033]: connection_input: conn=2434 deferring operation: too many executing 12/04/16 04:00 PM server1 slapd[5033]: connection_input: conn=2434 deferring operation: too many executing 12/04/16 04:00 PM server1 slapd[5033]: connection_input: conn=2434 deferring operation: too many executing 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=11 ABANDON msg=5 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=12 ABANDON msg=6 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=13 ABANDON msg=7 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=14 ABANDON msg=8 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=15 ABANDON msg=9 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=16 ABANDON msg=10 12/04/16 04:00 PM server1 slapd[5033]: conn=2434 op=17 ABANDON msg=11 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=19 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=18 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=18 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=19 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=20 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=20 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=21 ABANDON msg=19 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=22 ABANDON msg=20 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=23 ABANDON msg=21 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=24 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=24 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=26 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=26 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=27 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=27 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=25 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=25 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=28 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:03 PM server1 slapd[5033]: conn=2434 op=28 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:03 PM server1 slapd[5033]: connection_input: conn=2434 deferring operation: too many executing 12/04/16 04:03 PM server1 slapd[5033]: connection_input: conn=2434 deferring operation: too many executing 12/04/16 04:03 PM server1 slapd[5033]: connection_input: conn=2434 deferring operation: too many executing 12/04/16 04:03 PM server1 slapd[5033]: connection_input: conn=2434 deferring operation: too many executing 12/04/16 04:03 PM server1 slapd[5033]: connection_input: conn=2434 deferring operation: too many executing 12/04/16 04:03 PM server1 slapd[5033]: connection_input: conn=2434 deferring operation: too many executing 12/04/16 04:03 PM server1 slapd[5033]: connection_input: conn=2434 deferring operation: too many executing 12/04/16 04:04 PM server1 slapd[5033]: conn=2434 op=29 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:04 PM server1 slapd[5033]: conn=2434 op=29 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:04 PM server1 slapd[5033]: conn=2434 op=30 ABANDON msg=25 12/04/16 04:04 PM server1 slapd[5033]: conn=2434 op=31 ABANDON msg=26 12/04/16 04:04 PM server1 slapd[5033]: conn=2434 op=32 ABANDON msg=27 12/04/16 04:04 PM server1 slapd[5033]: conn=2434 op=33 ABANDON msg=28 12/04/16 04:04 PM server1 slapd[5033]: conn=2434 op=34 ABANDON msg=29 12/04/16 04:04 PM server1 slapd[5033]: conn=2434 op=35 ABANDON msg=30 12/04/16 04:04 PM server1 slapd[5033]: conn=2434 op=36 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:04 PM server1 slapd[5033]: conn=2434 op=36 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:04 PM server1 slapd[5033]: conn=2434 op=37 ABANDON msg=37 12/04/16 04:07 PM server1 slapd[5033]: conn=2434 op=38 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:07 PM server1 slapd[5033]: conn=2434 op=38 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:07 PM server1 slapd[5033]: conn=2434 op=39 ABANDON msg=39 12/04/16 04:12 PM server1 slapd[5033]: conn=2434 op=40 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:12 PM server1 slapd[5033]: conn=2434 op=41 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:12 PM server1 slapd[5033]: conn=2434 op=41 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:12 PM server1 slapd[5033]: conn=2434 op=40 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:12 PM server1 slapd[5033]: conn=2434 op=42 SRCH base="ou=SUDO Groups,ou=Roles,dc=bpk2,dc=com" scope=2 deref=0 filter="(&(objectClass=sudoRole)(modifyTimestamp>=20150104230653Z)(!(modifyTimestamp=20150104230653Z)))" 12/04/16 04:12 PM server1 slapd[5033]: conn=2434 op=42 SRCH attr=objectClass cn sudoCommand sudoHost sudoUser sudoOption sudoRunAs sudoRunAsUser sudoRunAsGroup sudoNotBefore sudoNotAfter sudoOrder modifyTimestamp 12/04/16 04:12 PM server1 slapd[5033]: conn=2434 op=43 ABANDON msg=41 12/04/16 04:12 PM server1 slapd[5033]: conn=2434 op=44 ABANDON msg=42 12/04/16 04:12 PM server1 slapd[5033]: conn=2434 op=45 ABANDON msg=43 
12/04/16 04:15 PM    server1    slapd[5033]:     conn=2434 op=46 UNBIND
12/04/16 04:15 PM    server1    slapd[5033]:     conn=2434 fd=29 closed