Re: SyncREPL Behaves Inconsistently (ITS#3262)

[adam@morrison-ind.com]

> I've tested with a similar setup but could not observe the same behavior.
> After loading the master and replica databases in the same manner,
> additional adds and modifies were performed at the master. Both of the
> operations were replicated to two replicas as expected. I'm wondering
> whether you can send me the debug output at the master and replicas. 

What would be the optimal debug level?  I checked the man page and there
isn't a log level specific to replication operations,  I tried dumping
"everything" (4095) and it seems like an awful lot.

> It will
> significantly reduce the debug time. If it is not possible to send all the
> log, can you send me that part of the log files which were generated when
> you performed modifications to the morrisoninternalrate attribute ?

No problem.

BTW, one consumer has 'suddenly' become reliable, at least for the last
+24 hours.  We made no changes to its config but we did restart it
several times.  The other consumers still exhibit the same behaviour of
only updating at startup.

------------------------
Sardine just brought online, throw & hoopoe aleardy out of sync.

throw:~ # echo "Master (littleboy, rh9):";ldapsearch -LLL -x -h
littleboy uid=adam morrisoninternalrate;echo "Consumer (turnstone,
rh9):";ldapsearch -LLL -x -h turnstone uid=adam
morrisoninternalrate;echo "Consumer (throw, suse91)";ldapsearch -LLL -x
-h throw uid=adam morrisoninternalrate;echo "Consumer (sardine,
rh9)";ldapsearch -LLL -x -h sardine uid=adam morrisoninternalrate;echo
"Consumer (hoopoe, rh9)";ldapsearch -LLL -x -h hoopoe uid=adam
morrisoninternalrate
Master (littleboy, rh9):
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate: 15
Consumer (turnstone, rh9):
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate: 15
Consumer (throw, suse91)
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate: 67
Consumer (sardine, rh9)
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate: 15
Consumer (hoopoe, rh9)
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate: 12

Restarted throw & hoopoe, now all in sync....

throw:~ # echo "Master (littleboy, rh9):";ldapsearch -LLL -x -h
littleboy uid=adam morrisoninternalrate;echo "Consumer (turnstone,
rh9):";ldapsearch -LLL -x -h turnstone uid=adam
morrisoninternalrate;echo "Consumer (throw, suse91)";ldapsearch -LLL -x
-h throw uid=adam morrisoninternalrate;echo "Consumer (sardine,
rh9)";ldapsearch -LLL -x -h sardine uid=adam morrisoninternalrate;echo
"Consumer (hoopoe, rh9)";ldapsearch -LLL -x -h hoopoe uid=adam
morrisoninternalrate
Master (littleboy, rh9):
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate:
15                                                                             
Consumer (turnstone, rh9):
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate:
15                                                        
Consumer (throw, suse91)
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate:
15                                                        
Consumer (sardine, rh9)
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate:
15                                                        
Consumer (hoopoe, rh9)
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate: 15

Changed value on master (littleboy),  only one consumer tracked the
change.

throw:~ # echo "Master (littleboy, rh9):";ldapsearch -LLL -x -h
littleboy uid=adam morrisoninternalrate;echo "Consumer (turnstone,
rh9):";ldapsearch -LLL -x -h turnstone uid=adam
morrisoninternalrate;echo "Consumer (throw, suse91)";ldapsearch -LLL -x
-h throw uid=adam morrisoninternalrate;echo "Consumer (sardine,
rh9)";ldapsearch -LLL -x -h sardine uid=adam morrisoninternalrate;echo
"Consumer (hoopoe, rh9)";ldapsearch -LLL -x -h hoopoe uid=adam
morrisoninternalrate
Master (littleboy, rh9):
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate: 16
Consumer (turnstone, rh9):
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate: 16
Consumer (throw, suse91)
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate: 15
Consumer (sardine, rh9)
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate: 15
Consumer (hoopoe, rh9)
dn: cn=Adam Williams,ou=People,o=Morrison Industries,c=US
morrisoninternalrate: 15

That consumer has proved reliable for +24 hours now,  not certain what
changed to keep it in sync.  None of the other sync beyond the initial
start-up phase.