Thanks Mark,
So this example is a user password change
using kinit, the password has been changed on freeipa02 but not
then replicated to the others. This happens for other records,
but I don't have examples of these at the moment.
As far as I'm aware, there is no fractal
replication set up.
Freeipa01:
# dynamic-kepler, users, accounts, ipa.example.com
dn:
uid=dynamic-kepler,cn=users,cn=accounts,dc=ipa,dc=example,dc=com
uid: dynamic-kepler
krbLastPwdChange: 20170608170011Z
krbPasswordExpiration: 20170608170011Z
Freeipa02:
#
dynamic-kepler, users, accounts, ipa.example.com
dn:
uid=dynamic-kepler,cn=users,cn=accounts,dc=ipa,dc=example,dc=com
uid: dynamic-kepler
krbLastPwdChange: 20170608170021Z
krbPasswordExpiration: 20170906170021Z
Freeipa03:
# dynamic-kepler, users, accounts, ipa.example.com
dn: uid=dynamic-kepler,cn=users,cn=accounts,dc=ipa,dc=example,dc=com
uid: dynamic-kepler
krbLastPwdChange: 20170608170011Z
krbPasswordExpiration: 20170608170011Z
Errors on Freeipa02:
[08/Jun/2017:01:46:50.635529447
+0000] replica_generate_next_csn: opcsn=5938ac8b000500030000
<= basecsn=5938ac8b000500040000, adjusted
opcsn=5938ac8b000600030000
[08/Jun/2017:12:16:46.497249649 +0000]
replica_generate_next_csn: opcsn=5939402f000500030000 <=
basecsn=5939402f000800040000, adjusted
opcsn=5939402f000900030000
[08/Jun/2017:23:38:48.197750001 +0000]
replica_generate_next_csn: opcsn=5939e009000100030000 <=
basecsn=5939e009000f00040000, adjusted
opcsn=5939e009001000030000
The other nodes have no errors from this data.
Access logs:
Freeipa01:
[08/Jun/2017:01:46:50.635529447 +0000]
replica_generate_next_csn: opcsn=5938ac8b000500030000 <=
basecsn=5938ac8b000500040000, adjusted
opcsn=5938ac8b000600030000
[08/Jun/2017:12:16:46.497249649 +0000]
replica_generate_next_csn: opcsn=5939402f000500030000 <=
basecsn=5939402f000800040000, adjusted
opcsn=5939402f000900030000
[08/Jun/2017:23:38:48.197750001 +0000]
replica_generate_next_csn: opcsn=5939e009000100030000 <=
basecsn=5939e009000f00040000, adjusted
opcsn=5939e009001000030000
Freeipa02:
Shows no logs "to" the other 2 nodes.
Freeipa03:
[08/Jun/2017:17:10:06.343697044 +0000] conn=9237
fd=70 slot=70 connection from 192.168.0.12 to 192.168.0.13
[08/Jun/2017:19:54:05.025713675 +0000] conn=9665 fd=70 slot=70
connection from 192.168.0.12 to 192.168.0.13
Freeipa02 replication logging:
[09/Jun/2017:11:24:58.827281135
+0000] NSMMReplicationPlugin - csnplCommitALL: processing data
csn 593964af000900030000
Repeats 800 - 900 time per second with a different csn.
[09/Jun/2017:11:23:35.369961485 +0000]
NSMMReplicationPlugin - conn=25423 op=264360 Acquired consumer
connection extension
[09/Jun/2017:11:23:35.372119530 +0000] NSMMReplicationPlugin -
conn=25423 op=264360 repl="dc=ipa,dc=example,dc=com": Begin
incremental protocol
[09/Jun/2017:11:23:35.373351582 +0000] csngen_adjust_time: gen
state before 593a85370005:1497007413:0:2
[09/Jun/2017:11:23:35.375049196 +0000]
_csngen_adjust_local_time: gen state before
593a85370005:1497007413:0:2
[09/Jun/2017:11:23:35.378561540 +0000]
_csngen_adjust_local_time: gen state after
593a85380000:1497007414:0:2
[09/Jun/2017:11:23:35.379799723 +0000] csngen_adjust_time: gen
state after 593a85380002:1497007414:0:2
[09/Jun/2017:11:23:35.381061072 +0000] NSMMReplicationPlugin -
conn=25423 op=264360 repl="dc=ipa,dc=example,dc=com": Acquired
replica
[09/Jun/2017:11:23:35.383050359 +0000] NSMMReplicationPlugin -
conn=25423 op=264360 repl="dc=ipa,dc=example,dc=com":
StartNSDS90ReplicationRequest: response=0 rc=0
[09/Jun/2017:11:23:35.384410556 +0000] NSMMReplicationPlugin -
conn=25423 op=264360 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:35.401662597 +0000] NSMMReplicationPlugin -
conn=25423 op=264361 Acquired consumer connection extension
[09/Jun/2017:11:23:35.405738547 +0000] NSMMReplicationPlugin -
conn=25423 op=264361 repl="dc=ipa,dc=example,dc=com": Released
replica held by locking_purl=conn=25423 id=264360
[09/Jun/2017:11:23:35.407391362 +0000] NSMMReplicationPlugin -
conn=25423 op=264361 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:35.409022374 +0000] NSMMReplicationPlugin -
conn=25423 op=264362 Acquired consumer connection extension
[09/Jun/2017:11:23:35.410925163 +0000] NSMMReplicationPlugin -
conn=25423 op=264362 repl="dc=ipa,dc=example,dc=com": Begin
incremental protocol
[09/Jun/2017:11:23:35.413478042 +0000] csngen_adjust_time: gen
state before 593a85380002:1497007414:0:2
[09/Jun/2017:11:23:35.414970366 +0000] csngen_adjust_time: gen
state after 593a85380008:1497007414:0:2
[09/Jun/2017:11:23:35.416204493 +0000] NSMMReplicationPlugin -
conn=25423 op=264362 repl="dc=ipa,dc=example,dc=com": Acquired
replica
[09/Jun/2017:11:23:35.417872073 +0000] NSMMReplicationPlugin -
conn=25423 op=264362 repl="dc=ipa,dc=example,dc=com":
StartNSDS90ReplicationRequest: response=0 rc=0
[09/Jun/2017:11:23:35.419084756 +0000] NSMMReplicationPlugin -
conn=25423 op=264362 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:35.425564689 +0000] NSMMReplicationPlugin -
conn=25423 op=264363 Acquired consumer connection extension
[09/Jun/2017:11:23:35.428869588 +0000] NSMMReplicationPlugin -
conn=25423 op=264363 repl="dc=ipa,dc=example,dc=com": Released
replica held by locking_purl=conn=25423 id=264362
[09/Jun/2017:11:23:35.430048781 +0000] NSMMReplicationPlugin -
conn=25423 op=264363 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:35.446697335 +0000] NSMMReplicationPlugin -
conn=25423 op=264364 Acquired consumer connection extension
[09/Jun/2017:11:23:35.449104495 +0000] NSMMReplicationPlugin -
conn=25423 op=264364 repl="dc=ipa,dc=example,dc=com": Begin
incremental protocol
[09/Jun/2017:11:23:35.450352007 +0000] csngen_adjust_time: gen
state before 593a85380008:1497007414:0:2
[09/Jun/2017:11:23:35.451676656 +0000] csngen_adjust_time: gen
state after 593a8538000a:1497007414:0:2
[09/Jun/2017:11:23:35.455589607 +0000] NSMMReplicationPlugin -
conn=25423 op=264364 repl="dc=ipa,dc=example,dc=com": Acquired
replica
[09/Jun/2017:11:23:35.457436037 +0000] NSMMReplicationPlugin -
conn=25423 op=264364 repl="dc=ipa,dc=example,dc=com":
StartNSDS90ReplicationRequest: response=0 rc=0
[09/Jun/2017:11:23:35.458682967 +0000] NSMMReplicationPlugin -
conn=25423 op=264364 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:35.463307540 +0000] NSMMReplicationPlugin -
conn=25423 op=264365 Acquired consumer connection extension
[09/Jun/2017:11:23:35.466539770 +0000] NSMMReplicationPlugin -
conn=25423 op=264365 repl="dc=ipa,dc=example,dc=com": Released
replica held by locking_purl=conn=25423 id=264364
[09/Jun/2017:11:23:35.467923321 +0000] NSMMReplicationPlugin -
conn=25423 op=264365 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:35.616313341 +0000] NSMMReplicationPlugin -
conn=25423 op=264366 Acquired consumer connection extension
[09/Jun/2017:11:23:35.618268832 +0000] NSMMReplicationPlugin -
conn=25423 op=264366 repl="dc=ipa,dc=example,dc=com": Begin
incremental protocol
[09/Jun/2017:11:23:35.619545238 +0000] csngen_adjust_time: gen
state before 593a8538000a:1497007414:0:2
[09/Jun/2017:11:23:35.620724991 +0000] csngen_adjust_time: gen
state after 593a8538000f:1497007414:0:2
[09/Jun/2017:11:23:35.622223896 +0000] NSMMReplicationPlugin -
conn=25423 op=264366 repl="dc=ipa,dc=example,dc=com": Acquired
replica
[09/Jun/2017:11:23:35.624000688 +0000] NSMMReplicationPlugin -
conn=25423 op=264366 repl="dc=ipa,dc=example,dc=com":
StartNSDS90ReplicationRequest: response=0 rc=0
[09/Jun/2017:11:23:35.625239857 +0000] NSMMReplicationPlugin -
conn=25423 op=264366 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:35.632952778 +0000] NSMMReplicationPlugin -
conn=25423 op=264367 Acquired consumer connection extension
[09/Jun/2017:11:23:35.636376469 +0000] NSMMReplicationPlugin -
conn=25423 op=264367 repl="dc=ipa,dc=example,dc=com": Released
replica held by locking_purl=conn=25423 id=264366
[09/Jun/2017:11:23:35.638246352 +0000] NSMMReplicationPlugin -
conn=25423 op=264367 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:35.640313811 +0000] NSMMReplicationPlugin -
conn=25423 op=264368 Acquired consumer connection extension
[09/Jun/2017:11:23:35.641698620 +0000] NSMMReplicationPlugin -
conn=25423 op=264368 repl="dc=ipa,dc=example,dc=com": Begin
incremental protocol
[09/Jun/2017:11:23:35.642781684 +0000] csngen_adjust_time: gen
state before 593a8538000f:1497007414:0:2
[09/Jun/2017:11:23:35.643891535 +0000] csngen_adjust_time: gen
state after 593a85380012:1497007414:0:2
[09/Jun/2017:11:23:35.645168025 +0000] NSMMReplicationPlugin -
conn=25423 op=264368 repl="dc=ipa,dc=example,dc=com": Acquired
replica
[09/Jun/2017:11:23:35.646733260 +0000] NSMMReplicationPlugin -
conn=25423 op=264368 repl="dc=ipa,dc=example,dc=com":
StartNSDS90ReplicationRequest: response=0 rc=0
[09/Jun/2017:11:23:35.647809079 +0000] NSMMReplicationPlugin -
conn=25423 op=264368 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:35.657157358 +0000] NSMMReplicationPlugin -
conn=25423 op=264369 Acquired consumer connection extension
[09/Jun/2017:11:23:35.660230137 +0000] NSMMReplicationPlugin -
conn=25423 op=264369 repl="dc=ipa,dc=example,dc=com": Released
replica held by locking_purl=conn=25423 id=264368
[09/Jun/2017:11:23:35.661335755 +0000] NSMMReplicationPlugin -
conn=25423 op=264369 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:35.664472242 +0000] NSMMReplicationPlugin -
conn=25423 op=264370 Acquired consumer connection extension
[09/Jun/2017:11:23:35.665951740 +0000] NSMMReplicationPlugin -
conn=25423 op=264370 repl="dc=ipa,dc=example,dc=com": Begin
incremental protocol
[09/Jun/2017:11:23:35.666980091 +0000] csngen_adjust_time: gen
state before 593a85380012:1497007414:0:2
[09/Jun/2017:11:23:35.668332835 +0000] csngen_adjust_time: gen
state after 593a85380015:1497007414:0:2
[09/Jun/2017:11:23:35.669862710 +0000] NSMMReplicationPlugin -
conn=25423 op=264370 repl="dc=ipa,dc=example,dc=com": Acquired
replica
[09/Jun/2017:11:23:35.671275797 +0000] NSMMReplicationPlugin -
conn=25423 op=264370 repl="dc=ipa,dc=example,dc=com":
StartNSDS90ReplicationRequest: response=0 rc=0
[09/Jun/2017:11:23:35.672308999 +0000] NSMMReplicationPlugin -
conn=25423 op=264370 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:35.681152759 +0000] NSMMReplicationPlugin -
conn=25423 op=264371 Acquired consumer connection extension
[09/Jun/2017:11:23:35.684694343 +0000] NSMMReplicationPlugin -
conn=25423 op=264371 repl="dc=ipa,dc=example,dc=com": Released
replica held by locking_purl=conn=25423 id=264370
[09/Jun/2017:11:23:35.685964169 +0000] NSMMReplicationPlugin -
conn=25423 op=264371 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:35.688474490 +0000] NSMMReplicationPlugin -
conn=25423 op=264372 Acquired consumer connection extension
[09/Jun/2017:11:23:35.689898052 +0000] NSMMReplicationPlugin -
conn=25423 op=264372 repl="dc=ipa,dc=example,dc=com": Begin
incremental protocol
[09/Jun/2017:11:23:35.691210304 +0000] csngen_adjust_time: gen
state before 593a85380015:1497007414:0:2
[09/Jun/2017:11:23:35.693114309 +0000] csngen_adjust_time: gen
state after 593a8538001b:1497007414:0:2
[09/Jun/2017:11:23:35.694414531 +0000] NSMMReplicationPlugin -
conn=25423 op=264372 repl="dc=ipa,dc=example,dc=com": Acquired
replica
[09/Jun/2017:11:23:35.695705088 +0000] NSMMReplicationPlugin -
conn=25423 op=264372 repl="dc=ipa,dc=example,dc=com":
StartNSDS90ReplicationRequest: response=0 rc=0
[09/Jun/2017:11:23:35.696904120 +0000] NSMMReplicationPlugin -
conn=25423 op=264372 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:35.705321103 +0000] NSMMReplicationPlugin -
conn=25423 op=264373 Acquired consumer connection extension
[09/Jun/2017:11:23:35.708729601 +0000] NSMMReplicationPlugin -
conn=25423 op=264373 repl="dc=ipa,dc=example,dc=com": Released
replica held by locking_purl=conn=25423 id=264372
[09/Jun/2017:11:23:35.710117231 +0000] NSMMReplicationPlugin -
conn=25423 op=264373 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:35.804518175 +0000]
_csngen_adjust_local_time: gen state before
593a8538001b:1497007414:0:2
[09/Jun/2017:11:23:35.806089913 +0000]
_csngen_adjust_local_time: gen state after
593a85390000:1497007415:0:2
[09/Jun/2017:11:23:35.807226603 +0000] NSMMReplicationPlugin -
ruv_add_csn_inprogress: successfully inserted csn
593a8539000000030000 into pending list
[09/Jun/2017:11:23:35.808490329 +0000] NSMMReplicationPlugin -
Purged state information from entry
uid=admin,cn=users,cn=accounts,dc=ipa,dc=example,dc=com up to
CSN 59314aac001300040000
[09/Jun/2017:11:23:35.813252764 +0000] NSMMReplicationPlugin -
changelog program - _cl5GetDBFileByReplicaName: found DB
object 7fc617e39fb0 for database
/var/lib/dirsrv/slapd-IPA-EXAMPLE-COM/cldb/9e9a320c-492211e6-b8bdad3d-6f36d78c_57867ff5000000040000.db
[09/Jun/2017:11:23:35.815030341 +0000] NSMMReplicationPlugin -
changelog program - _cl5GetDBFileByReplicaName: found DB
object 7fc617e39fb0 for database
/var/lib/dirsrv/slapd-IPA-EXAMPLE-COM/cldb/9e9a320c-492211e6-b8bdad3d-6f36d78c_57867ff5000000040000.db
[09/Jun/2017:11:23:36.966971030 +0000] NSMMReplicationPlugin -
conn=25423 op=264374 Acquired consumer connection extension
[09/Jun/2017:11:23:37.152983273 +0000] NSMMReplicationPlugin -
conn=25423 op=264374 repl="dc=ipa,dc=example,dc=com": Begin
incremental protocol
[09/Jun/2017:11:23:40.513966641 +0000] NSMMReplicationPlugin -
conn=31891 op=108 Acquired consumer connection extension
[09/Jun/2017:11:23:40.516032713 +0000] NSMMReplicationPlugin -
conn=31891 op=108 repl="dc=ipa,dc=example,dc=com": Begin
incremental protocol
[09/Jun/2017:11:23:59.148426236 +0000] NSMMReplicationPlugin -
ruv_update_ruv: successfully committed csn
593a8539000000030000
[09/Jun/2017:11:23:59.150000307 +0000] csngen_adjust_time: gen
state before 593a85390001:1497007415:0:2
[09/Jun/2017:11:23:59.151524926 +0000]
_csngen_adjust_local_time: gen state before
593a85390001:1497007415:0:2
[09/Jun/2017:11:23:59.152735294 +0000]
_csngen_adjust_local_time: gen state after
593a85500000:1497007438:0:2
[09/Jun/2017:11:23:59.153668431 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
State: wait_for_changes -> wait_for_changes
[09/Jun/2017:11:23:59.154793650 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
State: wait_for_changes -> ready_to_acquire_replica
[09/Jun/2017:11:23:59.155870517 +0000] NSMMReplicationPlugin -
conn=25423 op=264374 repl="dc=ipa,dc=example,dc=com": Acquired
replica
[09/Jun/2017:11:23:59.157054222 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
State: wait_for_changes -> wait_for_changes
[09/Jun/2017:11:23:59.158237336 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
State: wait_for_changes -> ready_to_acquire_replica
[09/Jun/2017:11:23:59.159455126 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Cancelling linger on the connection
[09/Jun/2017:11:23:59.161084796 +0000] csngen_adjust_time: gen
state before 593a85500000:1497007438:0:2
[09/Jun/2017:11:23:59.163055051 +0000] NSMMReplicationPlugin -
conn=31891 op=108 repl="dc=ipa,dc=example,dc=com": Replica in
use locking_purl=conn=25423 id=264374
[09/Jun/2017:11:23:59.164692726 +0000] NSMMReplicationPlugin -
changelog program - _cl5GetDBFile: found DB object
7fc617e39fb0 for database
/var/lib/dirsrv/slapd-IPA-EXAMPLE-COM/cldb/9e9a320c-492211e6-b8bdad3d-6f36d78c_57867ff5000000040000.db
[09/Jun/2017:11:23:59.165998389 +0000] NSMMReplicationPlugin -
changelog program - cl5GetOperationCount: found DB object
7fc617e39fb0
[09/Jun/2017:11:23:59.167383700 +0000] NSMMReplicationPlugin -
conn=31891 op=108 replica="dc=ipa,dc=example,dc=com": Unable
to acquire replica: error: replica busy locked by conn=25423
id=264374 for incremental update
[09/Jun/2017:11:23:59.168588051 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Cancelling linger on the connection
[09/Jun/2017:11:23:59.169680583 +0000] NSMMReplicationPlugin -
conn=25423 op=264374 repl="dc=ipa,dc=example,dc=com":
StartNSDS90ReplicationRequest: response=0 rc=0
[09/Jun/2017:11:23:59.170777957 +0000] NSMMReplicationPlugin -
changelog program - _cl5GetDBFile: found DB object
7fc617e39fb0 for database
/var/lib/dirsrv/slapd-IPA-EXAMPLE-COM/cldb/9e9a320c-492211e6-b8bdad3d-6f36d78c_57867ff5000000040000.db
[09/Jun/2017:11:23:59.171838122 +0000] NSMMReplicationPlugin -
changelog program - cl5GetOperationCount: found DB object
7fc617e39fb0
[09/Jun/2017:11:23:59.173023432 +0000] NSMMReplicationPlugin -
conn=31891 op=108 repl="dc=ipa,dc=example,dc=com":
StartNSDS90ReplicationRequest: response=1 rc=0
[09/Jun/2017:11:23:59.174115819 +0000] NSMMReplicationPlugin -
ruv_add_csn_inprogress: successfully inserted csn
593a8550000200030000 into pending list
[09/Jun/2017:11:23:59.175212206 +0000] NSMMReplicationPlugin -
conn=25423 op=264374 Relinquishing consumer connection
extension
[09/Jun/2017:11:23:59.176245867 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Replica was successfully acquired.
[09/Jun/2017:11:23:59.177346814 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Replica was successfully acquired.
[09/Jun/2017:11:23:59.178446626 +0000] NSMMReplicationPlugin -
conn=31891 op=108 Relinquishing consumer connection extension
[09/Jun/2017:11:23:59.179481731 +0000] NSMMReplicationPlugin -
Purged state information from entry
uid=dynamic-kepler,cn=users,cn=accounts,dc=ipa,dc=example,dc=com
up to CSN 59314aac001300040000
[09/Jun/2017:11:23:59.180647455 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
State: ready_to_acquire_replica -> sending_updates
[09/Jun/2017:11:23:59.181915531 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
State: ready_to_acquire_replica -> sending_updates
[09/Jun/2017:11:23:59.183084279 +0000] csngen_adjust_time: gen
state before 593a85500003:1497007438:0:2
[09/Jun/2017:11:23:59.184247501 +0000] NSMMReplicationPlugin -
changelog program - _cl5GetDBFile: found DB object
7fc617e39fb0 for database
/var/lib/dirsrv/slapd-IPA-EXAMPLE-COM/cldb/9e9a320c-492211e6-b8bdad3d-6f36d78c_57867ff5000000040000.db
[09/Jun/2017:11:23:59.185241528 +0000] csngen_adjust_time: gen
state before 593a85500003:1497007438:0:2
[09/Jun/2017:11:23:59.186423239 +0000] NSMMReplicationPlugin -
changelog program - _cl5GetDBFile: found DB object
7fc617e39fb0 for database
/var/lib/dirsrv/slapd-IPA-EXAMPLE-COM/cldb/9e9a320c-492211e6-b8bdad3d-6f36d78c_57867ff5000000040000.db
[09/Jun/2017:11:23:59.187605163 +0000]
_cl5PositionCursorForReplay
(agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389)):
Consumer RUV:
[09/Jun/2017:11:23:59.188816969 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
{replicageneration} 57867ff5000000040000
[09/Jun/2017:11:23:59.189875597 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
{replica 4 ldap://freeipa01.mgmt.example.com:389}
57867ffe000000040000 593a854f000800040000 00000000
[09/Jun/2017:11:23:59.191148141 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
{replica 3 ldap://freeipa02.mgmt.example.com:389}
57867ffa000000030000 5937cccd000300030000 00000000
[09/Jun/2017:11:23:59.192435806 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
{replica 5 ldap://freeipa03.mgmt.example.com:389}
59355988000000050000 593a8512000400050000 00000000
[09/Jun/2017:11:23:59.193752191 +0000]
_cl5PositionCursorForReplay
(agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389)):
Supplier RUV:
[09/Jun/2017:11:23:59.194855092 +0000] NSMMReplicationPlugin -
ruv_add_csn_inprogress: successfully inserted csn
593a8550000300030000 into pending list
[09/Jun/2017:11:23:59.196013013 +0000]
_cl5PositionCursorForReplay
(agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389)):
Consumer RUV:
[09/Jun/2017:11:23:59.197018847 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
{replicageneration} 57867ff5000000040000
[09/Jun/2017:11:23:59.198149650 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
{replica 5 ldap://freeipa03.mgmt.example.com:389}
59355988000000050000 593a854f000200050000 00000000
[09/Jun/2017:11:23:59.199164207 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
{replica 3 ldap://freeipa02.mgmt.example.com:389}
57867ffa000000030000 5937cccd000300030000 00000000
[09/Jun/2017:11:23:59.200160501 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
{replica 4 ldap://freeipa01.mgmt.example.com:389}
57867ffe000000040000 593a8549000200040000 00000000
[09/Jun/2017:11:23:59.201223801 +0000]
_cl5PositionCursorForReplay
(agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389)):
Supplier RUV:
[09/Jun/2017:11:23:59.202406176 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
{replicageneration} 57867ff5000000040000
[09/Jun/2017:11:23:59.203534024 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
{replica 3 ldap://freeipa02.mgmt.example.com:389}
57867ffa000000030000 5937ccd3000a00030000 5937ccd0
[09/Jun/2017:11:23:59.204516976 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
{replica 4 ldap://freeipa01.mgmt.example.com:389}
57867ffe000000040000 593a852c001300040000 593a852c
[09/Jun/2017:11:23:59.205570891 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
{replica 5 ldap://freeipa03.mgmt.example.com:389}
59355988000000050000 593a8512000400050000 593a8511
[09/Jun/2017:11:23:59.206847122 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
clcache_get_buffer: found thread private buffer cache
7fc5ec02a250
[09/Jun/2017:11:23:59.207950863 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
clcache_get_buffer: _pool is 7fc617e6c070
_pool->pl_busy_lists is 7fc5e8052d30
_pool->pl_busy_lists->bl_buffers is 7fc5e8052c30
[09/Jun/2017:11:23:59.209067644 +0000]
clcache_initial_anchorcsn -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
(cscb 0 - state 0) - csnPrevMax () csnMax
(5937ccd3000a00030000) csnBuf (5937ccd3001a00040000)
csnConsumerMax (5937cccd000300030000)
[09/Jun/2017:11:23:59.210151400 +0000]
clcache_initial_anchorcsn -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
(cscb 1 - state 1) - csnPrevMax () csnMax
(593a852c001300040000) csnBuf (5937ccd3001a00040000)
csnConsumerMax (593a8549000200040000)
[09/Jun/2017:11:23:59.211264387 +0000]
clcache_initial_anchorcsn - anchor is now:
5937cccd000300030000
[09/Jun/2017:11:23:59.212241989 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
{replicageneration} 57867ff5000000040000
[09/Jun/2017:11:23:59.213476236 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
{replica 3 ldap://freeipa02.mgmt.example.com:389}
57867ffa000000030000 5937ccd3000a00030000 5937ccd0
[09/Jun/2017:11:23:59.214735708 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
{replica 4 ldap://freeipa01.mgmt.example.com:389}
57867ffe000000040000 593a852c001300040000 593a852c
[09/Jun/2017:11:23:59.215853690 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
{replica 5 ldap://freeipa03.mgmt.example.com:389}
59355988000000050000 593a8512000400050000 593a8511
[09/Jun/2017:11:23:59.217009469 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
clcache_get_buffer: found thread private buffer cache
7fc5f800cee0
[09/Jun/2017:11:23:59.218074716 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
clcache_get_buffer: _pool is 7fc617e6c070
_pool->pl_busy_lists is 7fc5e8052d30
_pool->pl_busy_lists->bl_buffers is 7fc5e8052c30
[09/Jun/2017:11:23:59.219157320 +0000]
clcache_initial_anchorcsn -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
(cscb 0 - state 0) - csnPrevMax () csnMax
(5937ccd3000a00030000) csnBuf (5937ccd3001a00040000)
csnConsumerMax (5937cccd000300030000)
[09/Jun/2017:11:23:59.220647475 +0000]
clcache_initial_anchorcsn -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
(cscb 1 - state 1) - csnPrevMax () csnMax
(593a8512000400050000) csnBuf (5937ccd3001a00040000)
csnConsumerMax (593a8512000400050000)
[09/Jun/2017:11:23:59.221818485 +0000]
clcache_initial_anchorcsn - anchor is now:
5937cccd000300030000
[09/Jun/2017:11:23:59.222874292 +0000] NSMMReplicationPlugin -
Purged state information from entry
uid=dynamic-kepler,cn=users,cn=accounts,dc=ipa,dc=example,dc=com
up to CSN 59314aac001300040000
[09/Jun/2017:11:23:59.223866110 +0000] NSMMReplicationPlugin -
changelog program - agmt="cn=meTofreeipa03.mgmt.example.com"
(freeipa03:389): CSN 5937cccd000300030000 found, position set
for replay
[09/Jun/2017:11:23:59.224974543 +0000] NSMMReplicationPlugin -
changelog program - agmt="cn=meTofreeipa01.mgmt.example.com"
(freeipa01:389): CSN 5937cccd000300030000 found, position set
for replay
[09/Jun/2017:11:23:59.226535009 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=1 rec=1 csn=5937cccd000500030000
[09/Jun/2017:11:23:59.227905158 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=claim-winter,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000500030000)
[09/Jun/2017:11:23:59.228971714 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=1 rec=1 csn=5937cccd000500030000
[09/Jun/2017:11:23:59.230147572 +0000]
repl5_inc_result_threadmain starting
[09/Jun/2017:11:23:59.231294475 +0000]
repl5_inc_result_threadmain starting
[09/Jun/2017:11:23:59.232517579 +0000] NSMMReplicationPlugin -
changelog program - _cl5GetDBFileByReplicaName: found DB
object 7fc617e39fb0 for database
/var/lib/dirsrv/slapd-IPA-EXAMPLE-COM/cldb/9e9a320c-492211e6-b8bdad3d-6f36d78c_57867ff5000000040000.db
[09/Jun/2017:11:23:59.233688545 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=claim-winter,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000500030000) not sent - empty
[09/Jun/2017:11:23:59.234698603 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000500030000
[09/Jun/2017:11:23:59.235705585 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
6cce4f02-6fe611e6-96f2be56-1da7a3c1, CSN
5937cccd000500030000):
[09/Jun/2017:11:23:59.236758912 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=1 rec=2 csn=5937cccd000600030000
[09/Jun/2017:11:23:59.237960234 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=rust-leeloo,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000600030000)
[09/Jun/2017:11:23:59.239122213 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=rust-leeloo,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000600030000) not sent - empty
[09/Jun/2017:11:23:59.240561993 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000600030000
[09/Jun/2017:11:23:59.241609779 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
56a8a935-704f11e6-96f2be56-1da7a3c1, CSN
5937cccd000600030000):
[09/Jun/2017:11:23:59.242656367 +0000] NSMMReplicationPlugin -
changelog program - _cl5GetDBFileByReplicaName: found DB
object 7fc617e39fb0 for database
/var/lib/dirsrv/slapd-IPA-EXAMPLE-COM/cldb/9e9a320c-492211e6-b8bdad3d-6f36d78c_57867ff5000000040000.db
[09/Jun/2017:11:23:59.243731678 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=claim-winter,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000500030000)
[09/Jun/2017:11:23:59.244786013 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.246022182 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.247079907 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=1 rec=3 csn=5937cccd000700030000
[09/Jun/2017:11:23:59.248439671 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=claim-winter,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000500030000) not sent - empty
[09/Jun/2017:11:23:59.249511773 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000500030000
[09/Jun/2017:11:23:59.250807498 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
6cce4f02-6fe611e6-96f2be56-1da7a3c1, CSN
5937cccd000500030000):
[09/Jun/2017:11:23:59.251791244 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=1 rec=2 csn=5937cccd000600030000
[09/Jun/2017:11:23:59.252850577 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=orange-surprise,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000700030000)
[09/Jun/2017:11:23:59.253890242 +0000] NSMMReplicationPlugin -
changelog program - _cl5GetDBFileByReplicaName: found DB
object 7fc617e39fb0 for database
/var/lib/dirsrv/slapd-IPA-EXAMPLE-COM/cldb/9e9a320c-492211e6-b8bdad3d-6f36d78c_57867ff5000000040000.db
[09/Jun/2017:11:23:59.254997201 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.256123172 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.257187333 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=rust-leeloo,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000600030000)
[09/Jun/2017:11:23:59.258395524 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=orange-surprise,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000700030000) not sent - empty
[09/Jun/2017:11:23:59.259420543 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000700030000
[09/Jun/2017:11:23:59.260414170 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
63c7973e-705311e6-96f2be56-1da7a3c1, CSN
5937cccd000700030000):
[09/Jun/2017:11:23:59.261456333 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=1 rec=4 csn=5937cccd000800030000
[09/Jun/2017:11:23:59.262493032 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.263755098 +0000] NSMMReplicationPlugin -
changelog program - _cl5GetDBFileByReplicaName: found DB
object 7fc617e39fb0 for database
/var/lib/dirsrv/slapd-IPA-EXAMPLE-COM/cldb/9e9a320c-492211e6-b8bdad3d-6f36d78c_57867ff5000000040000.db
[09/Jun/2017:11:23:59.264958435 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.266036220 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=rust-leeloo,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000600030000) not sent - empty
[09/Jun/2017:11:23:59.267213752 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000600030000
[09/Jun/2017:11:23:59.268403318 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
56a8a935-704f11e6-96f2be56-1da7a3c1, CSN
5937cccd000600030000):
[09/Jun/2017:11:23:59.269441700 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=carmine-pascal,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000800030000)
[09/Jun/2017:11:23:59.270556133 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.271763440 +0000] NSMMReplicationPlugin -
ruv_add_csn_inprogress: successfully inserted csn
593a8549000200040000 into pending list
[09/Jun/2017:11:23:59.273021252 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=1 rec=3 csn=5937cccd000700030000
[09/Jun/2017:11:23:59.274163167 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.275240924 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=carmine-pascal,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000800030000) not sent - empty
[09/Jun/2017:11:23:59.276258494 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000800030000
[09/Jun/2017:11:23:59.277296208 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
5e1e8132-705411e6-96f2be56-1da7a3c1, CSN
5937cccd000800030000):
[09/Jun/2017:11:23:59.339003700 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=1 rec=5 csn=5937cccd000900030000
[09/Jun/2017:11:23:59.340167578 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=orange-surprise,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000700030000)
[09/Jun/2017:11:23:59.341967319 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.343885306 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.473976871 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=orange-surprise,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000700030000) not sent - empty
[09/Jun/2017:11:23:59.475134422 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000700030000
[09/Jun/2017:11:23:59.476103287 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
63c7973e-705311e6-96f2be56-1da7a3c1, CSN
5937cccd000700030000):
[09/Jun/2017:11:23:59.477404633 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.634970515 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.635972943 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.637014347 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=1 rec=4 csn=5937cccd000800030000
[09/Jun/2017:11:23:59.637999767 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=yellow-word,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000900030000)
[09/Jun/2017:11:23:59.669108492 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.670299094 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=yellow-word,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000900030000) not sent - empty
[09/Jun/2017:11:23:59.671338294 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000900030000
[09/Jun/2017:11:23:59.672273023 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
2300c133-744b11e6-96f2be56-1da7a3c1, CSN
5937cccd000900030000):
[09/Jun/2017:11:23:59.693524887 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=1 rec=6 csn=5937cccd000a00030000
[09/Jun/2017:11:23:59.694654897 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=carmine-pascal,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000800030000)
[09/Jun/2017:11:23:59.695873986 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=carmine-pascal,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000800030000) not sent - empty
[09/Jun/2017:11:23:59.697086747 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000800030000
[09/Jun/2017:11:23:59.698226406 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
5e1e8132-705411e6-96f2be56-1da7a3c1, CSN
5937cccd000800030000):
[09/Jun/2017:11:23:59.699334764 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=1 rec=5 csn=5937cccd000900030000
[09/Jun/2017:11:23:59.706234640 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:23:59.707281062 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=yellow-word,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000900030000)
[09/Jun/2017:11:23:59.708333989 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=maroon-han,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000a00030000)
[09/Jun/2017:11:23:59.826311317 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=maroon-han,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000a00030000) not sent - empty
[09/Jun/2017:11:23:59.827303065 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000a00030000
[09/Jun/2017:11:23:59.828244567 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
24cd8306-745111e6-96f2be56-1da7a3c1, CSN
5937cccd000a00030000):
[09/Jun/2017:11:24:00.119835159 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:00.121132287 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=1 rec=7 csn=5937cccd000b00030000
[09/Jun/2017:11:24:00.122246967 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:00.123418461 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=yellow-word,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000900030000) not sent - empty
[09/Jun/2017:11:24:00.124528188 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000900030000
[09/Jun/2017:11:24:00.125736293 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
2300c133-744b11e6-96f2be56-1da7a3c1, CSN
5937cccd000900030000):
[09/Jun/2017:11:24:00.346203115 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=impress-spite,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000b00030000)
[09/Jun/2017:11:24:00.347254280 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:00.348414055 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=1 rec=6 csn=5937cccd000a00030000
[09/Jun/2017:11:24:00.349554133 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=maroon-han,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000a00030000)
[09/Jun/2017:11:24:00.351735287 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=maroon-han,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000a00030000) not sent - empty
[09/Jun/2017:11:24:00.352846041 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000a00030000
[09/Jun/2017:11:24:00.353933852 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
24cd8306-745111e6-96f2be56-1da7a3c1, CSN
5937cccd000a00030000):
[09/Jun/2017:11:24:00.354913324 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=1 rec=7 csn=5937cccd000b00030000
[09/Jun/2017:11:24:00.356017624 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=impress-spite,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000b00030000)
[09/Jun/2017:11:24:00.357138628 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=impress-spite,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000b00030000) not sent - empty
[09/Jun/2017:11:24:00.358373469 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000b00030000
[09/Jun/2017:11:24:00.359560743 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
3733de0b-479311e7-96f2be56-1da7a3c1, CSN
5937cccd000b00030000):
[09/Jun/2017:11:24:00.360765077 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=1 rec=8 csn=5937cccd000c00030000
[09/Jun/2017:11:24:00.361908467 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=understanding-tradition-walk,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000c00030000)
[09/Jun/2017:11:24:00.363132015 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=understanding-tradition-walk,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000c00030000) not sent - empty
[09/Jun/2017:11:24:00.364337739 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000c00030000
[09/Jun/2017:11:24:00.365371180 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
5a03cf19-753e11e6-96f2be56-1da7a3c1, CSN
5937cccd000c00030000):
[09/Jun/2017:11:24:00.412383063 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=impress-spite,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000b00030000) not sent - empty
[09/Jun/2017:11:24:00.413431885 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000b00030000
[09/Jun/2017:11:24:00.414386555 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
3733de0b-479311e7-96f2be56-1da7a3c1, CSN
5937cccd000b00030000):
[09/Jun/2017:11:24:00.415356502 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:00.516093595 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=1 rec=8 csn=5937cccd000c00030000
[09/Jun/2017:11:24:00.536011820 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=understanding-tradition-walk,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000c00030000)
[09/Jun/2017:11:24:00.621969760 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=understanding-tradition-walk,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000c00030000) not sent - empty
[09/Jun/2017:11:24:00.623073358 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000c00030000
[09/Jun/2017:11:24:00.624389007 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
5a03cf19-753e11e6-96f2be56-1da7a3c1, CSN
5937cccd000c00030000):
[09/Jun/2017:11:24:00.625780420 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:01.095045708 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:01.168977824 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:02.131027199 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:02.335544215 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:03.054906281 +0000] NSMMReplicationPlugin -
conn=31891 op=109 Acquired consumer connection extension
[09/Jun/2017:11:24:03.067325491 +0000] NSMMReplicationPlugin -
conn=31891 op=109 repl="dc=ipa,dc=example,dc=com": Begin
incremental protocol
[09/Jun/2017:11:24:03.167477981 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:03.428535079 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:04.198918134 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:04.703565461 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:05.421976186 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:05.758162332 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:06.740878753 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:06.848889369 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:07.913970239 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:07.915242746 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:08.963329779 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:08.964473772 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:10.149965805 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:10.151179223 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:11.237996339 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:11.239111840 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:12.505969952 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:12.506989732 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:13.592971583 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:13.594640614 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:14.654656307 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:14.655773809 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:15.694634141 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:15.695886238 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:16.721904498 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:16.810970655 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:17.998988021 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:18.000108731 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:19.183980776 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:19.185207669 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:20.213470305 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:20.214487748 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:21.368495882 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:21.369491946 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:22.021620336 +0000] NSMMReplicationPlugin -
ruv_update_ruv: successfully committed csn
593a8550000200030000
[09/Jun/2017:11:24:22.022751841 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
(cscb 0 - state 0) - csnPrevMax (5937ccd3000a00030000) csnMax
(5937ccd3000a00030000) csnBuf (5937cccd000c00030000)
csnConsumerMax (5937cccd000c00030000)
[09/Jun/2017:11:24:22.023746956 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
(cscb 1 - state 1) - csnPrevMax (593a8512000400050000) csnMax
(593a8512000400050000) csnBuf (5937cccd000c00030000)
csnConsumerMax (593a8512000400050000)
[09/Jun/2017:11:24:22.024744332 +0000]
clcache_adjust_anchorcsn - anchor is now: 5937cccd000c00030000
[09/Jun/2017:11:24:22.025844615 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
(cscb 0 - state 0) - csnPrevMax (5937ccd3000a00030000) csnMax
(5937ccd3000a00030000) csnBuf (5937cccd000c00030000)
csnConsumerMax (5937cccd000c00030000)
[09/Jun/2017:11:24:22.026883994 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
(cscb 1 - state 1) - csnPrevMax (593a852c001300040000) csnMax
(593a852c001300040000) csnBuf (5937cccd000c00030000)
csnConsumerMax (593a8549000200040000)
[09/Jun/2017:11:24:22.027876070 +0000]
clcache_adjust_anchorcsn - anchor is now: 5937cccd000c00030000
[09/Jun/2017:11:24:22.028914820 +0000] csngen_adjust_time: gen
state before 593a85500004:1497007438:0:2
[09/Jun/2017:11:24:22.030027593 +0000]
_csngen_adjust_local_time: gen state before
593a85500004:1497007438:0:2
[09/Jun/2017:11:24:22.031068677 +0000]
_csngen_adjust_local_time: gen state after
593a85670000:1497007461:0:2
[09/Jun/2017:11:24:22.032197847 +0000] NSMMReplicationPlugin -
conn=31891 op=109 repl="dc=ipa,dc=example,dc=com": Replica in
use locking_purl=conn=25423 id=264374
[09/Jun/2017:11:24:22.033416768 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=2 rec=9 csn=5937cccd000d00030000
[09/Jun/2017:11:24:22.034446653 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=2 rec=9 csn=5937cccd000d00030000
[09/Jun/2017:11:24:22.035528149 +0000] NSMMReplicationPlugin -
conn=31891 op=109 replica="dc=ipa,dc=example,dc=com": Unable
to acquire replica: error: replica busy locked by conn=25423
id=264374 for incremental update
[09/Jun/2017:11:24:22.036688318 +0000] NSMMReplicationPlugin -
ruv_add_csn_inprogress: successfully inserted csn
593a8567000000030000 into pending list
[09/Jun/2017:11:24:22.037813398 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=honest-leroy,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000d00030000)
[09/Jun/2017:11:24:22.038846775 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=honest-leroy,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000d00030000) not sent - empty
[09/Jun/2017:11:24:22.039950286 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000d00030000
[09/Jun/2017:11:24:22.040989356 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
eeed862c-f01211e6-96f2be56-1da7a3c1, CSN
5937cccd000d00030000):
[09/Jun/2017:11:24:22.042106480 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=2 rec=10 csn=5937cccd000e00030000
[09/Jun/2017:11:24:22.043417515 +0000] NSMMReplicationPlugin -
conn=31891 op=109 repl="dc=ipa,dc=example,dc=com":
StartNSDS90ReplicationRequest: response=1 rc=0
[09/Jun/2017:11:24:22.044819547 +0000] NSMMReplicationPlugin -
Purged state information from entry
uid=dynamic-kepler,cn=users,cn=accounts,dc=ipa,dc=example,dc=com
up to CSN 59314aac001300040000
[09/Jun/2017:11:24:22.046042245 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=honest-leroy,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000d00030000)
[09/Jun/2017:11:24:22.047184987 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=friendly-amethyst-climate,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000e00030000)
[09/Jun/2017:11:24:22.048320012 +0000] NSMMReplicationPlugin -
conn=31891 op=109 Relinquishing consumer connection extension
[09/Jun/2017:11:24:22.049402209 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=honest-leroy,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000d00030000) not sent - empty
[09/Jun/2017:11:24:22.050571226 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000d00030000
[09/Jun/2017:11:24:22.052037522 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
eeed862c-f01211e6-96f2be56-1da7a3c1, CSN
5937cccd000d00030000):
[09/Jun/2017:11:24:22.053218635 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=2 rec=10 csn=5937cccd000e00030000
[09/Jun/2017:11:24:22.054413196 +0000] NSMMReplicationPlugin -
changelog program - _cl5GetDBFileByReplicaName: found DB
object 7fc617e39fb0 for database
/var/lib/dirsrv/slapd-IPA-EXAMPLE-COM/cldb/9e9a320c-492211e6-b8bdad3d-6f36d78c_57867ff5000000040000.db
[09/Jun/2017:11:24:22.055612365 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=friendly-amethyst-climate,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000e00030000) not sent - empty
[09/Jun/2017:11:24:22.056669907 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000e00030000
[09/Jun/2017:11:24:22.057745711 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
19f31b1b-754311e6-96f2be56-1da7a3c1, CSN
5937cccd000e00030000):
[09/Jun/2017:11:24:22.058977638 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=2 rec=11 csn=5937cccd000f00030000
[09/Jun/2017:11:24:22.060789981 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=romantic-blanco-cat,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000f00030000)
[09/Jun/2017:11:24:22.061949682 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=romantic-blanco-cat,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000f00030000) not sent - empty
[09/Jun/2017:11:24:22.063192209 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000f00030000
[09/Jun/2017:11:24:22.064360191 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
c1596084-9f7c11e6-96f2be56-1da7a3c1, CSN
5937cccd000f00030000):
[09/Jun/2017:11:24:22.065528999 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=2 rec=12 csn=5937cccd001000030000
[09/Jun/2017:11:24:22.066773800 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=friendly-amethyst-climate,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000e00030000)
[09/Jun/2017:11:24:22.068014114 +0000] NSMMReplicationPlugin -
changelog program - _cl5GetDBFileByReplicaName: found DB
object 7fc617e39fb0 for database
/var/lib/dirsrv/slapd-IPA-EXAMPLE-COM/cldb/9e9a320c-492211e6-b8bdad3d-6f36d78c_57867ff5000000040000.db
[09/Jun/2017:11:24:22.069217618 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=good-nemo,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd001000030000)
[09/Jun/2017:11:24:22.070527918 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=good-nemo,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd001000030000) not sent - empty
[09/Jun/2017:11:24:22.071734093 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937cccd001000030000
[09/Jun/2017:11:24:22.072954591 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
5f5c3944-766611e6-96f2be56-1da7a3c1, CSN
5937cccd001000030000):
[09/Jun/2017:11:24:22.316668767 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=friendly-amethyst-climate,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000e00030000) not sent - empty
[09/Jun/2017:11:24:22.336969181 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000e00030000
[09/Jun/2017:11:24:22.337964863 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
19f31b1b-754311e6-96f2be56-1da7a3c1, CSN
5937cccd000e00030000):
[09/Jun/2017:11:24:22.737496231 +0000] NSMMReplicationPlugin -
conn=31891 op=110 Acquired consumer connection extension
[09/Jun/2017:11:24:22.739557773 +0000] NSMMReplicationPlugin -
conn=31891 op=110 repl="dc=ipa,dc=example,dc=com": Begin
incremental protocol
[09/Jun/2017:11:24:22.740921837 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:22.742054562 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=2 rec=11 csn=5937cccd000f00030000
[09/Jun/2017:11:24:22.899110951 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:22.900184929 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=romantic-blanco-cat,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000f00030000)
[09/Jun/2017:11:24:22.970633375 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=romantic-blanco-cat,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd000f00030000) not sent - empty
[09/Jun/2017:11:24:22.971652475 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937cccd000f00030000
[09/Jun/2017:11:24:22.972599623 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
c1596084-9f7c11e6-96f2be56-1da7a3c1, CSN
5937cccd000f00030000):
[09/Jun/2017:11:24:22.973604677 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=2 rec=12 csn=5937cccd001000030000
[09/Jun/2017:11:24:23.326980255 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=good-nemo,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd001000030000)
[09/Jun/2017:11:24:23.333437765 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=good-nemo,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937cccd001000030000) not sent - empty
[09/Jun/2017:11:24:23.341722698 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937cccd001000030000
[09/Jun/2017:11:24:23.345834898 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
5f5c3944-766611e6-96f2be56-1da7a3c1, CSN
5937cccd001000030000):
[09/Jun/2017:11:24:23.348830932 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
Skipping update because the consumer with Rid: [4] is ignored
[09/Jun/2017:11:24:23.353132222 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
Skipping update because the consumer with Rid: [4] is ignored
[09/Jun/2017:11:24:23.357254972 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
Skipping update because the consumer with Rid: [4] is ignored
[09/Jun/2017:11:24:24.424104175 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:24.425487825 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:25.818975203 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:25.820046324 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:27.074028951 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:27.075209888 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:28.101314443 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:28.678977629 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:29.599917667 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:31.875977516 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:31.877211928 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:32.904632505 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:32.905859953 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:34.009979774 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:34.011150703 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:35.307732142 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:35.309119597 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:36.438972102 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:36.440050806 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:37.480882968 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:37.482043005 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:38.862963193 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:38.864129696 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:40.178969941 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:40.180059248 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:41.332969532 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:41.334125348 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:42.441284062 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:42.442379075 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:43.656977050 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:43.658143687 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:45.320909690 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:45.321979651 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:45.381466802 +0000] NSMMReplicationPlugin -
ruv_update_ruv: successfully committed csn
593a8567000000030000
[09/Jun/2017:11:24:45.382649596 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
(cscb 0 - state 0) - csnPrevMax (5937ccd3000a00030000) csnMax
(5937ccd3000a00030000) csnBuf (5937ccce000a00040000)
csnConsumerMax (5937cccd001000030000)
[09/Jun/2017:11:24:45.383858959 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
(cscb 1 - state 1) - csnPrevMax (593a852c001300040000) csnMax
(593a852c001300040000) csnBuf (5937ccce000a00040000)
csnConsumerMax (593a8549000200040000)
[09/Jun/2017:11:24:45.385046911 +0000]
clcache_adjust_anchorcsn - anchor is now: 5937ccce000a00040000
[09/Jun/2017:11:24:45.386261815 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
(cscb 0 - state 0) - csnPrevMax (5937ccd3000a00030000) csnMax
(5937ccd3000a00030000) csnBuf (5937ccce000a00040000)
csnConsumerMax (5937cccd001000030000)
[09/Jun/2017:11:24:45.387577691 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
(cscb 1 - state 1) - csnPrevMax (593a8512000400050000) csnMax
(593a8512000400050000) csnBuf (5937ccce000a00040000)
csnConsumerMax (593a8512000400050000)
[09/Jun/2017:11:24:45.388773441 +0000]
clcache_adjust_anchorcsn - anchor is now: 5937ccce000a00040000
[09/Jun/2017:11:24:45.390049775 +0000] NSMMReplicationPlugin -
Authorized replication managers is resync (1497007485)
[09/Jun/2017:11:24:45.391213078 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=3 rec=18 csn=5937ccce001600030000
[09/Jun/2017:11:24:45.392608567 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
Skipping update because the consumer with Rid: [4] is ignored
[09/Jun/2017:11:24:45.393999065 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
Skipping update because the consumer with Rid: [4] is ignored
[09/Jun/2017:11:24:45.395213439 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=3 rec=18 csn=5937ccce001600030000
[09/Jun/2017:11:24:45.396591555 +0000]
_csngen_adjust_local_time: gen state before
593a85670001:1497007461:0:2
[09/Jun/2017:11:24:45.397989075 +0000]
_csngen_adjust_local_time: gen state after
593a857e0000:1497007484:0:2
[09/Jun/2017:11:24:45.399930736 +0000] csngen_adjust_time: gen
state before 593a857e0001:1497007484:0:2
[09/Jun/2017:11:24:45.401174316 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=nieve-if,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937ccce001600030000)
[09/Jun/2017:11:24:45.402698725 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=nieve-if,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937ccce001600030000) not sent - empty
[09/Jun/2017:11:24:45.403821583 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937ccce001600030000
[09/Jun/2017:11:24:45.404946496 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
71feb58d-7a4c11e6-96f2be56-1da7a3c1, CSN
5937ccce001600030000):
[09/Jun/2017:11:24:45.406078787 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=3 rec=19 csn=5937ccce001700030000
[09/Jun/2017:11:24:45.407270475 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=nieve-if,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937ccce001600030000)
[09/Jun/2017:11:24:45.410072396 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=nieve-if,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937ccce001600030000) not sent - empty
[09/Jun/2017:11:24:45.411305199 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937ccce001600030000
[09/Jun/2017:11:24:45.412405115 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
71feb58d-7a4c11e6-96f2be56-1da7a3c1, CSN
5937ccce001600030000):
[09/Jun/2017:11:24:45.413573311 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=3 rec=19 csn=5937ccce001700030000
[09/Jun/2017:11:24:45.414738888 +0000] NSMMReplicationPlugin -
conn=31891 op=110 repl="dc=ipa,dc=example,dc=com": Replica in
use locking_purl=conn=25423 id=264374
[09/Jun/2017:11:24:45.415819170 +0000] NSMMReplicationPlugin -
conn=31891 op=110 replica="dc=ipa,dc=example,dc=com": Unable
to acquire replica: error: replica busy locked by conn=25423
id=264374 for incremental update
[09/Jun/2017:11:24:45.417492568 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=user_api,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937ccce001700030000)
[09/Jun/2017:11:24:45.418677205 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=user_api,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937ccce001700030000) not sent - empty
[09/Jun/2017:11:24:45.419926966 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937ccce001700030000
[09/Jun/2017:11:24:45.421485957 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
3ac43904-492311e6-96f2be56-1da7a3c1, CSN
5937ccce001700030000):
[09/Jun/2017:11:24:45.422597851 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
Skipping update because the consumer with Rid: [4] is ignored
[09/Jun/2017:11:24:45.423875359 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=user_api,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937ccce001700030000)
[09/Jun/2017:11:24:45.425009740 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=user_api,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937ccce001700030000) not sent - empty
[09/Jun/2017:11:24:45.426012140 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937ccce001700030000
[09/Jun/2017:11:24:45.427217498 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
3ac43904-492311e6-96f2be56-1da7a3c1, CSN
5937ccce001700030000):
[09/Jun/2017:11:24:45.428339841 +0000] NSMMReplicationPlugin -
ruv_add_csn_inprogress: successfully inserted csn
593a857e000000030000 into pending list
[09/Jun/2017:11:24:45.429633603 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
(cscb 0 - state 0) - csnPrevMax (5937ccd3000a00030000) csnMax
(5937ccd3000a00030000) csnBuf (5937ccce001700040000)
csnConsumerMax (5937ccce001700030000)
[09/Jun/2017:11:24:45.431017786 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
(cscb 1 - state 1) - csnPrevMax (593a8512000400050000) csnMax
(593a8512000400050000) csnBuf (5937ccce001700040000)
csnConsumerMax (593a8512000400050000)
[09/Jun/2017:11:24:45.432188915 +0000]
clcache_adjust_anchorcsn - anchor is now: 5937ccce001700040000
[09/Jun/2017:11:24:45.433367469 +0000] NSMMReplicationPlugin -
Purged state information from entry
uid=admin,cn=users,cn=accounts,dc=ipa,dc=example,dc=com up to
CSN 59314aac001300040000
[09/Jun/2017:11:24:45.434496240 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
(cscb 0 - state 0) - csnPrevMax (5937ccd3000a00030000) csnMax
(5937ccd3000a00030000) csnBuf (5937ccce001700040000)
csnConsumerMax (5937ccce001700030000)
[09/Jun/2017:11:24:45.436049132 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
(cscb 1 - state 1) - csnPrevMax (593a852c001300040000) csnMax
(593a852c001300040000) csnBuf (5937ccce001700040000)
csnConsumerMax (593a8549000200040000)
[09/Jun/2017:11:24:45.437140358 +0000]
clcache_adjust_anchorcsn - anchor is now: 5937ccce001700040000
[09/Jun/2017:11:24:45.438251461 +0000] NSMMReplicationPlugin -
conn=31891 op=110 repl="dc=ipa,dc=example,dc=com":
StartNSDS90ReplicationRequest: response=1 rc=0
[09/Jun/2017:11:24:45.439401654 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
Skipping update because the consumer with Rid: [4] is ignored
[09/Jun/2017:11:24:45.440409080 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
Skipping update because the consumer with Rid: [4] is ignored
[09/Jun/2017:11:24:45.441410977 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
Skipping update because the consumer with Rid: [4] is ignored
[09/Jun/2017:11:24:45.442780004 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
load=4 rec=24 csn=5937ccd0000500030000
[09/Jun/2017:11:24:45.444131710 +0000] NSMMReplicationPlugin -
changelog program - _cl5GetDBFileByReplicaName: found DB
object 7fc617e39fb0 for database
/var/lib/dirsrv/slapd-IPA-EXAMPLE-COM/cldb/9e9a320c-492211e6-b8bdad3d-6f36d78c_57867ff5000000040000.db
[09/Jun/2017:11:24:45.445468007 +0000]
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
load=4 rec=24 csn=5937ccd0000500030000
[09/Jun/2017:11:24:45.446512142 +0000] NSMMReplicationPlugin -
conn=31891 op=110 Relinquishing consumer connection extension
[09/Jun/2017:11:24:45.447571353 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Sending modify operation
(dn="uid=frank-alizarin-wife,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937ccd0000500030000)
[09/Jun/2017:11:24:45.448537321 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: modifys operation
(dn="uid=frank-alizarin-wife,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937ccd0000500030000) not sent - empty
[09/Jun/2017:11:24:45.449614060 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
replay_update: Consumer successfully sent operation with csn
5937ccd0000500030000
[09/Jun/2017:11:24:45.450649912 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389):
Skipping update operation with no message_id (uniqueid
0f2f0d86-7a9011e6-96f2be56-1da7a3c1, CSN
5937ccd0000500030000):
[09/Jun/2017:11:24:45.451826292 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Sending modify operation
(dn="uid=frank-alizarin-wife,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937ccd0000500030000)
[09/Jun/2017:11:24:45.452815681 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: modifys operation
(dn="uid=frank-alizarin-wife,cn=users,cn=accounts,dc=ipa,dc=example,dc=com"
csn=5937ccd0000500030000) not sent - empty
[09/Jun/2017:11:24:45.453774071 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
replay_update: Consumer successfully sent operation with csn
5937ccd0000500030000
[09/Jun/2017:11:24:45.454752897 +0000] NSMMReplicationPlugin -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389):
Skipping update operation with no message_id (uniqueid
0f2f0d86-7a9011e6-96f2be56-1da7a3c1, CSN
5937ccd0000500030000):
[09/Jun/2017:11:24:45.455761552 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
(cscb 0 - state 0) - csnPrevMax (5937ccd3000a00030000) csnMax
(5937ccd3000a00030000) csnBuf (5937ccd0000500030000)
csnConsumerMax (5937ccd0000500030000)
[09/Jun/2017:11:24:45.457682337 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
(cscb 1 - state 1) - csnPrevMax (593a8512000400050000) csnMax
(593a8512000400050000) csnBuf (5937ccd0000500030000)
csnConsumerMax (593a8512000400050000)
[09/Jun/2017:11:24:45.458781212 +0000]
clcache_adjust_anchorcsn - anchor is now: 5937ccd0000500030000
[09/Jun/2017:11:24:45.459836378 +0000] NSMMReplicationPlugin -
changelog program - _cl5GetDBFileByReplicaName: found DB
object 7fc617e39fb0 for database
/var/lib/dirsrv/slapd-IPA-EXAMPLE-COM/cldb/9e9a320c-492211e6-b8bdad3d-6f36d78c_57867ff5000000040000.db
[09/Jun/2017:11:24:45.460908735 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
(cscb 0 - state 0) - csnPrevMax (5937ccd3000a00030000) csnMax
(5937ccd3000a00030000) csnBuf (5937ccd0000500030000)
csnConsumerMax (5937ccd0000500030000)
[09/Jun/2017:11:24:45.461953737 +0000]
clcache_adjust_anchorcsn -
agmt="cn=meTofreeipa03.mgmt.example.com" (freeipa03:389) -
(cscb 1 - state 1) - csnPrevMax (593a852c001300040000) csnMax
(593a852c001300040000) csnBuf (5937ccd0000500030000)
csnConsumerMax (593a8549000200040000)
[09/Jun/2017:11:24:45.463009813 +0000]
clcache_adjust_anchorcsn - anchor is now: 5937ccd0000500030000
[09/Jun/2017:11:24:45.464034007 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
Skipping update because the consumer with Rid: [4] is ignored
[09/Jun/2017:11:24:45.465052954 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
Skipping update because the consumer with Rid: [4] is ignored
[09/Jun/2017:11:24:45.466086437 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
Skipping update because the consumer with Rid: [4] is ignored
[09/Jun/2017:11:24:45.467117597 +0000]
agmt="cn=meTofreeipa01.mgmt.example.com" (freeipa01:389) -
Skipping update because the consumer with Rid: [4] is ignored
[09/Jun/2017:11:24:47.326964434 +0000] NSMMReplicationPlugin -
conn=31891 op=111 Acquired consumer connection extension
[09/Jun/2017:11:24:47.328250272 +0000] NSMMReplicationPlugin -
conn=31891 op=111 repl="dc=ipa,dc=example,dc=com": Begin
incremental protocol
[09/Jun/2017:11:24:47.329402730 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:47.547967746 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:48.458900902 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:48.784073495 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:49.899058335 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:49.900125522 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:51.016070114 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:51.017234474 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:52.124155685 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:52.125252246 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:53.215232214 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:53.216294330 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:54.256159985 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:54.257198516 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:55.301698936 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:55.302865381 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:56.358462954 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:56.359879193 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:57.405304224 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:57.406763420 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:58.479617762 +0000]
repl5_inc_result_threadmain: read result for message_id 0
[09/Jun/2017:11:24:58.480672207 +0000]
repl5_inc_result_threadmain: read result for message_id 0
On 06/07/2017 10:58 AM, Nick Campion via FreeIPA-users wrote:
What is the change you making, what attribute are you updating? Could it be possible that its being excluded by fractional replication? Or is it all changes?Hi all,
We have a 3 master setup that is failing to replicate changes from a particular node to the other IPA instances. The replication status says it's all fine, however the record hasn't been changed on the other servers. We've seen this on user password changes, adding hosts and services. The only thing we've found that seems to fix this temporarily is to re-initialize from the master with the changed record. A force-sync doesn't pick up the changed record.
Any errors in the logs on the nodes(good and bad): /var/log/dirsrv/slapd-INSTANCE/errors
Do you see replication sessions starting between the bad node and good ones? Are they talking? Check the access log ( /var/log/dirsrv/slapd-INSTANCE/access) on a good node and look for "connection from <BAD NODE IP address>"
Next would be to enable replication logging on the bad node and reproduce the problem (then disable repl logging right away), then send us the logs to look at. See https://access.redhat.com/documentation/en-us/red_hat_directory_server/10/html/administration_guide/managing_replication-troubleshooting_replication_related_problems
Regards,
Mark
Not sure what logs would be helpful to diagnose what is happening in this setup.
# ipa-replica-manage -v list `hostname`
freeipa03.mgmt.example.com: replica
last init status: None
last init ended: 1970-01-01 00:00:00+00:00
last update status: Error (0) Replica acquired successfully: Incremental update succeeded
last update ended: 2017-06-07 14:43:53+00:00
freeipa02.mgmt.example.com: replica
last init status: None
last init ended: 1970-01-01 00:00:00+00:00
last update status: Error (0) Replica acquired successfully: Incremental update succeeded
last update ended: 2017-06-07 14:43:53+00:00# ldapsearch -W -x -D "cn=directory manager" -b "cn=users,cn=accounts,dc=ipa,dc=example,dc=com" "nsds5ReplConflict=*" \* nsds5ReplConflict
Enter LDAP Password:
# extended LDIF
#
# LDAPv3
# base <cn=users,cn=accounts,dc=ipa,dc=example,dc=com> with scope subtree
# filter: nsds5ReplConflict=*
# requesting: * nsds5ReplConflict
## search result
search: 2
result: 0 Success# numResponses: 1
Any help in what else can be checked or what logs would be helpful would be appreciated.
Thanks
Nick
_______________________________________________ FreeIPA-users mailing list -- freeipa-users@lists.fedorahosted.org To unsubscribe send an email to freeipa-users-leave@lists.fedorahosted.org