FreeIPA-users March 2026

freeipa-users@lists.fedorahosted.org

17 participants
19 discussions

Webservices failing when run behind Caddy v2.11 Reverse Proxy
by Daniel Paetzold 13 Mar '26

13 Mar '26

When Caddy v2.10.X is a reverse Proxy for FreeIPA, then after upgrade to V2.11.? the Webservices will stop working, leading to inifite Redirect 301/307 loops when connecting to https://.../ipa/ui That will cause Browsers to complain about e.g. "Error_Too_Many_Redirects" without any other output. Other Services like IPA- Vaults won't work any more. The Error seems to be in the Apache rewrite- rule as all connections to "https://.../ipa/ui" will get redirected to non-ssl "http://.../ipa/ui" via 301 which again will be redirected to "https://.../ipa/ui" via 307, which is a loop. According to https://github.com/alexandzors/caddy/releases The Problem may be related to: "Reverse proxy now automatically rewrites the Host header to the address of the upstream when the upstream is HTTPS (#7454)" Deactivating Freeipas Apache rewrite Rules for Port 443 as described at https://www.adelton.com/freeipa/freeipa-behind-ssl-proxy does not solve the Problem. Has anyone already had that Problem and an idea how it could be fixed to make the rules work with caddys new behaviour?

1 0

Unexpected IPA loss of service
by Robert Mattson 12 Mar '26

12 Mar '26

Dear IPA Community, We have about ~37 replicas in a system, they’ve been running for some years. They’re all linked together with a maximum of four replication agreements per host, apart from one node which I think had five, according to guidance in a RedHat document. The nodes themselves are CentOS 7.6, running ipa-server-4.6.4-10 and 389-ds-base-1.3.8.4-23. I switched one of the replicas off, and performed an ‘ipa-replica-manage del’ on it, and then some time later performed an ‘ipa-replica-manage del’ on a second server. Further, one of the replicas was off and was turned on during the CleanAllRUV event, which resulted in it getting a total copy of the LDAP database. It appears that the CleanReplicaRUV process went awry, consuming 3-full CPU cores on all replicas. It was not able to service login requests from workstations that were configured with ipa-client (gdm/sssd) and we had to stop IPA on all replicas and start them again. Which resulted in the load clearing and people could then login… Does anyone have experience with a failure of this type. What I thought was a good review of bugs and searching has not indicated a previously known behaviour... The log below is from one of the replicas. It is typical of the other logs, but as one might expect they are not all identical. I don’t like the LDAP can’t connect message, though curl could create a TCP connection, so I’m wondering if krb5kdc was the true culprit in rejecting authentication attempts from replicas. I’m struggling to understand what the nodes were doing, IPA has been rock solid for years… If someone has an opinion, or follow up thoughts/questions, I would like to understand what happened a little better. Cheers, and many thanks in advance, Rob . . [25/Feb/2026:14:19:36.748106280 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:19:37.760430811 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:19:45.443028630 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:20:03.029746436 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 82): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:20:12.324543608 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:20:12.325221674 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:12.341088721 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:12.341386919 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:12.341738587 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:12.342191914 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:12.342540204 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:12.979770303 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:12.982050348 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:12.982418395 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:12.982792849 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:12.983168586 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:12.983530250 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:14.536633724 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:14.538767178 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:14.539140239 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:14.539519552 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:14.539898156 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:14.540245661 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:14.807654094 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:14.810099203 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:14.810447865 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:14.810812918 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:14.811207578 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:14.811524864 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:15.372569055 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:15.374307257 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:15.374691273 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:15.375063538 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:15.375450475 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:15.375833439 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:15.888855195 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:15.892145005 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:15.892537588 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:15.892929529 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:15.893349111 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:15.893705369 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:16.404269350 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:16.407066921 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:16.407438615 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:16.408021279 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:16.408357222 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:16.408734245 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:18.096966986 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [26/Feb/2026:14:20:18.099289455 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:18.099593690 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:18.099938022 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:18.100232214 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:18.100584190 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:18.196958838 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:18.199047269 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:18.199358840 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:18.199653733 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:18.200315573 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:18.200633799 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:18.516002380 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:18.516333785 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:18.517360076 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:18.517633515 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:18.518037079 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:18.518295540 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:18.518645789 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:18.518892547 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:18.519188645 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:18.519513164 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:18.519839033 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:18.520114070 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:20.478632383 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:20.480432487 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:20.480791991 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:20.481126088 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:20.481473271 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:20.481783961 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:26.580450544 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:20:27.502335146 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:27.503914991 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:27.504208795 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:27.505540834 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:27.505900991 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:27.506316400 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:27.584523887 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:20:27.789812435 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:27.790301653 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:27.792602083 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:27.792982434 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:27.793413867 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:27.794308849 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:27.794796465 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:27.795538774 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:27.795842282 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:27.796202293 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:27.796585257 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:27.796974478 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:28.218117342 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:28.220478632 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:28.220761258 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:28.220967687 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:28.221167066 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:28.221365163 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:34.341582640 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:34.343652101 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:34.344018697 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:34.344386108 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:34.344757472 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:34.345101499 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:36.763529402 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:36.766522825 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:36.766882823 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:36.767247214 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:36.767610893 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:36.767976280 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:36.963529284 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:20:37.863381553 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:37.866261049 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:37.866718498 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:37.867072866 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:37.869390993 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:37.869665941 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:37.968467040 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:20:38.018568689 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:38.021144102 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:38.021506381 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:38.021872603 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:38.022184674 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:38.022505250 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:38.480633372 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:20:38.551778395 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:38.553808378 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:38.554182258 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:38.554556067 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:38.554934053 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:38.555336117 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:38.668661840 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:38.671026122 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:38.671390837 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:38.671766204 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:38.672163965 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:38.672517688 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:39.486373656 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:20:39.723557917 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:39.726333051 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:39.726598186 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:39.727027587 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:39.727306621 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:39.727596934 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:40.345538418 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:40.347316484 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:40.347666818 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:40.348040330 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:40.348364315 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:40.348731786 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:42.058162450 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:20:42.060765594 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:20:42.061116879 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:20:42.061853402 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:20:42.062200635 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:20:42.062510411 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:20:45.670118947 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:20:45.670838869 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:20:46.021507692 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Propagated task does not delete Keep alive entry (83). [25/Feb/2026:14:20:46.021790418 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:20:46.139610876 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:20:46.675067304 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:20:46.679088389 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:20:47.157642828 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:20:48.075366603 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaned replication agreements. [25/Feb/2026:14:20:48.075688071 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Successfully cleaned rid(83). [25/Feb/2026:14:20:53.297468231 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:20:53.310218081 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:20:53.313701708 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:20:53.808873766 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:20:54.311384144 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:20:54.318838055 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:20:54.830942926 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:20:56.679273702 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:20:57.115493809 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to find any entries with nsds5ReplicaCleanRUV under (cn=replica,cn="dc=vcs,dc=system",cn=mapping tree,cn=config) [25/Feb/2026:14:20:57.115859284 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to remove replica config (-1), rid (83) [25/Feb/2026:14:20:57.116149721 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:20:57.687998750 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:21:01.695572845 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to find any entries with nsds5ReplicaCleanRUV under (cn=replica,cn="dc=vcs,dc=system",cn=mapping tree,cn=config) [25/Feb/2026:14:21:01.695889610 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to remove replica config (-1), rid (83) [25/Feb/2026:14:21:01.696163927 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:21:07.610790353 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to find any entries with nsds5ReplicaCleanRUV under (cn=replica,cn="dc=vcs,dc=system",cn=mapping tree,cn=config) [25/Feb/2026:14:21:07.611206358 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to remove replica config (-1), rid (83) [25/Feb/2026:14:21:07.611570808 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:21:09.128522831 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to find any entries with nsds5ReplicaCleanRUV under (cn=replica,cn="dc=vcs,dc=system",cn=mapping tree,cn=config) [25/Feb/2026:14:21:09.128882426 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to remove replica config (-1), rid (83) [25/Feb/2026:14:21:09.129225762 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:21:14.623040690 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:21:14.638046950 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:21:14.638384370 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:21:14.638755217 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:21:14.639138946 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:21:14.639545406 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:21:19.876309571 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:21:19.876736849 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:21:20.661465919 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:21:20.899863931 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:21:21.665998631 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:21:21.903999952 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:21:26.915793659 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:21:26.916349149 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 82): Propagated task does not delete Keep alive entry (82). [25/Feb/2026:14:21:26.916669203 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 82): Cleaning agmt... [25/Feb/2026:14:21:27.535405513 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 82): Cleaning agmt... [25/Feb/2026:14:21:28.154017724 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 82): Cleaning agmt... [25/Feb/2026:14:21:28.273080679 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 82): Cleaned replication agreements. [25/Feb/2026:14:21:28.273420015 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 82): Successfully cleaned rid(82). [25/Feb/2026:14:21:28.929860540 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:21:29.935077582 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:21:35.634671306 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Propagated task does not delete Keep alive entry (83). [25/Feb/2026:14:21:35.635041354 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:21:40.098937328 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:21:40.099375187 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Propagated task does not delete Keep alive entry (83). [25/Feb/2026:14:21:40.099719711 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:21:40.120226654 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:21:40.338345798 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:21:40.455813901 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaned replication agreements. [25/Feb/2026:14:21:40.456164965 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Successfully cleaned rid(83). [25/Feb/2026:14:21:43.507119110 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:21:44.630589067 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:21:45.659017476 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:21:58.810003469 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:22:04.163535790 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:04.811535783 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to find any entries with nsds5ReplicaCleanRUV under (cn=replica,cn="dc=vcs,dc=system",cn=mapping tree,cn=config) [25/Feb/2026:14:22:04.811858758 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to remove replica config (-1), rid (83) [25/Feb/2026:14:22:04.812154370 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:22:04.812732020 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:22:05.817860896 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:22:14.039822612 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:17.313286911 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:22:18.319055408 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:22:18.371958398 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:20.210903986 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:22:20.269174340 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:21.215281752 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:22:23.725167649 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:25.773145706 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:26.310919868 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:22:27.316811724 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:22:27.821068199 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:29.299062249 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:22:30.242986878 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:30.304634616 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:22:31.035033718 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:22:32.040356277 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:22:32.755447585 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:22:33.453754707 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to find any entries with nsds5ReplicaCleanRUV under (cn=replica,cn="dc=vcs,dc=system",cn=mapping tree,cn=config) [25/Feb/2026:14:22:33.454140427 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to remove replica config (-1), rid (83) [25/Feb/2026:14:22:33.454436482 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:22:33.761141321 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:22:35.501215512 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:38.074305821 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:22:38.090599014 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:22:38.090907246 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:22:38.091301758 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:22:38.091605459 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:22:38.091822625 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:22:38.854381333 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:22:39.262339861 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:22:39.747034790 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:40.266752975 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:22:40.834432207 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to find any entries with nsds5ReplicaCleanRUV under (cn=replica,cn="dc=vcs,dc=system",cn=mapping tree,cn=config) [25/Feb/2026:14:22:40.834739858 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to remove replica config (-1), rid (83) [25/Feb/2026:14:22:40.835106901 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:22:44.077142338 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:45.229151868 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:45.869165644 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:45.891032286 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:22:45.997164218 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:46.895050784 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:22:47.021156333 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:47.661163824 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:22:48.137512514 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:22:48.284155464 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:22:48.311548256 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:22:49.142040693 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:22:49.290052908 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:22:49.318056407 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:22:49.451982276 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:22:49.842861942 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Propagated task does not delete Keep alive entry (83). [25/Feb/2026:14:22:49.843243116 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:22:49.864109013 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:22:49.976561523 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:22:50.197896141 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaned replication agreements. [25/Feb/2026:14:22:50.198226936 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Successfully cleaned rid(83). [25/Feb/2026:14:22:50.241722337 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning local ruv's... [25/Feb/2026:14:22:50.457061076 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:22:51.247033256 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be cleaned... [25/Feb/2026:14:22:52.020384857 +0000] - INFO - NSMMReplicationPlugin - multimaster_extop_cleanruv - CleanAllRUV Task - Launching cleanAllRUV thread... [25/Feb/2026:14:22:52.037415344 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning rid (83)... [25/Feb/2026:14:22:52.037818385 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting to process all the updates from the deleted replica... [25/Feb/2026:14:22:52.038292145 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to be online... [25/Feb/2026:14:22:52.038686767 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to receive all the deleted replica updates... [25/Feb/2026:14:22:52.039064291 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Sending cleanAllRUV task to all the replicas... [25/Feb/2026:14:22:56.405622345 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:22:58.623408504 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Propagated task does not delete Keep alive entry (83). [25/Feb/2026:14:22:58.623741007 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:22:58.642211684 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:22:58.760230661 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:22:58.879718458 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaned replication agreements. [25/Feb/2026:14:22:58.880123637 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Successfully cleaned rid(83). [25/Feb/2026:14:23:01.613514004 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:23:02.125120912 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:23:04.429161005 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:23:04.429557725 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Propagated task does not delete Keep alive entry (83). [25/Feb/2026:14:23:04.429888863 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:23:04.449621317 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:23:04.566895580 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:23:04.886506117 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaned replication agreements. [25/Feb/2026:14:23:04.886882765 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Successfully cleaned rid(83). [25/Feb/2026:14:23:04.971072055 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to find any entries with nsds5ReplicaCleanRUV under (cn=replica,cn="dc=vcs,dc=system",cn=mapping tree,cn=config) [25/Feb/2026:14:23:04.971443965 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to remove replica config (-1), rid (83) [25/Feb/2026:14:23:04.971821504 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:23:05.944988119 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to find any entries with nsds5ReplicaCleanRUV under (cn=replica,cn="dc=vcs,dc=system",cn=mapping tree,cn=config) [25/Feb/2026:14:23:05.950931461 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to remove replica config (-1), rid (83) [25/Feb/2026:14:23:05.957624913 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:23:06.514335439 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to find any entries with nsds5ReplicaCleanRUV under (cn=replica,cn="dc=vcs,dc=system",cn=mapping tree,cn=config) [25/Feb/2026:14:23:06.514718698 +0000] - ERR - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): delete_cleaned_rid_config - Failed to remove replica config (-1), rid (83) [25/Feb/2026:14:23:06.515090803 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Waiting for all the replicas to finish cleaning... [25/Feb/2026:14:23:14.925143973 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:23:14.925568118 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Propagated task does not delete Keep alive entry (83). [25/Feb/2026:14:23:14.925934695 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:23:14.946588798 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:23:15.063026627 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:23:15.180046656 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaned replication agreements. [25/Feb/2026:14:23:15.180373009 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Successfully cleaned rid(83). [25/Feb/2026:14:23:16.461149653 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:23:16.461545050 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Propagated task does not delete Keep alive entry (83). [25/Feb/2026:14:23:16.461828282 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:23:16.482048604 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:23:16.866994870 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:23:17.401359458 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:23:17.635041115 +0000] - ERR - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=csu01.melb.vcs.system-to-csu02.can.vcs.system" (csu02:389) - Replication bind with GSSAPI auth failed: LDAP error -1 (Can't contact LDAP server) () [25/Feb/2026:14:23:17.635490622 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Propagated task does not delete Keep alive entry (83). [25/Feb/2026:14:23:17.635847861 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:23:17.655922712 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:23:19.074870502 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaning agmt... [25/Feb/2026:14:23:19.092701048 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaned replication agreements. [25/Feb/2026:14:23:19.093015503 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Successfully cleaned rid(83). [25/Feb/2026:14:23:20.221555168 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Cleaned replication agreements. [25/Feb/2026:14:23:20.221887660 +0000] - INFO - NSMMReplicationPlugin - CleanAllRUV Task (rid 83): Successfully cleaned rid(83). . . .

1 0

SystemCertClient.__init__() has been deprecated
by lejeczek 12 Mar '26

12 Mar '26

Hi guys. At first I thought maybe because I had mixed 4.12 & 4.12 domain but now with only 4.13 I get: -> $ ipa-healthcheck /usr/lib/python3.9/site-packages/pki/server/healthcheck/meta/connectivity.py:131: The PKIConnection parameter in SystemCertClient.__init__() has been deprecated. Provide SubsystemClient instead. [] Anybody sees the same/similar? _ipa-healthcheck_ seems to do its work but how critical this above might be? Containers are built off Centos 9. thanks, L.

3 2

demote & remove DNSSEC keymaster
by lejeczek 12 Mar '26

12 Mar '26

Hi guys. Is there a doc, a howto for how to demote - I presume that has to be done first - a key-master replica? If there is not - does anybody has suggestions for such a "procedure"? many thanks, L.

2 1

setup failed: HSM error - ods-enforcerd.service
by lejeczek 12 Mar '26

12 Mar '26

Hi guys. I wonder if you guys have seen something like here below? Starting OpenDNSSEC Enforcer daemon... [engine] running as pid 5470 [engine] enforcer started Configuration.cpp(96): Missing log.level in configuration. Using default value: INFO Configuration.cpp(96): Missing slots.mechanisms in configuration. Using default value: ALL Configuration.cpp(124): Missing slots.removable in configuration. Using default value: false [engine] hsm_get_slot_id(): could not find token with the name OpenDNSSEC setup failed: HSM error [engine] enforcer shutdown [engine] enforcerd (pid: 5470) stopped with exitcode 3 [engine] fail to start enforcerd completely OpenDNSSEC key and signing policy enforcer version 2.1.10 hsm_get_slot_id(): could not find token with the name OpenDNSSEC ods-enforcerd.service: Control process exited, code=exited, status=1/FAILURE ods-enforcerd.service: Failed with result 'exit-code'. Failed to start OpenDNSSEC Enforcer daemon. I've upgraded my OS, this is IPA in a container, certainly along with with update many binaries & envs are different now. I did remove & recreate the container but still cannot start this one 'ods-enforcerd.service' and then some more verbosity: ipaserver.dnssec.keysyncer: INFO Initial LDAP dump is done, sychronizing with ODS and BIND Traceback (most recent call last): File "/usr/libexec/ipa/ipa-dnskeysyncd", line 130, in <module> while ldap_connection.syncrepl_poll(all=1, msgid=ldap_search): File "/usr/lib64/python3.9/site-packages/ldap/syncrepl.py", line 464, in syncrepl_poll self.syncrepl_refreshdone() File "/usr/lib/python3.9/site-packages/ipaserver/dnssec/keysyncer.py", line 125, in syncrepl_refreshdone self.ods_sync() File "/usr/lib/python3.9/site-packages/ipaserver/dnssec/keysyncer.py", line 183, in ods_sync self.odsmgr.sync() File "/usr/lib/python3.9/site-packages/ipaserver/dnssec/odsmgr.py", line 221, in sync zl_ods = self.get_ods_zonelist() File "/usr/lib/python3.9/site-packages/ipaserver/dnssec/odsmgr.py", line 143, in get_ods_zonelist stdout = self.ksmutil(['zonelist', 'export']) File "/usr/lib/python3.9/site-packages/ipaserver/dnssec/odsmgr.py", line 139, in ksmutil result = tasks.run_ods_manager(params, capture_output=True) File "/usr/lib/python3.9/site-packages/ipaserver/dnssec/_ods21.py", line 121, in run_ods_manager return ipautil.run(cmd, **kwargs) File "/usr/lib/python3.9/site-packages/ipapython/ipautil.py", line 612, in run raise CalledProcessError( ipapython.ipautil.CalledProcessError: CalledProcessError(Command ['/usr/sbin/ods-enforcer', 'zonelist', 'export'] returned non-zero exit status 201: 'Unable to connect to engine. connect() failed: Connection refused ("/var/run/opendnssec/enforcer.sock")\n') All & any thought how to troubleshoot it are much appreciated. thanks, L.

3 3

configure ipa-healthcheck?
by lejeczek 12 Mar '26

12 Mar '26

I see there is a config file and I searched, but failed to find an info on how to, ideally permanently, tell ipa-healthcheck what is the threshold for filesystem - do you now? thanks, L.

2 1

new replication agreement = CSN errors
by lejeczek 12 Mar '26

12 Mar '26

Hi guys. I have 3-node IPA domain, one replica was logging errors about missing missing CSN. I removed that one, both-ways agreement, both for _domain_ & _ca_ - errors went away. I gave replications a several hours - just in case - I re-initialized that erroring replica via the agreement which seemed healthy - which went error-free. Now trying to add that third agreement, as soon as I do (which itself says went a okey) errors reappear. ... - ERR - agmt="cn=ipa-dzien.mine.priv-to-ipa-whale.mine.priv" (ipa-whale:389) - clcache_load_buffer - Can't locate CSN 69aca246000000110000 in the changelog (DB rc=-12797). If replication stops, the consumer may need to be reinitialized. - ERR - NSMMReplicationPlugin - changelog program - repl_plugin_name_cl - agmt="cn=ipa-dzien.mine.priv-to-ipa-whale.mine.priv" (ipa-whale:389): CSN 69aca246000000110000 not found, we aren't as up to date, or we purged - ERR - NSMMReplicationPlugin - send_updates - agmt="cn=ipa-dzien.mine.priv-to-ipa-whale.mine.priv" (ipa-whale:389): Data required to update replica has been purged from the changelog. If the error persists the replica must be reinitialized. - ERR - ipa-topology-plugin - ipa_topo_agmt_del: cn=ipa-dzien.mine.priv-to-ipa-whale.mine.priv ... Any other errors - from journalctl - which this replica logs are: ... ipa-dnskeysyncd: CRITICAL Kerberos authentication failed: Major (458752): No credentials were supplied, or the credentials were unavailable or inaccessible, Minor (2529638936): Preauthentication failed GSSAPI client step 2 ... VERSION: 4.12.2, API_VERSION: 2.254 Any thoughts shared as to what might be "broken" there are much appreciated. thanks, L.

2 1

ipa-replica-install fails early
by lejeczek 11 Mar '26

11 Mar '26

Hi guys. ipa-replica-install fails early -in container on centos 10 - yet first server install succeeds. Before I spam here with logs & such I thought I show this: -> $ { export _DOM=mine.priv _H=ipa-dzien _IP=10.2.1.202; _NAME="freeipa.${_DOM}".c9s; export _PATH=/devs/ROOTFUL.containers/${_NAME}; echo; mkdir -p ${_PATH}/{,root,data}; }; podman run -ti --tz=local --cap-add=CAP_SYS_TIME --add-host=${_H}.${_DOM}:${_IP} --network=off-host-1021 --ip=${_IP} --volume=${_PATH}/root:/root --volume=${_PATH}/data:/data:z --volume=${_PATH}/etc_resolv.conf:/etc/resolv.conf --volume=${_PATH}/etc_hosts:/etc/hosts --hostname ${_H}.${_DOM} --name ${_NAME} localhost/freeipa-server-c9s ipa-replica-install --setup-dns --no-forwarders --no-ntp --force-join Failed to set RLIMIT_CORE: Operation not permitted systemd 252-59.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) Detected virtualization container-other. Detected architecture x86-64. Initializing machine ID from container UUID. Queued start job for default target Minimal target for containerized FreeIPA server. Wed Mar 11 17:34:40 CET 2026 /usr/sbin/ipa-server-configure-first Configuring client side components This program will set up IPA client. Version 4.13.1 One of password / principal / keytab is required. The ipa-client-install command failed. See /var/log/ipaclient-install.log for more information Removing client side components IPA client is not configured on this system. The ipa-client-install command failed. Your system may be partly configured. Run /usr/sbin/ipa-server-install --uninstall to clean up. Configuration of client side components failed! The ipa-replica-install command failed. See /var/log/ipareplica-install.log for more information Sending SIGTERM to remaining processes... Sending SIGKILL to remaining processes... All filesystems, swaps, loop devices, MD devices and DM devices detached. Exiting container. Is: Failed to set RLIMIT_CORE: Operation not permitted the culprit and if so then what might be a fix? My sudo conf already has _Set disable_coredump false_ which I read was the workaround previously many thanks, L.

2 1

Anybody has mixed 4.12 & newer in the same domain?
by lejeczek 11 Mar '26

11 Mar '26

HI guys. As per the subject - different versions replicas - and successfully of course? thanks, L.

2 1

Error in replication after ipa-replica-install
by Andrea Tuccia 11 Mar '26

11 Mar '26

Hello, I'm managing to create a FreeIPA replica, I just installed successfully a client, it's perfectly working. Then, I tried to promote it to replica server: kinit admin ipa-replica-install -U ... .... [39/39]: restarting directory server Here it took a long time (minutes), then: Done configuring directory server (dirsrv). Configuring Kerberos KDC (krb5kdc) [1/6]: configuring KDC [2/6]: adding the password extension to the directory [3/6]: creating anonymous principal [4/6]: starting the KDC [5/6]: configuring KDC to start on boot [6/6]: enable PAC ticket signature support Done configuring Kerberos KDC (krb5kdc). Configuring kadmin [1/2]: starting kadmin [2/2]: configuring kadmin to start on boot Done configuring kadmin. Configuring directory server (dirsrv) [1/3]: configuring TLS for DS instance [error] RuntimeError: Certificate issuance failed (TIMEOUT: None) Your system may be partly configured. Run /usr/sbin/ipa-server-install --uninstall to clean up. On the master in /var/log/dirsrv/slapd-DNSHOSTING-LOCAL/errors, I found: [09/Mar/2026:16:05:34.766497477 +0100] - ERR - NSMMReplicationPlugin - multimaster_extop_StartNSDS50ReplicationRequest - conn=16926 op=5 replica="dc=dnshosting,dc=local": Unable to acquire replica: error: permission denied [09/Mar/2026:16:05:34.813324097 +0100] - ERR - NSMMReplicationPlugin - multimaster_extop_StartNSDS50ReplicationRequest - conn=16927 op=5 replica="dc=dnshosting,dc=local": Unable to acquire replica: error: permission denied [09/Mar/2026:16:05:35.591739096 +0100] - WARN - NSMMReplicationPlugin - repl5_inc_run - agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389): The remote replica has a different database generation ID than the local database. You may have to reinitialize the remote replica, or the local replica. [09/Mar/2026:16:05:36.473116954 +0100] - INFO - NSMMReplicationPlugin - repl5_tot_run - Beginning total update of replica "agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389)". [09/Mar/2026:16:05:44.191444432 +0100] - INFO - NSMMReplicationPlugin - repl5_tot_run - Finished total update of replica "agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389)". Sent 1127 entries. [09/Mar/2026:16:05:46.609757815 +0100] - ERR - NSMMReplicationPlugin - acquire_replica - agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389): Unable to acquire replica: permission denied. The bind dn "" does not have permission to supply replication updates to the replica. Will retry later. [09/Mar/2026:16:07:49.517285460 +0100] - WARN - NSMMReplicationPlugin - acquire_replica - agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389): Unable to receive the response for a startReplication extended operation to consumer (Timed out). Will retry later. [09/Mar/2026:16:09:49.463621786 +0100] - WARN - NSMMReplicationPlugin - acquire_replica - agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389): Unable to receive the response for a startReplication extended operation to consumer (Timed out). Will retry later. [09/Mar/2026:16:11:49.404501384 +0100] - WARN - NSMMReplicationPlugin - acquire_replica - agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389): Unable to receive the response for a startReplication extended operation to consumer (Timed out). Will retry later. [09/Mar/2026:16:13:49.346100000 +0100] - WARN - NSMMReplicationPlugin - acquire_replica - agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389): Unable to receive the response for a startReplication extended operation to consumer (Timed out). Will retry later. [09/Mar/2026:16:15:47.247435494 +0100] - WARN - NSMMReplicationPlugin - acquire_replica - agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389): Unable to receive the response for a startReplication extended operation to consumer (Can't contact LDAP server). Will retry later. [09/Mar/2026:16:15:50.383507834 +0100] - INFO - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389): Replication bind with GSSAPI auth resumed [09/Mar/2026:16:18:14.243723406 +0100] - WARN - NSMMReplicationPlugin - acquire_replica - agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389): Unable to receive the response for a startReplication extended operation to consumer (Timed out). Will retry later. [09/Mar/2026:16:20:17.185770854 +0100] - WARN - NSMMReplicationPlugin - acquire_replica - agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389): Unable to receive the response for a startReplication extended operation to consumer (Timed out). Will retry later. [09/Mar/2026:16:22:17.128420594 +0100] - WARN - NSMMReplicationPlugin - acquire_replica - agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389): Unable to receive the response for a startReplication extended operation to consumer (Timed out). Will retry later. [09/Mar/2026:16:24:17.068371488 +0100] - WARN - NSMMReplicationPlugin - acquire_replica - agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389): Unable to receive the response for a startReplication extended operation to consumer (Timed out). Will retry later. [09/Mar/2026:16:25:54.459627837 +0100] - WARN - NSMMReplicationPlugin - acquire_replica - agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389): Unable to receive the response for a startReplication extended operation to consumer (Can't contact LDAP server). Will retry later. [09/Mar/2026:16:25:56.226517031 +0100] - INFO - NSMMReplicationPlugin - bind_and_check_pwp - agmt="cn=meTonewipa03.dnshosting.local" (newipa03:389): Replication bind with GSSAPI auth resumed I tried dozens of times, everytime I done ipa-replica-install --uninstall on the replica and ipa-replica-manage del on the master. No way. And when the replica fails, the dirsrv on the replica is stuck, cannot stop with systemctl and I have to kill -KILL it. The master is a CentOS 8 I have to dismiss. The replica is CentOS Stream 10. ipa-replica-conncheck is ok, klist on the replica shows the token (and is usable, I tried also with ssh), I've run out of ideas!

3 4

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

FreeIPA-users March 2026