I hardly know where to start describing this. I'm having tons of trouble adding a simple fourth replica to my setup, something I've done effortlessly in the past.
The setup: Rocky Linux 8.10 all around, FreeIPA 4.9.13.
Three servers: idm0, idm1 and idm2. I wish to add idm3.
Very small database, maybe 50 users and 200 hosts. Has been going for 7-8 years so many hosts have a couple of expired certificates, but again, very small. I did an "ipa backup" recently and the resulting file was 80MB. I also checked one of my old logs, and then the replication took literally 10 seconds.
Problem 1: replication doesn't work. It takes forever (hours) then either crashes or crashes the source server with an OOM killer fault. It should be noted that some of the source servers had very little memory, 4GB and the same for swap, but I have since upgraded.
My install procedure for idm3 is:
Turn off firewall on idm3 completely, to take that out of the equation.
ipa-client-install --principal admin --no-ntp --no-nisdomain --force-join
ipa-replica-install --debug --principal admin --setup-ca --setup-dns --forwarder=8.8.8.8 --forwarder=8.8.4.4
It makes it to step 26 where it's "replicating" and sits there forever.
Problem 2: ns-slapd consumes 100% CPU for days on end, on some of the existing servers. The pattern of this behavior escapes me.
It should be noted that I might have created an "idm3" host and tried to promote it to replica years ago. I deleted the host, but perhaps some replication agreements are lingering?
Input on which log files I should follow and what I should try greatly appreciated.