Consumer failed to replay change Operations error (1)

[Alfred Victor]

Hi FreeIPA,

We have some replication messages in our slapd errors log which look very
like the ones discussed here:

https://bugzilla.redhat.com/show_bug.cgi?id=1574602

I took a look and we do have the MemberOf plugin, but our version of 389-ds
newer:

*389-ds-base-1.3.10.2-10.el7_9.x86_64*

Hoping someone might have a suggestion for what we might do to get rid of
these log messages, or what the root cause may be/impact? They've been
going since at least a couple of weeks ago:

[15/Jun/2021:18:57:26.362094959 -0500] - WARN - NSMMReplicationPlugin
- repl5_inc_update_from_op_result -
agmt="cn=redactedauth0001.redacted.com-to-redactedauth0003.redacted.com"
(redactedauth0003:389): Consumer failed to replay change (uniqueid
d5896001-39a111eb-8868efc8-91dc0b98, CSN 60c93bc2000400250000):
Operations error (1). Will retry later.

I looked for this same uniqueid (they are ALL the same uniqueID) and
found this which is interesting and references a specific cn and
"optype":
> [03/Jun/2021:15:45:43.332068775 -0500] - ERR - NSMMReplicationPlugin - write_changelog_and_ruv - Can't add a change for cn=admin,cn=groups,cn=accounts,dc=redacted,dc=com (uniqid: d5896001-39a111eb-8868efc8-91dc0b98, optype: 8) to changelog csn 60b93f93005200230000

Alfred

[Florence Renaud]

Forwarding to [e-mail]
https://lists.fedoraproject.org/admin/lists/389-users.lists.fedoraproject.org
as they may have more inputs.

On Wed, Jun 16, 2021 at 11:31 PM Alfred Victor via FreeIPA-users <
[e-mail]> wrote:
> Hi FreeIPA,
>
> We have some replication messages in our slapd errors log which look very
> like the ones discussed here:
>
> https://bugzilla.redhat.com/show_bug.cgi?id=1574602
>
> I took a look and we do have the MemberOf plugin, but our version of
> 389-ds newer:
>
> *389-ds-base-1.3.10.2-10.el7_9.x86_64*
>
> Hoping someone might have a suggestion for what we might do to get rid of
> these log messages, or what the root cause may be/impact? They've been
> going since at least a couple of weeks ago:
>
> [15/Jun/2021:18:57:26.362094959 -0500] - WARN - NSMMReplicationPlugin - repl5_inc_update_from_op_result - agmt="cn=redactedauth0001.redacted.com-to-redactedauth0003.redacted.com" (redactedauth0003:389): Consumer failed to replay change (uniqueid d5896001-39a111eb-8868efc8-91dc0b98, CSN 60c93bc2000400250000): Operations error (1). Will retry later.
>
> I looked for this same uniqueid (they are ALL the same uniqueID) and found this which is interesting and references a specific cn and "optype":
> > [03/Jun/2021:15:45:43.332068775 -0500] - ERR - NSMMReplicationPlugin - write_changelog_and_ruv - Can't add a change for cn=admin,cn=groups,cn=accounts,dc=redacted,dc=com (uniqid: d5896001-39a111eb-8868efc8-91dc0b98, optype: 8) to changelog csn 60b93f93005200230000
>
> Alfred
>
> FreeIPA-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct:
> https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
> https://lists.fedorahosted.org/archives/list/[e-mail]...
> Do not reply to spam on the list, report it:
> https://pagure.io/fedora-infrastructure

[Thierry Bordaz]

Hello Alfred,

If it is IPA deployment I doubt that you hit [1] because it only applies 
on read-only replica (hub/consumer). Also this bug is fixed in the 
version you are running.

The consumer (redactedauth0003.redacted.com 
http://redactedauth0001.redacted.com-to-redactedauth0003.redacted.com) 
fails to apply a replicated MOD targeting the admin group. It is not 
clear if the failure occurs at changelog update or RUV update. It is 
looking it is a permanent failure so you may enable replication debug 
log in case it gives more details why it is failing.

regards
thierry

[1] https://bugzilla.redhat.com/show_bug.cgi?id=1574602 
https://bugzilla.redhat.com/show_bug.cgi?id=1574602

On 6/17/21 11:12 AM, Florence Renaud via FreeIPA-users wrote:
> Forwarding to [e-mail] 
> https://lists.fedoraproject.org/admin/lists/389-users.lists.fedoraproject.org 
> as they may have more inputs.
>
> On Wed, Jun 16, 2021 at 11:31 PM Alfred Victor via FreeIPA-users 
> <[e-mail] 
> > wrote:
> Hi FreeIPA,
>
> We have some replication messages in our slapd errors log which
> look very like the ones discussed here:
>
> https://bugzilla.redhat.com/show_bug.cgi?id=1574602
> <https://bugzilla.redhat.com/show_bug.cgi?id=1574602>
>
> I took a look and we do have the MemberOf plugin, but our version
> of 389-ds newer:
>
>     *389-ds-base-1.3.10.2-10.el7_9.x86_64*
>
> *
> *
>
> *
> *
>
> Hoping someone might have a suggestion for what we might do to get
> rid of these log messages, or what the root cause may be/impact?
> They've been going since at least a couple of weeks ago:
> *
> *
>
>     [15/Jun/2021:18:57:26.362094959 -0500] - WARN -
>     NSMMReplicationPlugin - repl5_inc_update_from_op_result -
>     agmt="cn=redactedauth0001.redacted.com-to-redactedauth0003.redacted.com
>     <http://redactedauth0001.redacted.com-to-redactedauth0003.redacted.com>"
>     (redactedauth0003:389): Consumer failed to replay change
>     (uniqueid d5896001-39a111eb-8868efc8-91dc0b98, CSN
>     60c93bc2000400250000): Operations error (1). Will retry later.
>
>
>
>
> I looked for this same uniqueid (they are ALL the same uniqueID) and found this which is interesting and references a specific cn and "optype":
>
>
>     [03/Jun/2021:15:45:43.332068775 -0500] - ERR -
>     NSMMReplicationPlugin - write_changelog_and_ruv - Can't add a
>     change for cn=admin,cn=groups,cn=accounts,dc=redacted,dc=com
>     (uniqid: d5896001-39a111eb-8868efc8-91dc0b98, optype: 8) to
>     changelog csn 60b93f93005200230000
>
>
>
> Alfred
>
> _______________________________________________
> FreeIPA-users mailing list -- [e-mail]
> <mailto:[e-mail]>
> To unsubscribe send an email to
> [e-mail]
> <mailto:[e-mail]>
> Fedora Code of Conduct:
> https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> <https://docs.fedoraproject.org/en-US/project/code-of-conduct/>
> List Guidelines:
> https://fedoraproject.org/wiki/Mailing_list_guidelines
> <https://fedoraproject.org/wiki/Mailing_list_guidelines>
> List Archives:
> https://lists.fedorahosted.org/archives/list/[e-mail]
> <https://lists.fedorahosted.org/archives/list/[e-mail]>
> Do not reply to spam on the list, report it:
> https://pagure.io/fedora-infrastructure
> <https://pagure.io/fedora-infrastructure>
>
>
> FreeIPA-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedorahosted.org/archives/list/[e-mail]...
> Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure