Problem with ldapsearch and scope one in 1.4.0.20

[Mihai Carabas]

Hello,

Recently I've upgraded 389ds to 389ds-1.4.0.20 on a fc29. It seems
that the bug https://pagure.io/389-ds-base/issue/49617 and also
https://pagure.io/389-ds-base/issue/49443

[root@ldap ~]# rpm -qa | grep 389
389-ds-console-doc-1.2.16-5.fc29.noarch
389-admin-1.1.46-2.fc29.x86_64
389-ds-1.2.2-14.fc29.noarch
389-console-1.1.19-1.fc29.noarch
python3-lib389-1.4.0.20-1.fc29.noarch
389-ds-base-legacy-tools-1.4.0.20-1.fc29.x86_64
389-admin-console-doc-1.1.12-5.fc29.noarch
389-admin-console-1.1.12-5.fc29.noarch
389-ds-base-1.4.0.20-1.fc29.x86_64
389-adminutil-1.1.23-11.fc29.x86_64
389-ds-base-libs-1.4.0.20-1.fc29.x86_64
389-dsgw-1.1.11-19.fc29.x86_64
389-ds-console-1.2.16-5.fc29.noarch
[root@ldap ~]#
[root@ldap ~]# cat /etc/redhat-release
Fedora release 29 (Twenty Nine)

If I do a search with a filter and scope one, all the entries in that
base are returned:

[root@ldap ~]# ldapsearch  ... -s one -b
"ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro" ou=Profesori dn

# Profesori, DPPD, People, curs.pub.ro
dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro

# Asistenti-Man, DPPD, People, curs.pub.ro
dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro

# Profesori-Man, DPPD, People, curs.pub.ro
dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro

# Externi, DPPD, People, curs.pub.ro
dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro

# Auxiliari, DPPD, People, curs.pub.ro
dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro

# search result
search: 2
result: 0 Success

# numResponses: 6
# numEntries: 5

If I replace one with sub, all is correct. Can you advise me in this issue?

Thank you,
Mihai

[William Brown]

> On 22 Jan 2019, at 09:15, Mihai Carabas  wrote:
>
> Hello,
>
> Recently I've upgraded 389ds to 389ds-1.4.0.20 on a fc29. It seems
> that the bug https://pagure.io/389-ds-base/issue/49617 and also
> https://pagure.io/389-ds-base/issue/49443
>
> [root@ldap ~]# rpm -qa | grep 389
> 389-ds-console-doc-1.2.16-5.fc29.noarch
> 389-admin-1.1.46-2.fc29.x86_64
> 389-ds-1.2.2-14.fc29.noarch
> 389-console-1.1.19-1.fc29.noarch
> python3-lib389-1.4.0.20-1.fc29.noarch
> 389-ds-base-legacy-tools-1.4.0.20-1.fc29.x86_64
> 389-admin-console-doc-1.1.12-5.fc29.noarch
> 389-admin-console-1.1.12-5.fc29.noarch
> 389-ds-base-1.4.0.20-1.fc29.x86_64
> 389-adminutil-1.1.23-11.fc29.x86_64
> 389-ds-base-libs-1.4.0.20-1.fc29.x86_64
> 389-dsgw-1.1.11-19.fc29.x86_64
> 389-ds-console-1.2.16-5.fc29.noarch
> [root@ldap ~]#
> [root@ldap ~]# cat /etc/redhat-release
> Fedora release 29 (Twenty Nine)
>
> If I do a search with a filter and scope one, all the entries in that
> base are returned:
>
> [root@ldap ~]# ldapsearch  ... -s one -b
> "ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro" ou=Profesori dn
>
> # Profesori, DPPD, People, curs.pub.ro
> dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
>
> # Asistenti-Man, DPPD, People, curs.pub.ro
> dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
>
> # Profesori-Man, DPPD, People, curs.pub.ro
> dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
>
> # Externi, DPPD, People, curs.pub.ro
> dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
>
> # Auxiliari, DPPD, People, curs.pub.ro
> dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
>
> # search result
> search: 2
> result: 0 Success
>
> # numResponses: 6
> # numEntries: 5
>
> If I replace one with sub, all is correct. Can you advise me in this issue?

I think this is correct. You have used a search base of ou=DPPD, and you are seeing all the entries “one level below ou=DPPD”, but not including that entry, and not including any child entries of x=x,ou=DPPD.

You may either want -s base, to show only ou=DPPD, or -s sub which show-s ou=DPPD and all entries in that subtree.

I hope this helps, but I think there is no issue here.
>

—
Sincerely,

William Brown
Software Engineer, 389 Directory Server
SUSE Labs

[Mihai Carabas]

Mihai Carabas
> On 22 Jan 2019, at 00:06, William Brown  wrote:
> > On 22 Jan 2019, at 09:15, Mihai Carabas  wrote:
> >
> > Hello,
> >
> > Recently I've upgraded 389ds to 389ds-1.4.0.20 on a fc29. It seems
> > that the bug https://pagure.io/389-ds-base/issue/49617 and also
> > https://pagure.io/389-ds-base/issue/49443
> >
> > [root@ldap ~]# rpm -qa | grep 389
> > 389-ds-console-doc-1.2.16-5.fc29.noarch
> > 389-admin-1.1.46-2.fc29.x86_64
> > 389-ds-1.2.2-14.fc29.noarch
> > 389-console-1.1.19-1.fc29.noarch
> > python3-lib389-1.4.0.20-1.fc29.noarch
> > 389-ds-base-legacy-tools-1.4.0.20-1.fc29.x86_64
> > 389-admin-console-doc-1.1.12-5.fc29.noarch
> > 389-admin-console-1.1.12-5.fc29.noarch
> > 389-ds-base-1.4.0.20-1.fc29.x86_64
> > 389-adminutil-1.1.23-11.fc29.x86_64
> > 389-ds-base-libs-1.4.0.20-1.fc29.x86_64
> > 389-dsgw-1.1.11-19.fc29.x86_64
> > 389-ds-console-1.2.16-5.fc29.noarch
> > [root@ldap ~]#
> > [root@ldap ~]# cat /etc/redhat-release
> > Fedora release 29 (Twenty Nine)
> >
> > If I do a search with a filter and scope one, all the entries in that
> > base are returned:
> >
> > [root@ldap ~]# ldapsearch  ... -s one -b
> > "ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro" ou=Profesori dn
> >
> > # Profesori, DPPD, People, curs.pub.ro
> > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> >
> > # Asistenti-Man, DPPD, People, curs.pub.ro
> > dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> >
> > # Profesori-Man, DPPD, People, curs.pub.ro
> > dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> >
> > # Externi, DPPD, People, curs.pub.ro
> > dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> >
> > # Auxiliari, DPPD, People, curs.pub.ro
> > dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> >
> > # search result
> > search: 2
> > result: 0 Success
> >
> > # numResponses: 6
> > # numEntries: 5
> >
> > If I replace one with sub, all is correct. Can you advise me in this issue?
>
> I think this is correct. You have used a search base of ou=DPPD, and you are seeing all the entries “one level below ou=DPPD”, but not including that entry, and not including any child entries of x=x,ou=DPPD.
>
> You may either want -s base, to show only ou=DPPD, or -s sub which show-s ou=DPPD and all entries in that subtree.

As you can see I have a filter ou=Profesori. So with a scope of -s one (all the entries one level bellow the base) and that filter it should return only one entry:ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro

Thank you,
Mihai
> I hope this helps, but I think there is no issue here.
> >
>
> —
> Sincerely,
>
> William Brown
> Software Engineer, 389 Directory Server
> SUSE Labs
> _______________________________________________
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mihai Carabas]

More verbose:
# extended LDIF
#
# LDAPv3
# base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
# filter: ou=Profesori
# requesting: dn
#

# Profesori, DPPD, People, curs.pub.ro
dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro

# Asistenti-Man, DPPD, People, curs.pub.ro
dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro

# Profesori-Man, DPPD, People, curs.pub.ro
dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro

# Externi, DPPD, People, curs.pub.ro
dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro

# Auxiliari, DPPD, People, curs.pub.ro
dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro

# search result
search: 2
result: 0 Success

# numResponses: 6
# numEntries: 5

It seems that the filter is ignored.

On another ou, this works. It is very confusing:

# extended LDIF
#
# LDAPv3
# base <ou=ACS,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
# filter: ou=Profesori
# requesting: dn
#

# Profesori, ACS, People, curs.pub.ro
dn: ou=Profesori,ou=ACS,ou=People,dc=curs,dc=pub,dc=ro

# search result
search: 2
result: 0 Success

And I have multiple OUs under ou=People and on some of them the
results are as expected on the others are not.

Mihai

On Tue, Jan 22, 2019 at 8:43 AM Mihai Carabas  wrote:
> Mihai Carabas
> > On 22 Jan 2019, at 00:06, William Brown  wrote:
> > > On 22 Jan 2019, at 09:15, Mihai Carabas  wrote:
> > >
> > > Hello,
> > >
> > > Recently I've upgraded 389ds to 389ds-1.4.0.20 on a fc29. It seems
> > > that the bug https://pagure.io/389-ds-base/issue/49617 and also
> > > https://pagure.io/389-ds-base/issue/49443
> > >
> > > [root@ldap ~]# rpm -qa | grep 389
> > > 389-ds-console-doc-1.2.16-5.fc29.noarch
> > > 389-admin-1.1.46-2.fc29.x86_64
> > > 389-ds-1.2.2-14.fc29.noarch
> > > 389-console-1.1.19-1.fc29.noarch
> > > python3-lib389-1.4.0.20-1.fc29.noarch
> > > 389-ds-base-legacy-tools-1.4.0.20-1.fc29.x86_64
> > > 389-admin-console-doc-1.1.12-5.fc29.noarch
> > > 389-admin-console-1.1.12-5.fc29.noarch
> > > 389-ds-base-1.4.0.20-1.fc29.x86_64
> > > 389-adminutil-1.1.23-11.fc29.x86_64
> > > 389-ds-base-libs-1.4.0.20-1.fc29.x86_64
> > > 389-dsgw-1.1.11-19.fc29.x86_64
> > > 389-ds-console-1.2.16-5.fc29.noarch
> > > [root@ldap ~]#
> > > [root@ldap ~]# cat /etc/redhat-release
> > > Fedora release 29 (Twenty Nine)
> > >
> > > If I do a search with a filter and scope one, all the entries in that
> > > base are returned:
> > >
> > > [root@ldap ~]# ldapsearch  ... -s one -b
> > > "ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro" ou=Profesori dn
> > >
> > > # Profesori, DPPD, People, curs.pub.ro
> > > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > >
> > > # Asistenti-Man, DPPD, People, curs.pub.ro
> > > dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > >
> > > # Profesori-Man, DPPD, People, curs.pub.ro
> > > dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > >
> > > # Externi, DPPD, People, curs.pub.ro
> > > dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > >
> > > # Auxiliari, DPPD, People, curs.pub.ro
> > > dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > >
> > > # search result
> > > search: 2
> > > result: 0 Success
> > >
> > > # numResponses: 6
> > > # numEntries: 5
> > >
> > > If I replace one with sub, all is correct. Can you advise me in this issue?
> >
> > I think this is correct. You have used a search base of ou=DPPD, and you are seeing all the entries “one level below ou=DPPD”, but not including that entry, and not including any child entries of x=x,ou=DPPD.
> >
> > You may either want -s base, to show only ou=DPPD, or -s sub which show-s ou=DPPD and all entries in that subtree.
>
> As you can see I have a filter ou=Profesori. So with a scope of -s one (all the entries one level bellow the base) and that filter it should return only one entry:ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
>
> Thank you,
> Mihai
> > I hope this helps, but I think there is no issue here.
> > >
> >
> > —
> > Sincerely,
> >
> > William Brown
> > Software Engineer, 389 Directory Server
> > SUSE Labs
> > _______________________________________________
> > 389-users mailing list -- [e-mail]
> > To unsubscribe send an email to [e-mail]
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Ludwig]

The issue you are reporting does match exactly the issue in #49443, but 
this was fixed and the fix is in current master. Also I cannot reproduce 
it in current master and not with 1.4.20 -

So this is a bit weird. Can you share a bit more of your data, eg 
provide all entries below ou=DPPD dn and ou attribute, do you have an 
index for ou ?

Regards,

Ludwig

On 01/22/2019 07:43 AM, Mihai Carabas wrote:
> Mihai Carabas
> > On 22 Jan 2019, at 00:06, William Brown  wrote:
> > > On 22 Jan 2019, at 09:15, Mihai Carabas  wrote:
> > >
> > > Hello,
> > >
> > > Recently I've upgraded 389ds to 389ds-1.4.0.20 on a fc29. It seems
> > > that the bug https://pagure.io/389-ds-base/issue/49617 and also
> > > https://pagure.io/389-ds-base/issue/49443
> > >
> > > [root@ldap ~]# rpm -qa | grep 389
> > > 389-ds-console-doc-1.2.16-5.fc29.noarch
> > > 389-admin-1.1.46-2.fc29.x86_64
> > > 389-ds-1.2.2-14.fc29.noarch
> > > 389-console-1.1.19-1.fc29.noarch
> > > python3-lib389-1.4.0.20-1.fc29.noarch
> > > 389-ds-base-legacy-tools-1.4.0.20-1.fc29.x86_64
> > > 389-admin-console-doc-1.1.12-5.fc29.noarch
> > > 389-admin-console-1.1.12-5.fc29.noarch
> > > 389-ds-base-1.4.0.20-1.fc29.x86_64
> > > 389-adminutil-1.1.23-11.fc29.x86_64
> > > 389-ds-base-libs-1.4.0.20-1.fc29.x86_64
> > > 389-dsgw-1.1.11-19.fc29.x86_64
> > > 389-ds-console-1.2.16-5.fc29.noarch
> > > [root@ldap ~]#
> > > [root@ldap ~]# cat /etc/redhat-release
> > > Fedora release 29 (Twenty Nine)
> > >
> > > If I do a search with a filter and scope one, all the entries in that
> > > base are returned:
> > >
> > > [root@ldap ~]# ldapsearch  ... -s one -b
> > > "ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro" ou=Profesori dn
> > >
> > > # Profesori, DPPD, People, curs.pub.ro
> > > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > >
> > > # Asistenti-Man, DPPD, People, curs.pub.ro
> > > dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > >
> > > # Profesori-Man, DPPD, People, curs.pub.ro
> > > dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > >
> > > # Externi, DPPD, People, curs.pub.ro
> > > dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > >
> > > # Auxiliari, DPPD, People, curs.pub.ro
> > > dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > >
> > > # search result
> > > search: 2
> > > result: 0 Success
> > >
> > > # numResponses: 6
> > > # numEntries: 5
> > >
> > > If I replace one with sub, all is correct. Can you advise me in this issue?
> >
> > I think this is correct. You have used a search base of ou=DPPD, and you are seeing all the entries “one level below ou=DPPD”, but not including that entry, and not including any child entries of x=x,ou=DPPD.
> >
> > You may either want -s base, to show only ou=DPPD, or -s sub which show-s ou=DPPD and all entries in that subtree.
>
> As you can see I have a filter ou=Profesori. So with a scope of -s one (all the entries one level bellow the base) and that filter it should return only one entry:ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
>
> Thank you,
> Mihai
> > I hope this helps, but I think there is no issue here.
> > —
> > Sincerely,
> >
> > William Brown
> > Software Engineer, 389 Directory Server
> > SUSE Labs
> > _______________________________________________
> > 389-users mailing list -- [e-mail]
> > To unsubscribe send an email to [e-mail]
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
>
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mihai Carabas]

Helllo,

On Tue, Jan 22, 2019 at 11:45 AM Ludwig  wrote:
> The issue you are reporting does match exactly the issue in #49443, but
> this was fixed and the fix is in current master. Also I cannot reproduce
> it in current master and not with 1.4.20 -
>
> So this is a bit weird. Can you share a bit more of your data, eg
> provide all entries below ou=DPPD dn and ou attribute, do you have an
> index for ou ?

Those are all _direct_ entries under ou=DPPD:
# extended LDIF
#
# LDAPv3
# base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
# filter: (objectclass=*)
# requesting: ALL
#

# Profesori, DPPD, People, curs.pub.ro
dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
objectClass: top
objectClass: organizationalunit
ou: ou=Profesori
ou: Profesori

# Asistenti-Man, DPPD, People, curs.pub.ro
dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
objectClass: top
objectClass: organizationalunit
ou: ou=Asistenti-Man
ou: Asistenti-Man

# Profesori-Man, DPPD, People, curs.pub.ro
dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
objectClass: top
objectClass: organizationalunit
ou: ou=Profesori-Man
ou: Profesori-Man

# Externi, DPPD, People, curs.pub.ro
dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
objectClass: top
objectClass: organizationalunit
ou: ou=Externi
ou: Externi

# Auxiliari, DPPD, People, curs.pub.ro
dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
objectClass: top
objectClass: organizationalunit
ou: Auxiliari

# search result
search: 2
result: 0 Success

# numResponses: 6
# numEntries: 5

But for out=ACS, the filter is working:
# extended LDIF
#
# LDAPv3
# base <ou=ACS,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
# filter: ou=Profesori
# requesting: ALL
#

# Profesori, ACS, People, curs.pub.ro
dn: ou=Profesori,ou=ACS,ou=People,dc=curs,dc=pub,dc=ro
objectClass: top
objectClass: organizationalunit
ou: ou=Profesori
ou: Profesori

# search result
search: 2
result: 0 Success

# numResponses: 2
# numEntries: 1

This is very wierd. I have an index for ou.
> Regards,
>
> Ludwig
>
> On 01/22/2019 07:43 AM, Mihai Carabas wrote:
> > Mihai Carabas
> > > On 22 Jan 2019, at 00:06, William Brown  wrote:
> > > > On 22 Jan 2019, at 09:15, Mihai Carabas  wrote:
> > > >
> > > > Hello,
> > > >
> > > > Recently I've upgraded 389ds to 389ds-1.4.0.20 on a fc29. It seems
> > > > that the bug https://pagure.io/389-ds-base/issue/49617 and also
> > > > https://pagure.io/389-ds-base/issue/49443
> > > >
> > > > [root@ldap ~]# rpm -qa | grep 389
> > > > 389-ds-console-doc-1.2.16-5.fc29.noarch
> > > > 389-admin-1.1.46-2.fc29.x86_64
> > > > 389-ds-1.2.2-14.fc29.noarch
> > > > 389-console-1.1.19-1.fc29.noarch
> > > > python3-lib389-1.4.0.20-1.fc29.noarch
> > > > 389-ds-base-legacy-tools-1.4.0.20-1.fc29.x86_64
> > > > 389-admin-console-doc-1.1.12-5.fc29.noarch
> > > > 389-admin-console-1.1.12-5.fc29.noarch
> > > > 389-ds-base-1.4.0.20-1.fc29.x86_64
> > > > 389-adminutil-1.1.23-11.fc29.x86_64
> > > > 389-ds-base-libs-1.4.0.20-1.fc29.x86_64
> > > > 389-dsgw-1.1.11-19.fc29.x86_64
> > > > 389-ds-console-1.2.16-5.fc29.noarch
> > > > [root@ldap ~]#
> > > > [root@ldap ~]# cat /etc/redhat-release
> > > > Fedora release 29 (Twenty Nine)
> > > >
> > > > If I do a search with a filter and scope one, all the entries in that
> > > > base are returned:
> > > >
> > > > [root@ldap ~]# ldapsearch  ... -s one -b
> > > > "ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro" ou=Profesori dn
> > > >
> > > > # Profesori, DPPD, People, curs.pub.ro
> > > > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > >
> > > > # Asistenti-Man, DPPD, People, curs.pub.ro
> > > > dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > >
> > > > # Profesori-Man, DPPD, People, curs.pub.ro
> > > > dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > >
> > > > # Externi, DPPD, People, curs.pub.ro
> > > > dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > >
> > > > # Auxiliari, DPPD, People, curs.pub.ro
> > > > dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > >
> > > > # search result
> > > > search: 2
> > > > result: 0 Success
> > > >
> > > > # numResponses: 6
> > > > # numEntries: 5
> > > >
> > > > If I replace one with sub, all is correct. Can you advise me in this issue?
> > >
> > > I think this is correct. You have used a search base of ou=DPPD, and you are seeing all the entries “one level below ou=DPPD”, but not including that entry, and not including any child entries of x=x,ou=DPPD.
> > >
> > > You may either want -s base, to show only ou=DPPD, or -s sub which show-s ou=DPPD and all entries in that subtree.
> >
> > As you can see I have a filter ou=Profesori. So with a scope of -s one (all the entries one level bellow the base) and that filter it should return only one entry:ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> >
> > Thank you,
> > Mihai
> > > I hope this helps, but I think there is no issue here.
> > > —
> > > Sincerely,
> > >
> > > William Brown
> > > Software Engineer, 389 Directory Server
> > > SUSE Labs
> > > _______________________________________________
> > > 389-users mailing list -- [e-mail]
> > > To unsubscribe send an email to [e-mail]
> > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> >
> > 389-users mailing list -- [e-mail]
> > To unsubscribe send an email to [e-mail]
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
>
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[William Brown]

> On 23 Jan 2019, at 02:01, Mihai Carabas  wrote:
>
> Helllo,
>
> On Tue, Jan 22, 2019 at 11:45 AM Ludwig  wrote:
> > The issue you are reporting does match exactly the issue in #49443, but
> > this was fixed and the fix is in current master. Also I cannot reproduce
> > it in current master and not with 1.4.20 -
> >
> > So this is a bit weird. Can you share a bit more of your data, eg
> > provide all entries below ou=DPPD dn and ou attribute, do you have an
> > index for ou ?
>
> Those are all _direct_ entries under ou=DPPD:
> # extended LDIF
> #
> # LDAPv3
> # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
> # filter: (objectclass=*)
> # requesting: ALL
> #
>
> # Profesori, DPPD, People, curs.pub.ro
> dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> objectClass: top
> objectClass: organizationalunit
> ou: ou=Profesori
> ou: Profesori
>
> # Asistenti-Man, DPPD, People, curs.pub.ro
> dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> objectClass: top
> objectClass: organizationalunit
> ou: ou=Asistenti-Man
> ou: Asistenti-Man
>
> # Profesori-Man, DPPD, People, curs.pub.ro
> dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> objectClass: top
> objectClass: organizationalunit
> ou: ou=Profesori-Man
> ou: Profesori-Man
>
> # Externi, DPPD, People, curs.pub.ro
> dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> objectClass: top
> objectClass: organizationalunit
> ou: ou=Externi
> ou: Externi
>
> # Auxiliari, DPPD, People, curs.pub.ro
> dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> objectClass: top
> objectClass: organizationalunit
> ou: Auxiliari
>
> # search result
> search: 2
> result: 0 Success
>
> # numResponses: 6
> # numEntries: 5
>
> But for out=ACS, the filter is working:
> # extended LDIF
> #
> # LDAPv3
> # base <ou=ACS,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
> # filter: ou=Profesori
> # requesting: ALL
> #
>
> # Profesori, ACS, People, curs.pub.ro
> dn: ou=Profesori,ou=ACS,ou=People,dc=curs,dc=pub,dc=ro
> objectClass: top
> objectClass: organizationalunit
> ou: ou=Profesori
> ou: Profesori
>
> # search result
> search: 2
> result: 0 Success
>
> # numResponses: 2
> # numEntries: 1
>
> This is very wierd. I have an index for ou.

This is indeed weird. Do you have the access log for this search operation? Can you please provide it?

Additionally, have you been able to reproduce this in a new instance? Or only on your “current” instance.

Thanks,

—
Sincerely,

William Brown
Software Engineer, 389 Directory Server
SUSE Labs

[Mihai Carabas]

On Wed, Jan 23, 2019 at 4:52 AM William Brown  wrote:
> > On 23 Jan 2019, at 02:01, Mihai Carabas  wrote:
> >
> > Helllo,
> >
> > On Tue, Jan 22, 2019 at 11:45 AM Ludwig  wrote:
> > > The issue you are reporting does match exactly the issue in #49443, but
> > > this was fixed and the fix is in current master. Also I cannot reproduce
> > > it in current master and not with 1.4.20 -
> > >
> > > So this is a bit weird. Can you share a bit more of your data, eg
> > > provide all entries below ou=DPPD dn and ou attribute, do you have an
> > > index for ou ?
> >
> > Those are all _direct_ entries under ou=DPPD:
> > # extended LDIF
> > #
> > # LDAPv3
> > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
> > # filter: (objectclass=*)
> > # requesting: ALL
> > #
> >
> > # Profesori, DPPD, People, curs.pub.ro
> > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > objectClass: top
> > objectClass: organizationalunit
> > ou: ou=Profesori
> > ou: Profesori
> >
> > # Asistenti-Man, DPPD, People, curs.pub.ro
> > dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > objectClass: top
> > objectClass: organizationalunit
> > ou: ou=Asistenti-Man
> > ou: Asistenti-Man
> >
> > # Profesori-Man, DPPD, People, curs.pub.ro
> > dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > objectClass: top
> > objectClass: organizationalunit
> > ou: ou=Profesori-Man
> > ou: Profesori-Man
> >
> > # Externi, DPPD, People, curs.pub.ro
> > dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > objectClass: top
> > objectClass: organizationalunit
> > ou: ou=Externi
> > ou: Externi
> >
> > # Auxiliari, DPPD, People, curs.pub.ro
> > dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > objectClass: top
> > objectClass: organizationalunit
> > ou: Auxiliari
> >
> > # search result
> > search: 2
> > result: 0 Success
> >
> > # numResponses: 6
> > # numEntries: 5
> >
> > But for out=ACS, the filter is working:
> > # extended LDIF
> > #
> > # LDAPv3
> > # base <ou=ACS,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
> > # filter: ou=Profesori
> > # requesting: ALL
> > #
> >
> > # Profesori, ACS, People, curs.pub.ro
> > dn: ou=Profesori,ou=ACS,ou=People,dc=curs,dc=pub,dc=ro
> > objectClass: top
> > objectClass: organizationalunit
> > ou: ou=Profesori
> > ou: Profesori
> >
> > # search result
> > search: 2
> > result: 0 Success
> >
> > # numResponses: 2
> > # numEntries: 1
> >
> > This is very wierd. I have an index for ou.
>
> This is indeed weird. Do you have the access log for this search operation? Can you please provide it?

[23/Jan/2019:09:01:00.759258088 +0200] conn=208222 fd=71 slot=71
connection from 141.85.241.48 to 141.85.241.48
[23/Jan/2019:09:01:00.759495689 +0200] conn=208222 op=0 BIND
dn="cn=directory manager" method=128 version=3
[23/Jan/2019:09:01:00.759638289 +0200] conn=208222 op=0 RESULT err=0
tag=97 nentries=0 etime=0.0000258701 dn="cn=directory manager"
[23/Jan/2019:09:01:00.760046290 +0200] conn=208222 op=1 SRCH
base="ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro" scope=1
filter="(ou=Profesori)" attrs=ALL
[23/Jan/2019:09:01:00.760605892 +0200] conn=208222 op=1 RESULT err=0
tag=101 nentries=5 etime=0.0000696102
[23/Jan/2019:09:01:00.761964296 +0200] conn=208222 op=2 UNBIND
[23/Jan/2019:09:01:00.761988896 +0200] conn=208222 op=2 fd=71 closed - U1
> Additionally, have you been able to reproduce this in a new instance? Or only on your “current” instance.

Honestly I did not.

One particular thing is that I have upgraded my Fedora25 step-by-step
(I went through each version) and also 389-ds was upgraded. The
dataset would contain old metadata from the old version of 389-ds?

Thank you,
Mihai
> Thanks,
>
> —
> Sincerely,
>
> William Brown
> Software Engineer, 389 Directory Server
> SUSE Labs
> _______________________________________________
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mihai Carabas]

I've tried playing with the filters on the ou=DPPD which has issues:
# extended LDIF
#
# LDAPv3
# base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
# filter: ou=Profeso
# requesting: ALL
#

# search result
search: 2
result: 0 Success

# numResponses: 1

# extended LDIF
#
# LDAPv3
# base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
# filter: ou=Profesor
# requesting: ALL
#

# Profesori, DPPD, People, curs.pub.ro
dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
ou: Profesori
objectClass: top
objectClass: organizationalunit

# Asistenti-Man, DPPD, People, curs.pub.ro
dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
objectClass: top
objectClass: organizationalunit
ou: ou=Asistenti-Man
ou: Asistenti-Man

# Profesori-Man, DPPD, People, curs.pub.ro
dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
objectClass: top
objectClass: organizationalunit
ou: ou=Profesori-Man
ou: Profesori-Man

# Externi, DPPD, People, curs.pub.ro
dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
objectClass: top
objectClass: organizationalunit
ou: ou=Externi
ou: Externi

# Auxiliari, DPPD, People, curs.pub.ro
dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
objectClass: top
objectClass: organizationalunit
ou: Auxiliari

# search result
search: 2
result: 0 Success

# numResponses: 6
# numEntries: 5

If I put a filter of ou=Profeso, no entry is returned which is _fine_.
If I put ou=Profesor, all the entries are returned (even no entry is
matching the string). Something is matching on all entries.

On Wed, Jan 23, 2019 at 9:06 AM Mihai Carabas  wrote:
> On Wed, Jan 23, 2019 at 4:52 AM William Brown  wrote:
> > > On 23 Jan 2019, at 02:01, Mihai Carabas  wrote:
> > >
> > > Helllo,
> > >
> > > On Tue, Jan 22, 2019 at 11:45 AM Ludwig  wrote:
> > > > The issue you are reporting does match exactly the issue in #49443, but
> > > > this was fixed and the fix is in current master. Also I cannot reproduce
> > > > it in current master and not with 1.4.20 -
> > > >
> > > > So this is a bit weird. Can you share a bit more of your data, eg
> > > > provide all entries below ou=DPPD dn and ou attribute, do you have an
> > > > index for ou ?
> > >
> > > Those are all _direct_ entries under ou=DPPD:
> > > # extended LDIF
> > > #
> > > # LDAPv3
> > > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
> > > # filter: (objectclass=*)
> > > # requesting: ALL
> > > #
> > >
> > > # Profesori, DPPD, People, curs.pub.ro
> > > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > objectClass: top
> > > objectClass: organizationalunit
> > > ou: ou=Profesori
> > > ou: Profesori
> > >
> > > # Asistenti-Man, DPPD, People, curs.pub.ro
> > > dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > objectClass: top
> > > objectClass: organizationalunit
> > > ou: ou=Asistenti-Man
> > > ou: Asistenti-Man
> > >
> > > # Profesori-Man, DPPD, People, curs.pub.ro
> > > dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > objectClass: top
> > > objectClass: organizationalunit
> > > ou: ou=Profesori-Man
> > > ou: Profesori-Man
> > >
> > > # Externi, DPPD, People, curs.pub.ro
> > > dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > objectClass: top
> > > objectClass: organizationalunit
> > > ou: ou=Externi
> > > ou: Externi
> > >
> > > # Auxiliari, DPPD, People, curs.pub.ro
> > > dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > objectClass: top
> > > objectClass: organizationalunit
> > > ou: Auxiliari
> > >
> > > # search result
> > > search: 2
> > > result: 0 Success
> > >
> > > # numResponses: 6
> > > # numEntries: 5
> > >
> > > But for out=ACS, the filter is working:
> > > # extended LDIF
> > > #
> > > # LDAPv3
> > > # base <ou=ACS,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
> > > # filter: ou=Profesori
> > > # requesting: ALL
> > > #
> > >
> > > # Profesori, ACS, People, curs.pub.ro
> > > dn: ou=Profesori,ou=ACS,ou=People,dc=curs,dc=pub,dc=ro
> > > objectClass: top
> > > objectClass: organizationalunit
> > > ou: ou=Profesori
> > > ou: Profesori
> > >
> > > # search result
> > > search: 2
> > > result: 0 Success
> > >
> > > # numResponses: 2
> > > # numEntries: 1
> > >
> > > This is very wierd. I have an index for ou.
> >
> > This is indeed weird. Do you have the access log for this search operation? Can you please provide it?
>
> [23/Jan/2019:09:01:00.759258088 +0200] conn=208222 fd=71 slot=71
> connection from 141.85.241.48 to 141.85.241.48
> [23/Jan/2019:09:01:00.759495689 +0200] conn=208222 op=0 BIND
> dn="cn=directory manager" method=128 version=3
> [23/Jan/2019:09:01:00.759638289 +0200] conn=208222 op=0 RESULT err=0
> tag=97 nentries=0 etime=0.0000258701 dn="cn=directory manager"
> [23/Jan/2019:09:01:00.760046290 +0200] conn=208222 op=1 SRCH
> base="ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro" scope=1
> filter="(ou=Profesori)" attrs=ALL
> [23/Jan/2019:09:01:00.760605892 +0200] conn=208222 op=1 RESULT err=0
> tag=101 nentries=5 etime=0.0000696102
> [23/Jan/2019:09:01:00.761964296 +0200] conn=208222 op=2 UNBIND
> [23/Jan/2019:09:01:00.761988896 +0200] conn=208222 op=2 fd=71 closed - U1
> > Additionally, have you been able to reproduce this in a new instance? Or only on your “current” instance.
>
> Honestly I did not.
>
> One particular thing is that I have upgraded my Fedora25 step-by-step
> (I went through each version) and also 389-ds was upgraded. The
> dataset would contain old metadata from the old version of 389-ds?
>
> Thank you,
> Mihai
> > Thanks,
> >
> > —
> > Sincerely,
> >
> > William Brown
> > Software Engineer, 389 Directory Server
> > SUSE Labs
> > _______________________________________________
> > 389-users mailing list -- [e-mail]
> > To unsubscribe send an email to [e-mail]
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[William Brown]

> On 23 Jan 2019, at 20:14, Mihai Carabas  wrote:
>
> I've tried playing with the filters on the ou=DPPD which has issues:
> # extended LDIF
> #
> # LDAPv3
> # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
> # filter: ou=Profeso
> # requesting: ALL
> #
>
> # search result
> search: 2
> result: 0 Success
>
> # numResponses: 1
>
> # extended LDIF
> #
> # LDAPv3
> # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
> # filter: ou=Profesor
> # requesting: ALL
> #
>
> # Profesori, DPPD, People, curs.pub.ro
> dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> ou: Profesori
> objectClass: top
> objectClass: organizationalunit
>
> # Asistenti-Man, DPPD, People, curs.pub.ro
> dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> objectClass: top
> objectClass: organizationalunit
> ou: ou=Asistenti-Man
> ou: Asistenti-Man
>
> # Profesori-Man, DPPD, People, curs.pub.ro
> dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> objectClass: top
> objectClass: organizationalunit
> ou: ou=Profesori-Man
> ou: Profesori-Man
>
> # Externi, DPPD, People, curs.pub.ro
> dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> objectClass: top
> objectClass: organizationalunit
> ou: ou=Externi
> ou: Externi
>
> # Auxiliari, DPPD, People, curs.pub.ro
> dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> objectClass: top
> objectClass: organizationalunit
> ou: Auxiliari
>
> # search result
> search: 2
> result: 0 Success
>
> # numResponses: 6
> # numEntries: 5
>
> If I put a filter of ou=Profeso, no entry is returned which is _fine_.
> If I put ou=Profesor, all the entries are returned (even no entry is
> matching the string). Something is matching on all entries.

This sounds like it could be an index corruption or issue perhaps. Would you be able to run a dbscan of:

cd /var/lib/dirsrv/slapd-<instance name>/<backend name>
dbscan -r -f ou.db4

For me this is:

cd /var/lib/dirsrv/slapd-localhost/userRoot

It would be interesting to see if you have a result of “=Profeso” but not “=Profesor”

Please do this first, but after this, the solution may be a db2index to rebuild your index content. I would like to see the dbscans first though :)

Thanks,
> On Wed, Jan 23, 2019 at 9:06 AM Mihai Carabas  wrote:
> > On Wed, Jan 23, 2019 at 4:52 AM William Brown  wrote:
> > > > On 23 Jan 2019, at 02:01, Mihai Carabas  wrote:
> > > >
> > > > Helllo,
> > > >
> > > > On Tue, Jan 22, 2019 at 11:45 AM Ludwig  wrote:
> > > > > The issue you are reporting does match exactly the issue in #49443, but
> > > > > this was fixed and the fix is in current master. Also I cannot reproduce
> > > > > it in current master and not with 1.4.20 -
> > > > >
> > > > > So this is a bit weird. Can you share a bit more of your data, eg
> > > > > provide all entries below ou=DPPD dn and ou attribute, do you have an
> > > > > index for ou ?
> > > >
> > > > Those are all _direct_ entries under ou=DPPD:
> > > > # extended LDIF
> > > > #
> > > > # LDAPv3
> > > > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
> > > > # filter: (objectclass=*)
> > > > # requesting: ALL
> > > > #
> > > >
> > > > # Profesori, DPPD, People, curs.pub.ro
> > > > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > objectClass: top
> > > > objectClass: organizationalunit
> > > > ou: ou=Profesori
> > > > ou: Profesori
> > > >
> > > > # Asistenti-Man, DPPD, People, curs.pub.ro
> > > > dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > objectClass: top
> > > > objectClass: organizationalunit
> > > > ou: ou=Asistenti-Man
> > > > ou: Asistenti-Man
> > > >
> > > > # Profesori-Man, DPPD, People, curs.pub.ro
> > > > dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > objectClass: top
> > > > objectClass: organizationalunit
> > > > ou: ou=Profesori-Man
> > > > ou: Profesori-Man
> > > >
> > > > # Externi, DPPD, People, curs.pub.ro
> > > > dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > objectClass: top
> > > > objectClass: organizationalunit
> > > > ou: ou=Externi
> > > > ou: Externi
> > > >
> > > > # Auxiliari, DPPD, People, curs.pub.ro
> > > > dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > objectClass: top
> > > > objectClass: organizationalunit
> > > > ou: Auxiliari
> > > >
> > > > # search result
> > > > search: 2
> > > > result: 0 Success
> > > >
> > > > # numResponses: 6
> > > > # numEntries: 5
> > > >
> > > > But for out=ACS, the filter is working:
> > > > # extended LDIF
> > > > #
> > > > # LDAPv3
> > > > # base <ou=ACS,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
> > > > # filter: ou=Profesori
> > > > # requesting: ALL
> > > > #
> > > >
> > > > # Profesori, ACS, People, curs.pub.ro
> > > > dn: ou=Profesori,ou=ACS,ou=People,dc=curs,dc=pub,dc=ro
> > > > objectClass: top
> > > > objectClass: organizationalunit
> > > > ou: ou=Profesori
> > > > ou: Profesori
> > > >
> > > > # search result
> > > > search: 2
> > > > result: 0 Success
> > > >
> > > > # numResponses: 2
> > > > # numEntries: 1
> > > >
> > > > This is very wierd. I have an index for ou.
> > >
> > > This is indeed weird. Do you have the access log for this search operation? Can you please provide it?
> >
> > [23/Jan/2019:09:01:00.759258088 +0200] conn=208222 fd=71 slot=71
> > connection from 141.85.241.48 to 141.85.241.48
> > [23/Jan/2019:09:01:00.759495689 +0200] conn=208222 op=0 BIND
> > dn="cn=directory manager" method=128 version=3
> > [23/Jan/2019:09:01:00.759638289 +0200] conn=208222 op=0 RESULT err=0
> > tag=97 nentries=0 etime=0.0000258701 dn="cn=directory manager"
> > [23/Jan/2019:09:01:00.760046290 +0200] conn=208222 op=1 SRCH
> > base="ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro" scope=1
> > filter="(ou=Profesori)" attrs=ALL
> > [23/Jan/2019:09:01:00.760605892 +0200] conn=208222 op=1 RESULT err=0
> > tag=101 nentries=5 etime=0.0000696102
> > [23/Jan/2019:09:01:00.761964296 +0200] conn=208222 op=2 UNBIND
> > [23/Jan/2019:09:01:00.761988896 +0200] conn=208222 op=2 fd=71 closed - U1
> > > Additionally, have you been able to reproduce this in a new instance? Or only on your “current” instance.
> >
> > Honestly I did not.
> >
> > One particular thing is that I have upgraded my Fedora25 step-by-step
> > (I went through each version) and also 389-ds was upgraded. The
> > dataset would contain old metadata from the old version of 389-ds?
> >
> > Thank you,
> > Mihai
> > > Thanks,
> > >
> > > —
> > > Sincerely,
> > >
> > > William Brown
> > > Software Engineer, 389 Directory Server
> > > SUSE Labs
> > > _______________________________________________
> > > 389-users mailing list -- [e-mail]
> > > To unsubscribe send an email to [e-mail]
> > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
>
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

—
Sincerely,

William Brown
Software Engineer, 389 Directory Server
SUSE Labs

[Mihai Carabas]

Hello William,

[root@ldap cursdb]# pwd
/var/lib/dirsrv/slapd-ldap/db/cursdb
[root@ldap cursdb]# dbscan -r -f ou.db
+
        2 3 4 7 26 27 67 68 70 71 75 77 79 305 1751 1752 1857 1858
1861 1862 1954 1998 2143 2144 2220 2434 2994 3054 3055 3093 3206 3225
3226 3229 3232 3245 3262 3391 3482 3499 3500 3611 3617 3647 3648 3656
3657 5450 5456 5457 5466 5467 5487 5547 5733 5856 5865 5905 5916 5924
5940 6226 6228 6229 6253 6259 6268 6270 6275 6278 6280 6282 6303 6304
6307 6308 6323 7098 7714 8042 8177 8286 8291 8294 8449 8531 8776 8904
9111 9131 9136 9165 9287 9288 9567 9704 9865 9930 9958 10301 10357
10412 10417 10470 10518 10524 10580 10742 10766 10823 10840 10843
10845 10871 11345 11346 11347 11348 11349 11350 11351 11352 11354
11355 11402 11540 11972 12185 15356 15711 15867 16085 16119 16402
16580 16583 16587 16941 17103 17133 17314 17387 18366 18382 18524
18589 18793 18853 19369 20378 21772 21773 21774 21775 21776 21777
21778 21779 21780 21781 21782 21783 21784 21785 21786 21787 21788
21789 21790 21791 21792 21793 21794 21795 21796 21797 21798 21799
21800 21801 21802 21803 21804 21805 21806 21807 21808 21809 21810
21811 21812 21813 21814 21815 21816 21817 21818 21819 21820 21821
21822 21823 21824 21825 21826 21827 21828 21829 21830 27227 36065
36066 36067 36068 36069 36070 36071 36072 36073 42789 42790 42791
42792 42793 42794 42795 42796 42797 42798 42799 42800 42801 42802
42803 42804 42805 42806 42807 42808 42809 42810 42811 42812 42813
42814 42815 42816 42817 42818 42819 42820 42821 42822 42823 42824
42825 42826 42827 42828 42829 42830 42831 42832 42833 42834 42835
42836 42837 42838 42839 42840 42841 42842 42843 42844 42845 42846
42847 42848 43368 43369 43441 43442 43443 43444 43445 43446 43447
43448 43449 43450 45716 45717 45718 45719 45720 52249 52250 52251
52252 52253 55415 55416 55417 55418 55419 55420 55421 55422 55423
55424 55425 55426 55427 55428 55429 55430 55431 55432 55433 55434
55435 55436 55437 56062 56064 56068 56070 56072 56075 56079 56095
56135 56141 58638 58799 59159 60280 60368 63580 63582 63589 63591
63593 63595 63601 63604 63607 63609 63612 63616 63692 63694 63759
63802 63841 64891 64917 64919 65594 65596 65598 65602 65604 65606
65609 65614 65617 65619 65624 65632 65635 65649 69725 72417 72419
72421 72424 72426 72430 72437 72439 72443 72445 72451 72548 73242
73269 77024 79401 79403 79405 79407 79409 79413 79417 79419 79421
79423 79429 79439 79443 79450 79460 86175
=2014
        42801 42802 42803 42804 42805 42806 42807 42808 42809 42810
42811 42812 43442 43447 45717 52250
=acs
        3 42790 55420
=aero
        2143 42795
=asistent
        42814 42817 42820 42823 42826 42829 42832 42835 42838 42841
42844 42847 43444 43449 45719 52252
=asistenti-man
        21773 21777 21780 21783 21786 21789 21793 21796 21799 21802
21805 21809 21813 21817 21821 21824 21828
=auxiliari
        63580 63582 63589 63591 63593 63595 63601 63604 63607 63609
63612 63616 63692 63694 63759 63802 63841
=chim
        43441
=chimie
        3499
=cs
        42789
=dppd
        3647 42799
=electro
        42791
=electronica
        26 45716 55418
=energ
        42792
=energetica
        1861 55432
=externi
        5450 21775 21779 21781 21784 21788 21791 21795 21798 21801
21804 21807 21811 21815 21819 21823 21826 21830 43369 55417
=faima
        6228 42800
=fils
        3054 42797 55427
=fsa
        42798
=groups
        70
=imst
        5466 42793 55423
=inactiveaccounts
        55415
=inginerieelectrica
        1857
=ingineriemedicala
        67
=isb
        6303 42794
=manual
        86175
=mecanica
        3225 43446
=moodle
        3611
=ncit
        3656 55416
=ou=asistenti-man
        21773 21777 21780 21783 21786 21789 21793 21796 21799 21802
21805 21809 21813 21817 21821 21824 21828
=ou=externi
        21775 21779 21781 21784 21788 21791 21795 21798 21801 21804
21807 21811 21815 21819 21823 21826 21830
=ou=fils
        3054
=ou=profesori
        7 68 3232 5457 6259 6268 6270 6275 6278 6280 6282 6304 6308
6323 7098 21827
=ou=profesori-man
        4 7714 21774 21778 21787 21790 21794 21797 21800 21803 21806
21810 21814 21818 21822 21825 21829
=ou=useri2006
        71 3206 5916 9930 10840 15356 16119 17103 17387 19369 21808
=ou=useri2007
        75 1998 2994 3482 5924 8042 8177 8286 8291 10742 11972 12185 18382
=ou=useri2008
        77 1752 1858 1862 1954 3391 5865 9165 10301 10470 11540 16941 17133
=ou=useri2009
        79 2220 5733 5856 5905 5940 8294 9131 10417 10871 16085 16587 18589
=ou=useri2010
        5487 5547 6229 8449 8904 9704 9865 10357 10412 10580 10766
11402 16402 16580 18853
=ou=useri2011
        305 3262 5467 8776 9111 9136 9288 9567 9958 10524 15711 15867
16583 17314 18793
=ou=useri2012
        18366
=ou=useri2013
        2144 3055 3093 3245 10843 18524 20378 21772 21776 21782 21785
21792 21812 21816 21820
=ou=useri2014
        27 2434 3226 3229 3500 6253 36065 36066 36067 36068 36069
36070 36071 36072 36073
=people
        2
=profesor
        42815 42818 42821 42824 42827 42830 42833 42836 42839 42842
42845 42848 43445 43450 45720 52253
=profesori
        7 68 3232 3648 5457 6259 6268 6270 6275 6278 6280 6282 6304
6308 6323 7098 21827
=profesori-man
        4 7714 21774 21778 21787 21790 21794 21797 21800 21803 21806
21810 21814 21818 21822 21825 21829
=rectorat
        11354
=sim
        6307 42796
=special%20users
        3617
=stiinteaplicate
        5456
=student
        42813 42816 42819 42822 42825 42828 42831 42834 42837 42840
42843 42846 43443 43448 45718 52251
=systemaccounts
        3657
=test
        43368
=tet
        52249
=transporturi
        1751 55430
=useri2006
        71 3206 5916 9930 10840 15356 16119 17103 17387 19369 21808
55421 64891 64917 64919
=useri2007
        75 1998 2994 3482 5924 8042 8177 8286 8291 10742 11972 12185
18382 55422 55428
=useri2008
        77 1752 1858 1862 1954 3391 5865 9165 10301 10470 11540 16941
17133 55419 55426 55431 55433
=useri2009
        79 2220 5733 5856 5905 5940 8294 9131 10417 10871 16085 16587
18589 27227 55434
=useri2010
        5487 5547 6229 8449 8904 9704 9865 10357 10412 10580 10766
11402 16402 16580 18853 55425 55436
=useri2011
        305 3262 5467 8776 9111 9136 9288 9567 9958 10524 15711 15867
16583 17314 18793 55429
=useri2012
        6226 8531 9287 10518 10823 10845 11345 11346 11347 11348 11349
11350 11351 11352 11355 18366 55424 55437
=useri2013
        2144 3055 3093 3245 10843 18524 20378 21772 21776 21782 21785
21792 21812 21816 21820 55435
=useri2014
        27 2434 3226 3229 3500 6253 36065 36066 36067 36068 36069
36070 36071 36072 36073
=useri2015
        56062 56064 56068 56070 56072 56075 56079 56095 56135 56141
58638 58799 59159 60280 60368
=useri2016
        65594 65596 65598 65602 65604 65606 65609 65614 65617 65619
65624 65632 65635 65649 69725
=useri2017
        72417 72419 72421 72424 72426 72430 72437 72439 72443 72445
72451 72548 73242 73269 77024
=useri2018
        79401 79403 79405 79407 79409 79413 79417 79419 79421 79423
79429 79439 79443 79450 79460

On Wed, Jan 23, 2019 at 1:09 PM William Brown  wrote:
> > On 23 Jan 2019, at 20:14, Mihai Carabas  wrote:
> >
> > I've tried playing with the filters on the ou=DPPD which has issues:
> > # extended LDIF
> > #
> > # LDAPv3
> > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
> > # filter: ou=Profeso
> > # requesting: ALL
> > #
> >
> > # search result
> > search: 2
> > result: 0 Success
> >
> > # numResponses: 1
> >
> > # extended LDIF
> > #
> > # LDAPv3
> > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
> > # filter: ou=Profesor
> > # requesting: ALL
> > #
> >
> > # Profesori, DPPD, People, curs.pub.ro
> > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > ou: Profesori
> > objectClass: top
> > objectClass: organizationalunit
> >
> > # Asistenti-Man, DPPD, People, curs.pub.ro
> > dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > objectClass: top
> > objectClass: organizationalunit
> > ou: ou=Asistenti-Man
> > ou: Asistenti-Man
> >
> > # Profesori-Man, DPPD, People, curs.pub.ro
> > dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > objectClass: top
> > objectClass: organizationalunit
> > ou: ou=Profesori-Man
> > ou: Profesori-Man
> >
> > # Externi, DPPD, People, curs.pub.ro
> > dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > objectClass: top
> > objectClass: organizationalunit
> > ou: ou=Externi
> > ou: Externi
> >
> > # Auxiliari, DPPD, People, curs.pub.ro
> > dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > objectClass: top
> > objectClass: organizationalunit
> > ou: Auxiliari
> >
> > # search result
> > search: 2
> > result: 0 Success
> >
> > # numResponses: 6
> > # numEntries: 5
> >
> > If I put a filter of ou=Profeso, no entry is returned which is _fine_.
> > If I put ou=Profesor, all the entries are returned (even no entry is
> > matching the string). Something is matching on all entries.
>
> This sounds like it could be an index corruption or issue perhaps. Would you be able to run a dbscan of:
>
> cd /var/lib/dirsrv/slapd-<instance name>/<backend name>
> dbscan -r -f ou.db4
>
> For me this is:
>
> cd /var/lib/dirsrv/slapd-localhost/userRoot
>
> It would be interesting to see if you have a result of “=Profeso” but not “=Profesor”
>
> Please do this first, but after this, the solution may be a db2index to rebuild your index content. I would like to see the dbscans first though :)
>
> Thanks,
> > On Wed, Jan 23, 2019 at 9:06 AM Mihai Carabas  wrote:
> > > On Wed, Jan 23, 2019 at 4:52 AM William Brown  wrote:
> > > > > On 23 Jan 2019, at 02:01, Mihai Carabas  wrote:
> > > > >
> > > > > Helllo,
> > > > >
> > > > > On Tue, Jan 22, 2019 at 11:45 AM Ludwig  wrote:
> > > > > > The issue you are reporting does match exactly the issue in #49443, but
> > > > > > this was fixed and the fix is in current master. Also I cannot reproduce
> > > > > > it in current master and not with 1.4.20 -
> > > > > >
> > > > > > So this is a bit weird. Can you share a bit more of your data, eg
> > > > > > provide all entries below ou=DPPD dn and ou attribute, do you have an
> > > > > > index for ou ?
> > > > >
> > > > > Those are all _direct_ entries under ou=DPPD:
> > > > > # extended LDIF
> > > > > #
> > > > > # LDAPv3
> > > > > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
> > > > > # filter: (objectclass=*)
> > > > > # requesting: ALL
> > > > > #
> > > > >
> > > > > # Profesori, DPPD, People, curs.pub.ro
> > > > > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > > objectClass: top
> > > > > objectClass: organizationalunit
> > > > > ou: ou=Profesori
> > > > > ou: Profesori
> > > > >
> > > > > # Asistenti-Man, DPPD, People, curs.pub.ro
> > > > > dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > > objectClass: top
> > > > > objectClass: organizationalunit
> > > > > ou: ou=Asistenti-Man
> > > > > ou: Asistenti-Man
> > > > >
> > > > > # Profesori-Man, DPPD, People, curs.pub.ro
> > > > > dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > > objectClass: top
> > > > > objectClass: organizationalunit
> > > > > ou: ou=Profesori-Man
> > > > > ou: Profesori-Man
> > > > >
> > > > > # Externi, DPPD, People, curs.pub.ro
> > > > > dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > > objectClass: top
> > > > > objectClass: organizationalunit
> > > > > ou: ou=Externi
> > > > > ou: Externi
> > > > >
> > > > > # Auxiliari, DPPD, People, curs.pub.ro
> > > > > dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > > objectClass: top
> > > > > objectClass: organizationalunit
> > > > > ou: Auxiliari
> > > > >
> > > > > # search result
> > > > > search: 2
> > > > > result: 0 Success
> > > > >
> > > > > # numResponses: 6
> > > > > # numEntries: 5
> > > > >
> > > > > But for out=ACS, the filter is working:
> > > > > # extended LDIF
> > > > > #
> > > > > # LDAPv3
> > > > > # base <ou=ACS,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
> > > > > # filter: ou=Profesori
> > > > > # requesting: ALL
> > > > > #
> > > > >
> > > > > # Profesori, ACS, People, curs.pub.ro
> > > > > dn: ou=Profesori,ou=ACS,ou=People,dc=curs,dc=pub,dc=ro
> > > > > objectClass: top
> > > > > objectClass: organizationalunit
> > > > > ou: ou=Profesori
> > > > > ou: Profesori
> > > > >
> > > > > # search result
> > > > > search: 2
> > > > > result: 0 Success
> > > > >
> > > > > # numResponses: 2
> > > > > # numEntries: 1
> > > > >
> > > > > This is very wierd. I have an index for ou.
> > > >
> > > > This is indeed weird. Do you have the access log for this search operation? Can you please provide it?
> > >
> > > [23/Jan/2019:09:01:00.759258088 +0200] conn=208222 fd=71 slot=71
> > > connection from 141.85.241.48 to 141.85.241.48
> > > [23/Jan/2019:09:01:00.759495689 +0200] conn=208222 op=0 BIND
> > > dn="cn=directory manager" method=128 version=3
> > > [23/Jan/2019:09:01:00.759638289 +0200] conn=208222 op=0 RESULT err=0
> > > tag=97 nentries=0 etime=0.0000258701 dn="cn=directory manager"
> > > [23/Jan/2019:09:01:00.760046290 +0200] conn=208222 op=1 SRCH
> > > base="ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro" scope=1
> > > filter="(ou=Profesori)" attrs=ALL
> > > [23/Jan/2019:09:01:00.760605892 +0200] conn=208222 op=1 RESULT err=0
> > > tag=101 nentries=5 etime=0.0000696102
> > > [23/Jan/2019:09:01:00.761964296 +0200] conn=208222 op=2 UNBIND
> > > [23/Jan/2019:09:01:00.761988896 +0200] conn=208222 op=2 fd=71 closed - U1
> > > > Additionally, have you been able to reproduce this in a new instance? Or only on your “current” instance.
> > >
> > > Honestly I did not.
> > >
> > > One particular thing is that I have upgraded my Fedora25 step-by-step
> > > (I went through each version) and also 389-ds was upgraded. The
> > > dataset would contain old metadata from the old version of 389-ds?
> > >
> > > Thank you,
> > > Mihai
> > > > Thanks,
> > > >
> > > > —
> > > > Sincerely,
> > > >
> > > > William Brown
> > > > Software Engineer, 389 Directory Server
> > > > SUSE Labs
> > > > _______________________________________________
> > > > 389-users mailing list -- [e-mail]
> > > > To unsubscribe send an email to [e-mail]
> > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> >
> > 389-users mailing list -- [e-mail]
> > To unsubscribe send an email to [e-mail]
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
>
> —
> Sincerely,
>
> William Brown
> Software Engineer, 389 Directory Server
> SUSE Labs
> _______________________________________________
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[William Brown]

> On 24 Jan 2019, at 00:50, Mihai Carabas  wrote:
>
> =profesor
>        42815 42818 42821 42824 42827 42830 42833 42836 42839 42842
> 42845 42848 43445 43450 45720 52253
> =profesori
>        7 68 3232 3648 5457 6259 6268 6270 6275 6278 6280 6282 6304
> 6308 6323 7098 21827

Can you also send me the output of :

ldapsearch -b …. -s sub ‘(ou=Profesori)’ entryid

This is not contingent on db2index, so you can run the db2index and see if that corrects the issue now (if you have not already).

Thanks

—
Sincerely,

William Brown
Software Engineer, 389 Directory Server
SUSE Labs

[Mihai Carabas]

On Thu, Jan 24, 2019 at 12:52 AM William Brown  wrote:
> > On 24 Jan 2019, at 00:50, Mihai Carabas  wrote:
> >
> > =profesor
> >        42815 42818 42821 42824 42827 42830 42833 42836 42839 42842
> > 42845 42848 43445 43450 45720 52253
> > =profesori
> >        7 68 3232 3648 5457 6259 6268 6270 6275 6278 6280 6282 6304
> > 6308 6323 7098 21827
>
> Can you also send me the output of :
>
> ldapsearch -b …. -s sub ‘(ou=Profesori)’ entryid

# extended LDIF
#
# LDAPv3
# base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope subtree
# filter: ou=Profesori
# requesting: entryid
#

# Profesori, DPPD, People, curs.pub.ro
dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
entryid: 3648

# search result
search: 2
result: 0 Success

I issued db2index and I have the following output:
the 50% threshold.
[24/Jan/2019:15:14:31.578343786 +0200] - INFO - import_monitor_threads
- reindex cursdb: Ending pass number 1 ...
[24/Jan/2019:15:14:31.781708885 +0200] - INFO - import_monitor_threads
- reindex cursdb: Foreman is done; waiting for workers to finish...
[24/Jan/2019:15:14:32.055444491 +0200] - INFO - import_monitor_threads
- reindex cursdb: Workers finished; cleaning up...
[24/Jan/2019:15:14:32.259020991 +0200] - INFO - import_monitor_threads
- reindex cursdb: Workers cleaned up.
[24/Jan/2019:15:14:32.262209501 +0200] - INFO -
import_sweep_after_pass - reindex cursdb: Sweeping files for merging
later...
[24/Jan/2019:15:14:33.674826562 +0200] - INFO - dblayer_instance_start
- Import is running with nsslapd-db-private-import-mem on; No other
process is allowed to access the database
[24/Jan/2019:15:14:33.975430948 +0200] - INFO -
import_sweep_after_pass - reindex cursdb: Sweep done.
[24/Jan/2019:15:14:33.982718069 +0200] - INFO - import_main_offline -
reindex cursdb: Beginning pass number 2
[24/Jan/2019:15:14:54.035041942 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
204521866.1/sec, recent rate 0.0/sec, hit ratio 0%

[24/Jan/2019:15:15:14.086428912 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
104755102.1/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:15:34.138688984 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
70409167.0/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:15:54.189761953 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
53024187.5/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:16:14.239427918 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
42524348.4/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:16:34.483660956 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
35495530.5/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:16:54.533827623 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
30460703.5/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:17:14.586325096 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
26676765.1/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:17:34.636106261 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
23729056.3/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:17:54.686551928 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
21367956.2/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:18:14.812847819 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
19434204.5/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:18:34.883738846 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
17821407.4/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:18:54.938178725 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
16455782.3/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:19:14.995408557 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
15284552.3/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:19:35.047817446 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 2) -- average rate
14221719.2/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:19:35.051470957 +0200] - INFO - import_throw_in_towel
- reindex cursdb: Decided to end this pass because the progress rate
has dropped below the 50% threshold.
[24/Jan/2019:15:19:35.054926468 +0200] - INFO - import_monitor_threads
- reindex cursdb: Ending pass number 2 ...
[24/Jan/2019:15:19:35.258101594 +0200] - INFO - import_monitor_threads
- reindex cursdb: Foreman is done; waiting for workers to finish...
[24/Jan/2019:15:19:35.261243303 +0200] - INFO - import_monitor_threads
- reindex cursdb: Workers finished; cleaning up...
[24/Jan/2019:15:19:35.464851131 +0200] - INFO - import_monitor_threads
- reindex cursdb: Workers cleaned up.
[24/Jan/2019:15:19:35.467968441 +0200] - INFO -
import_sweep_after_pass - reindex cursdb: Sweeping files for merging
later...
[24/Jan/2019:15:19:35.506390559 +0200] - INFO - dblayer_instance_start
- Import is running with nsslapd-db-private-import-mem on; No other
process is allowed to access the database
[24/Jan/2019:15:19:35.731292752 +0200] - INFO -
import_sweep_after_pass - reindex cursdb: Sweep done.
[24/Jan/2019:15:19:35.734380561 +0200] - INFO - import_main_offline -
reindex cursdb: Beginning pass number 3
[24/Jan/2019:15:19:55.782461337 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:20:15.834380724 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
107373979.7/sec, recent rate 0.0/sec, hit ratio 0%

[24/Jan/2019:15:20:35.886774313 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
71582653.1/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:20:55.938228899 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
53686989.9/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:21:15.988693682 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
42949591.9/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:21:40.661184607 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
34359673.5/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:22:00.820373724 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
29620408.2/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:22:20.872956514 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
26030055.7/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:22:40.928481812 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
23215995.6/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:23:00.983057008 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
20951020.4/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:23:21.398151214 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
19004244.2/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:23:41.466437252 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
17459183.7/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:24:01.517539137 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
16146463.1/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:24:21.568626321 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
15017339.8/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:24:41.726888036 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 3) -- average rate
14035814.3/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:24:41.731112549 +0200] - INFO - import_throw_in_towel
- reindex cursdb: Decided to end this pass because the progress rate
has dropped below the 50% threshold.
[24/Jan/2019:15:24:41.734400859 +0200] - INFO - import_monitor_threads
- reindex cursdb: Ending pass number 3 ...
[24/Jan/2019:15:24:41.837514477 +0200] - INFO - import_monitor_threads
- reindex cursdb: Foreman is done; waiting for workers to finish...
[24/Jan/2019:15:24:41.841081788 +0200] - INFO - import_monitor_threads
- reindex cursdb: Workers finished; cleaning up...
[24/Jan/2019:15:24:41.944805808 +0200] - INFO - import_monitor_threads
- reindex cursdb: Workers cleaned up.
[24/Jan/2019:15:24:41.948172218 +0200] - INFO -
import_sweep_after_pass - reindex cursdb: Sweeping files for merging
later...
[24/Jan/2019:15:24:41.972718294 +0200] - INFO - dblayer_instance_start
- Import is running with nsslapd-db-private-import-mem on; No other
process is allowed to access the database
[24/Jan/2019:15:24:42.277287032 +0200] - INFO -
import_sweep_after_pass - reindex cursdb: Sweep done.
[24/Jan/2019:15:24:42.524714295 +0200] - INFO - import_main_offline -
reindex cursdb: Beginning pass number 4
[24/Jan/2019:15:25:02.589790122 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 4) -- average rate
214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
[24/Jan/2019:15:25:22.648607831 +0200] - INFO - import_monitor_threads
- reindex cursdb: Processed 8108 entries (pass 4) -- average rate
107373979.7/sec, recent rate 0.0/sec, hit ratio 0%

And it takes a long time. What should I do?
> This is not contingent on db2index, so you can run the db2index and see if that corrects the issue now (if you have not already).
>
> Thanks
>
> —
> Sincerely,
>
> William Brown
> Software Engineer, 389 Directory Server
> SUSE Labs
> _______________________________________________
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mark Reynolds]

On 1/24/19 8:37 AM, Mihai Carabas wrote:
> On Thu, Jan 24, 2019 at 12:52 AM William Brown  wrote:
> > > On 24 Jan 2019, at 00:50, Mihai Carabas  wrote:
> > >
> > > =profesor
> > >         42815 42818 42821 42824 42827 42830 42833 42836 42839 42842
> > > 42845 42848 43445 43450 45720 52253
> > > =profesori
> > >         7 68 3232 3648 5457 6259 6268 6270 6275 6278 6280 6282 6304
> > > 6308 6323 7098 21827
> >
> > Can you also send me the output of :
> >
> > ldapsearch -b …. -s sub ‘(ou=Profesori)’ entryid
>
> # extended LDIF
> #
> # LDAPv3
> # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope subtree
> # filter: ou=Profesori
> # requesting: entryid
> #
>
> # Profesori, DPPD, People, curs.pub.ro
> dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> entryid: 3648
>
> # search result
> search: 2
> result: 0 Success
>
> I issued db2index and I have the following output:
> the 50% threshold.
> [24/Jan/2019:15:14:31.578343786 +0200] - INFO - import_monitor_threads
> reindex cursdb: Ending pass number 1 ...
>
> [24/Jan/2019:15:14:31.781708885 +0200] - INFO - import_monitor_threads
> reindex cursdb: Foreman is done; waiting for workers to finish...
>
> [24/Jan/2019:15:14:32.055444491 +0200] - INFO - import_monitor_threads
> reindex cursdb: Workers finished; cleaning up...
>
> [24/Jan/2019:15:14:32.259020991 +0200] - INFO - import_monitor_threads
> reindex cursdb: Workers cleaned up.
>
> [24/Jan/2019:15:14:32.262209501 +0200] - INFO -
> import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> later...
> [24/Jan/2019:15:14:33.674826562 +0200] - INFO - dblayer_instance_start
> Import is running with nsslapd-db-private-import-mem on; No other
>
> process is allowed to access the database
> [24/Jan/2019:15:14:33.975430948 +0200] - INFO -
> import_sweep_after_pass - reindex cursdb: Sweep done.
> [24/Jan/2019:15:14:33.982718069 +0200] - INFO - import_main_offline -
> reindex cursdb: Beginning pass number 2
> [24/Jan/2019:15:14:54.035041942 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 204521866.1/sec, recent rate 0.0/sec, hit ratio 0%
>
> [24/Jan/2019:15:15:14.086428912 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 104755102.1/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:15:34.138688984 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 70409167.0/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:15:54.189761953 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 53024187.5/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:16:14.239427918 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 42524348.4/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:16:34.483660956 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 35495530.5/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:16:54.533827623 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 30460703.5/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:17:14.586325096 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 26676765.1/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:17:34.636106261 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 23729056.3/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:17:54.686551928 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 21367956.2/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:18:14.812847819 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 19434204.5/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:18:34.883738846 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 17821407.4/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:18:54.938178725 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 16455782.3/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:19:14.995408557 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 15284552.3/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:19:35.047817446 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 14221719.2/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:19:35.051470957 +0200] - INFO - import_throw_in_towel
> reindex cursdb: Decided to end this pass because the progress rate
>
> has dropped below the 50% threshold.
> [24/Jan/2019:15:19:35.054926468 +0200] - INFO - import_monitor_threads
> reindex cursdb: Ending pass number 2 ...
>
> [24/Jan/2019:15:19:35.258101594 +0200] - INFO - import_monitor_threads
> reindex cursdb: Foreman is done; waiting for workers to finish...
>
> [24/Jan/2019:15:19:35.261243303 +0200] - INFO - import_monitor_threads
> reindex cursdb: Workers finished; cleaning up...
>
> [24/Jan/2019:15:19:35.464851131 +0200] - INFO - import_monitor_threads
> reindex cursdb: Workers cleaned up.
>
> [24/Jan/2019:15:19:35.467968441 +0200] - INFO -
> import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> later...
> [24/Jan/2019:15:19:35.506390559 +0200] - INFO - dblayer_instance_start
> Import is running with nsslapd-db-private-import-mem on; No other
>
> process is allowed to access the database
> [24/Jan/2019:15:19:35.731292752 +0200] - INFO -
> import_sweep_after_pass - reindex cursdb: Sweep done.
> [24/Jan/2019:15:19:35.734380561 +0200] - INFO - import_main_offline -
> reindex cursdb: Beginning pass number 3
> [24/Jan/2019:15:19:55.782461337 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:20:15.834380724 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
>
> [24/Jan/2019:15:20:35.886774313 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 71582653.1/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:20:55.938228899 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 53686989.9/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:21:15.988693682 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 42949591.9/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:21:40.661184607 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 34359673.5/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:22:00.820373724 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 29620408.2/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:22:20.872956514 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 26030055.7/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:22:40.928481812 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 23215995.6/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:23:00.983057008 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 20951020.4/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:23:21.398151214 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 19004244.2/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:23:41.466437252 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 17459183.7/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:24:01.517539137 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 16146463.1/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:24:21.568626321 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 15017339.8/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:24:41.726888036 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 14035814.3/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:24:41.731112549 +0200] - INFO - import_throw_in_towel
> reindex cursdb: Decided to end this pass because the progress rate
>
> has dropped below the 50% threshold.
> [24/Jan/2019:15:24:41.734400859 +0200] - INFO - import_monitor_threads
> reindex cursdb: Ending pass number 3 ...
>
> [24/Jan/2019:15:24:41.837514477 +0200] - INFO - import_monitor_threads
> reindex cursdb: Foreman is done; waiting for workers to finish...
>
> [24/Jan/2019:15:24:41.841081788 +0200] - INFO - import_monitor_threads
> reindex cursdb: Workers finished; cleaning up...
>
> [24/Jan/2019:15:24:41.944805808 +0200] - INFO - import_monitor_threads
> reindex cursdb: Workers cleaned up.
>
> [24/Jan/2019:15:24:41.948172218 +0200] - INFO -
> import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> later...
> [24/Jan/2019:15:24:41.972718294 +0200] - INFO - dblayer_instance_start
> Import is running with nsslapd-db-private-import-mem on; No other
>
> process is allowed to access the database
> [24/Jan/2019:15:24:42.277287032 +0200] - INFO -
> import_sweep_after_pass - reindex cursdb: Sweep done.
> [24/Jan/2019:15:24:42.524714295 +0200] - INFO - import_main_offline -
> reindex cursdb: Beginning pass number 4
> [24/Jan/2019:15:25:02.589790122 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 4) -- average rate
>
> 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:25:22.648607831 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 4) -- average rate
>
> 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
>
> And it takes a long time. What should I do?

This is very odd that the index task is not proceeding.  Are there more 
than 8108 entries in the database?  Or is that the size of the db in 
entries?

If the task is still running can you grab a stack traces using this process:

http://www.port389.org/docs/389ds/FAQ/faq.html#debugging-hangs

Grab  a few stack traces with that gdb command, and send them to us please.

Then to fix it I think we need to do an export & import of the 
database.  That will regenerate everything.  If you are using 
replication then use the "--replication" option with db2ldif, otherwise 
do not use that option:

dsctl <INSTANCE> stop    --->  You might have to kill the process 
if the reindex is hanging :-(

dsctl <INSTANCE> db2ldif userroot <LDIF file name> --replication

Then import that LDIF

dsctl <INSTANCE> ldif2db userroot <LDIF file name>

dsctl <INSTANCE> start

Then retry your search tests.

Regards,

Mark
> > This is not contingent on db2index, so you can run the db2index and see if that corrects the issue now (if you have not already).
> >
> > Thanks
> >
> > —
> > Sincerely,
> >
> > William Brown
> > Software Engineer, 389 Directory Server
> > SUSE Labs
> > _______________________________________________
> > 389-users mailing list -- [e-mail]
> > To unsubscribe send an email to [e-mail]
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
>
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mihai Carabas]

Hello Mark,

On Thu, Jan 24, 2019 at 4:35 PM Mark Reynolds  wrote:
> On 1/24/19 8:37 AM, Mihai Carabas wrote:
> > On Thu, Jan 24, 2019 at 12:52 AM William Brown  wrote:
> > > > On 24 Jan 2019, at 00:50, Mihai Carabas  wrote:
> > > >
> > > > =profesor
> > > >         42815 42818 42821 42824 42827 42830 42833 42836 42839 42842
> > > > 42845 42848 43445 43450 45720 52253
> > > > =profesori
> > > >         7 68 3232 3648 5457 6259 6268 6270 6275 6278 6280 6282 6304
> > > > 6308 6323 7098 21827
> > >
> > > Can you also send me the output of :
> > >
> > > ldapsearch -b …. -s sub ‘(ou=Profesori)’ entryid
> >
> > # extended LDIF
> > #
> > # LDAPv3
> > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope subtree
> > # filter: ou=Profesori
> > # requesting: entryid
> > #
> >
> > # Profesori, DPPD, People, curs.pub.ro
> > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > entryid: 3648
> >
> > # search result
> > search: 2
> > result: 0 Success
> >
> > I issued db2index and I have the following output:
> > the 50% threshold.
> > [24/Jan/2019:15:14:31.578343786 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Ending pass number 1 ...
> >
> > [24/Jan/2019:15:14:31.781708885 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Foreman is done; waiting for workers to finish...
> >
> > [24/Jan/2019:15:14:32.055444491 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Workers finished; cleaning up...
> >
> > [24/Jan/2019:15:14:32.259020991 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Workers cleaned up.
> >
> > [24/Jan/2019:15:14:32.262209501 +0200] - INFO -
> > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > later...
> > [24/Jan/2019:15:14:33.674826562 +0200] - INFO - dblayer_instance_start
> > Import is running with nsslapd-db-private-import-mem on; No other
> >
> > process is allowed to access the database
> > [24/Jan/2019:15:14:33.975430948 +0200] - INFO -
> > import_sweep_after_pass - reindex cursdb: Sweep done.
> > [24/Jan/2019:15:14:33.982718069 +0200] - INFO - import_main_offline -
> > reindex cursdb: Beginning pass number 2
> > [24/Jan/2019:15:14:54.035041942 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 204521866.1/sec, recent rate 0.0/sec, hit ratio 0%
> >
> > [24/Jan/2019:15:15:14.086428912 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 104755102.1/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:15:34.138688984 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 70409167.0/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:15:54.189761953 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 53024187.5/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:16:14.239427918 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 42524348.4/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:16:34.483660956 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 35495530.5/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:16:54.533827623 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 30460703.5/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:17:14.586325096 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 26676765.1/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:17:34.636106261 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 23729056.3/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:17:54.686551928 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 21367956.2/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:18:14.812847819 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 19434204.5/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:18:34.883738846 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 17821407.4/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:18:54.938178725 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 16455782.3/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:19:14.995408557 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 15284552.3/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:19:35.047817446 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> >
> > 14221719.2/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:19:35.051470957 +0200] - INFO - import_throw_in_towel
> > reindex cursdb: Decided to end this pass because the progress rate
> >
> > has dropped below the 50% threshold.
> > [24/Jan/2019:15:19:35.054926468 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Ending pass number 2 ...
> >
> > [24/Jan/2019:15:19:35.258101594 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Foreman is done; waiting for workers to finish...
> >
> > [24/Jan/2019:15:19:35.261243303 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Workers finished; cleaning up...
> >
> > [24/Jan/2019:15:19:35.464851131 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Workers cleaned up.
> >
> > [24/Jan/2019:15:19:35.467968441 +0200] - INFO -
> > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > later...
> > [24/Jan/2019:15:19:35.506390559 +0200] - INFO - dblayer_instance_start
> > Import is running with nsslapd-db-private-import-mem on; No other
> >
> > process is allowed to access the database
> > [24/Jan/2019:15:19:35.731292752 +0200] - INFO -
> > import_sweep_after_pass - reindex cursdb: Sweep done.
> > [24/Jan/2019:15:19:35.734380561 +0200] - INFO - import_main_offline -
> > reindex cursdb: Beginning pass number 3
> > [24/Jan/2019:15:19:55.782461337 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:20:15.834380724 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> >
> > [24/Jan/2019:15:20:35.886774313 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 71582653.1/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:20:55.938228899 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 53686989.9/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:21:15.988693682 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 42949591.9/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:21:40.661184607 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 34359673.5/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:22:00.820373724 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 29620408.2/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:22:20.872956514 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 26030055.7/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:22:40.928481812 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 23215995.6/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:23:00.983057008 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 20951020.4/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:23:21.398151214 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 19004244.2/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:23:41.466437252 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 17459183.7/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:24:01.517539137 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 16146463.1/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:24:21.568626321 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 15017339.8/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:24:41.726888036 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> >
> > 14035814.3/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:24:41.731112549 +0200] - INFO - import_throw_in_towel
> > reindex cursdb: Decided to end this pass because the progress rate
> >
> > has dropped below the 50% threshold.
> > [24/Jan/2019:15:24:41.734400859 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Ending pass number 3 ...
> >
> > [24/Jan/2019:15:24:41.837514477 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Foreman is done; waiting for workers to finish...
> >
> > [24/Jan/2019:15:24:41.841081788 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Workers finished; cleaning up...
> >
> > [24/Jan/2019:15:24:41.944805808 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Workers cleaned up.
> >
> > [24/Jan/2019:15:24:41.948172218 +0200] - INFO -
> > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > later...
> > [24/Jan/2019:15:24:41.972718294 +0200] - INFO - dblayer_instance_start
> > Import is running with nsslapd-db-private-import-mem on; No other
> >
> > process is allowed to access the database
> > [24/Jan/2019:15:24:42.277287032 +0200] - INFO -
> > import_sweep_after_pass - reindex cursdb: Sweep done.
> > [24/Jan/2019:15:24:42.524714295 +0200] - INFO - import_main_offline -
> > reindex cursdb: Beginning pass number 4
> > [24/Jan/2019:15:25:02.589790122 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> >
> > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > [24/Jan/2019:15:25:22.648607831 +0200] - INFO - import_monitor_threads
> > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> >
> > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> >
> > And it takes a long time. What should I do?
>
> This is very odd that the index task is not proceeding.  Are there more
> than 8108 entries in the database?  Or is that the size of the db in
> entries?

I have more de 70000 users. So I do not think that is the size of the db.
> If the task is still running can you grab a stack traces using this process:
>
> http://www.port389.org/docs/389ds/FAQ/faq.html#debugging-hangs
>
> Grab  a few stack traces with that gdb command, and send them to us please.

Unfortunatelly I've closed the db2index command and I've restored the
Directory Server from a previous backup. I couldn' afford to wait much
longer.
> Then to fix it I think we need to do an export & import of the
> database.  That will regenerate everything.  If you are using
> replication then use the "--replication" option with db2ldif, otherwise
> do not use that option:
>  dsctl <INSTANCE> stop    --->  You might have to kill the process
>
> if the reindex is hanging :-(
>  dsctl <INSTANCE> db2ldif userroot <LDIF file name> --replication
>
> Then import that LDIF
>  dsctl <INSTANCE> ldif2db userroot <LDIF file name>
>
>  dsctl <INSTANCE> start
>
>
> Then retry your search tests.

This should be done on my restored running instace?

I have a replication with Active Directory. This will be affected?
> Regards,
>
> Mark
> > > This is not contingent on db2index, so you can run the db2index and see if that corrects the issue now (if you have not already).
> > >
> > > Thanks
> > >
> > > —
> > > Sincerely,
> > >
> > > William Brown
> > > Software Engineer, 389 Directory Server
> > > SUSE Labs
> > > _______________________________________________
> > > 389-users mailing list -- [e-mail]
> > > To unsubscribe send an email to [e-mail]
> > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> >
> > 389-users mailing list -- [e-mail]
> > To unsubscribe send an email to [e-mail]
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mihai Carabas]

Also I used db2index on the stopped Directory Server. Should I have
used db2index.pl on the running one?

Thanks,
Mihai

On Thu, Jan 24, 2019 at 5:24 PM Mihai Carabas  wrote:
> Hello Mark,
>
> On Thu, Jan 24, 2019 at 4:35 PM Mark Reynolds  wrote:
> > On 1/24/19 8:37 AM, Mihai Carabas wrote:
> > > On Thu, Jan 24, 2019 at 12:52 AM William Brown  wrote:
> > > > > On 24 Jan 2019, at 00:50, Mihai Carabas  wrote:
> > > > >
> > > > > =profesor
> > > > >         42815 42818 42821 42824 42827 42830 42833 42836 42839 42842
> > > > > 42845 42848 43445 43450 45720 52253
> > > > > =profesori
> > > > >         7 68 3232 3648 5457 6259 6268 6270 6275 6278 6280 6282 6304
> > > > > 6308 6323 7098 21827
> > > >
> > > > Can you also send me the output of :
> > > >
> > > > ldapsearch -b …. -s sub ‘(ou=Profesori)’ entryid
> > >
> > > # extended LDIF
> > > #
> > > # LDAPv3
> > > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope subtree
> > > # filter: ou=Profesori
> > > # requesting: entryid
> > > #
> > >
> > > # Profesori, DPPD, People, curs.pub.ro
> > > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > entryid: 3648
> > >
> > > # search result
> > > search: 2
> > > result: 0 Success
> > >
> > > I issued db2index and I have the following output:
> > > the 50% threshold.
> > > [24/Jan/2019:15:14:31.578343786 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Ending pass number 1 ...
> > >
> > > [24/Jan/2019:15:14:31.781708885 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > >
> > > [24/Jan/2019:15:14:32.055444491 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Workers finished; cleaning up...
> > >
> > > [24/Jan/2019:15:14:32.259020991 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Workers cleaned up.
> > >
> > > [24/Jan/2019:15:14:32.262209501 +0200] - INFO -
> > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > later...
> > > [24/Jan/2019:15:14:33.674826562 +0200] - INFO - dblayer_instance_start
> > > Import is running with nsslapd-db-private-import-mem on; No other
> > >
> > > process is allowed to access the database
> > > [24/Jan/2019:15:14:33.975430948 +0200] - INFO -
> > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > [24/Jan/2019:15:14:33.982718069 +0200] - INFO - import_main_offline -
> > > reindex cursdb: Beginning pass number 2
> > > [24/Jan/2019:15:14:54.035041942 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 204521866.1/sec, recent rate 0.0/sec, hit ratio 0%
> > >
> > > [24/Jan/2019:15:15:14.086428912 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 104755102.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:15:34.138688984 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 70409167.0/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:15:54.189761953 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 53024187.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:16:14.239427918 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 42524348.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:16:34.483660956 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 35495530.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:16:54.533827623 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 30460703.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:17:14.586325096 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 26676765.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:17:34.636106261 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 23729056.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:17:54.686551928 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 21367956.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:18:14.812847819 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 19434204.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:18:34.883738846 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 17821407.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:18:54.938178725 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 16455782.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:19:14.995408557 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 15284552.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:19:35.047817446 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 14221719.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:19:35.051470957 +0200] - INFO - import_throw_in_towel
> > > reindex cursdb: Decided to end this pass because the progress rate
> > >
> > > has dropped below the 50% threshold.
> > > [24/Jan/2019:15:19:35.054926468 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Ending pass number 2 ...
> > >
> > > [24/Jan/2019:15:19:35.258101594 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > >
> > > [24/Jan/2019:15:19:35.261243303 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Workers finished; cleaning up...
> > >
> > > [24/Jan/2019:15:19:35.464851131 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Workers cleaned up.
> > >
> > > [24/Jan/2019:15:19:35.467968441 +0200] - INFO -
> > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > later...
> > > [24/Jan/2019:15:19:35.506390559 +0200] - INFO - dblayer_instance_start
> > > Import is running with nsslapd-db-private-import-mem on; No other
> > >
> > > process is allowed to access the database
> > > [24/Jan/2019:15:19:35.731292752 +0200] - INFO -
> > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > [24/Jan/2019:15:19:35.734380561 +0200] - INFO - import_main_offline -
> > > reindex cursdb: Beginning pass number 3
> > > [24/Jan/2019:15:19:55.782461337 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:20:15.834380724 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > >
> > > [24/Jan/2019:15:20:35.886774313 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 71582653.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:20:55.938228899 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 53686989.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:21:15.988693682 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 42949591.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:21:40.661184607 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 34359673.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:22:00.820373724 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 29620408.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:22:20.872956514 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 26030055.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:22:40.928481812 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 23215995.6/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:23:00.983057008 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 20951020.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:23:21.398151214 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 19004244.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:23:41.466437252 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 17459183.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:24:01.517539137 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 16146463.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:24:21.568626321 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 15017339.8/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:24:41.726888036 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 14035814.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:24:41.731112549 +0200] - INFO - import_throw_in_towel
> > > reindex cursdb: Decided to end this pass because the progress rate
> > >
> > > has dropped below the 50% threshold.
> > > [24/Jan/2019:15:24:41.734400859 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Ending pass number 3 ...
> > >
> > > [24/Jan/2019:15:24:41.837514477 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > >
> > > [24/Jan/2019:15:24:41.841081788 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Workers finished; cleaning up...
> > >
> > > [24/Jan/2019:15:24:41.944805808 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Workers cleaned up.
> > >
> > > [24/Jan/2019:15:24:41.948172218 +0200] - INFO -
> > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > later...
> > > [24/Jan/2019:15:24:41.972718294 +0200] - INFO - dblayer_instance_start
> > > Import is running with nsslapd-db-private-import-mem on; No other
> > >
> > > process is allowed to access the database
> > > [24/Jan/2019:15:24:42.277287032 +0200] - INFO -
> > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > [24/Jan/2019:15:24:42.524714295 +0200] - INFO - import_main_offline -
> > > reindex cursdb: Beginning pass number 4
> > > [24/Jan/2019:15:25:02.589790122 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > >
> > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:25:22.648607831 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > >
> > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > >
> > > And it takes a long time. What should I do?
> >
> > This is very odd that the index task is not proceeding.  Are there more
> > than 8108 entries in the database?  Or is that the size of the db in
> > entries?
>
> I have more de 70000 users. So I do not think that is the size of the db.
> > If the task is still running can you grab a stack traces using this process:
> >
> > http://www.port389.org/docs/389ds/FAQ/faq.html#debugging-hangs
> >
> > Grab  a few stack traces with that gdb command, and send them to us please.
>
> Unfortunatelly I've closed the db2index command and I've restored the
> Directory Server from a previous backup. I couldn' afford to wait much
> longer.
> > Then to fix it I think we need to do an export & import of the
> > database.  That will regenerate everything.  If you are using
> > replication then use the "--replication" option with db2ldif, otherwise
> > do not use that option:
> >  dsctl <INSTANCE> stop    --->  You might have to kill the process
> >
> > if the reindex is hanging :-(
> >  dsctl <INSTANCE> db2ldif userroot <LDIF file name> --replication
> >
> > Then import that LDIF
> >  dsctl <INSTANCE> ldif2db userroot <LDIF file name>
> >
> >  dsctl <INSTANCE> start
> >
> >
> > Then retry your search tests.
>
> This should be done on my restored running instace?
>
> I have a replication with Active Directory. This will be affected?
> > Regards,
> >
> > Mark
> > > > This is not contingent on db2index, so you can run the db2index and see if that corrects the issue now (if you have not already).
> > > >
> > > > Thanks
> > > >
> > > > —
> > > > Sincerely,
> > > >
> > > > William Brown
> > > > Software Engineer, 389 Directory Server
> > > > SUSE Labs
> > > > _______________________________________________
> > > > 389-users mailing list -- [e-mail]
> > > > To unsubscribe send an email to [e-mail]
> > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> > >
> > > 389-users mailing list -- [e-mail]
> > > To unsubscribe send an email to [e-mail]
> > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mark Reynolds]

On 1/24/19 10:26 AM, Mihai Carabas wrote:
> Also I used db2index on the stopped Directory Server. Should I have
> used db2index.pl on the running one?

IMO, it's best to stop to the server when doing these types of operations.

Mark
> Thanks,
> Mihai
>
> On Thu, Jan 24, 2019 at 5:24 PM Mihai Carabas  wrote:
> > Hello Mark,
> >
> > On Thu, Jan 24, 2019 at 4:35 PM Mark Reynolds  wrote:
> > > On 1/24/19 8:37 AM, Mihai Carabas wrote:
> > > > On Thu, Jan 24, 2019 at 12:52 AM William Brown  wrote:
> > > > > > On 24 Jan 2019, at 00:50, Mihai Carabas  wrote:
> > > > > >
> > > > > > =profesor
> > > > > >          42815 42818 42821 42824 42827 42830 42833 42836 42839 42842
> > > > > > 42845 42848 43445 43450 45720 52253
> > > > > > =profesori
> > > > > >          7 68 3232 3648 5457 6259 6268 6270 6275 6278 6280 6282 6304
> > > > > > 6308 6323 7098 21827
> > > > >
> > > > > Can you also send me the output of :
> > > > >
> > > > > ldapsearch -b …. -s sub ‘(ou=Profesori)’ entryid
> > > >
> > > > # extended LDIF
> > > > #
> > > > # LDAPv3
> > > > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope subtree
> > > > # filter: ou=Profesori
> > > > # requesting: entryid
> > > > #
> > > >
> > > > # Profesori, DPPD, People, curs.pub.ro
> > > > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > entryid: 3648
> > > >
> > > > # search result
> > > > search: 2
> > > > result: 0 Success
> > > >
> > > > I issued db2index and I have the following output:
> > > > the 50% threshold.
> > > > [24/Jan/2019:15:14:31.578343786 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Ending pass number 1 ...
> > > >
> > > > [24/Jan/2019:15:14:31.781708885 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > >
> > > > [24/Jan/2019:15:14:32.055444491 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Workers finished; cleaning up...
> > > >
> > > > [24/Jan/2019:15:14:32.259020991 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Workers cleaned up.
> > > >
> > > > [24/Jan/2019:15:14:32.262209501 +0200] - INFO -
> > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > later...
> > > > [24/Jan/2019:15:14:33.674826562 +0200] - INFO - dblayer_instance_start
> > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > >
> > > > process is allowed to access the database
> > > > [24/Jan/2019:15:14:33.975430948 +0200] - INFO -
> > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > [24/Jan/2019:15:14:33.982718069 +0200] - INFO - import_main_offline -
> > > > reindex cursdb: Beginning pass number 2
> > > > [24/Jan/2019:15:14:54.035041942 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 204521866.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > >
> > > > [24/Jan/2019:15:15:14.086428912 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 104755102.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:15:34.138688984 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 70409167.0/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:15:54.189761953 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 53024187.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:16:14.239427918 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 42524348.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:16:34.483660956 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 35495530.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:16:54.533827623 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 30460703.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:17:14.586325096 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 26676765.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:17:34.636106261 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 23729056.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:17:54.686551928 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 21367956.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:18:14.812847819 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 19434204.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:18:34.883738846 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 17821407.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:18:54.938178725 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 16455782.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:19:14.995408557 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 15284552.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:19:35.047817446 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 14221719.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:19:35.051470957 +0200] - INFO - import_throw_in_towel
> > > > reindex cursdb: Decided to end this pass because the progress rate
> > > >
> > > > has dropped below the 50% threshold.
> > > > [24/Jan/2019:15:19:35.054926468 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Ending pass number 2 ...
> > > >
> > > > [24/Jan/2019:15:19:35.258101594 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > >
> > > > [24/Jan/2019:15:19:35.261243303 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Workers finished; cleaning up...
> > > >
> > > > [24/Jan/2019:15:19:35.464851131 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Workers cleaned up.
> > > >
> > > > [24/Jan/2019:15:19:35.467968441 +0200] - INFO -
> > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > later...
> > > > [24/Jan/2019:15:19:35.506390559 +0200] - INFO - dblayer_instance_start
> > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > >
> > > > process is allowed to access the database
> > > > [24/Jan/2019:15:19:35.731292752 +0200] - INFO -
> > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > [24/Jan/2019:15:19:35.734380561 +0200] - INFO - import_main_offline -
> > > > reindex cursdb: Beginning pass number 3
> > > > [24/Jan/2019:15:19:55.782461337 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:20:15.834380724 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > >
> > > > [24/Jan/2019:15:20:35.886774313 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 71582653.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:20:55.938228899 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 53686989.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:21:15.988693682 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 42949591.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:21:40.661184607 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 34359673.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:22:00.820373724 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 29620408.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:22:20.872956514 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 26030055.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:22:40.928481812 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 23215995.6/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:23:00.983057008 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 20951020.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:23:21.398151214 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 19004244.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:23:41.466437252 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 17459183.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:24:01.517539137 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 16146463.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:24:21.568626321 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 15017339.8/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:24:41.726888036 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 14035814.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:24:41.731112549 +0200] - INFO - import_throw_in_towel
> > > > reindex cursdb: Decided to end this pass because the progress rate
> > > >
> > > > has dropped below the 50% threshold.
> > > > [24/Jan/2019:15:24:41.734400859 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Ending pass number 3 ...
> > > >
> > > > [24/Jan/2019:15:24:41.837514477 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > >
> > > > [24/Jan/2019:15:24:41.841081788 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Workers finished; cleaning up...
> > > >
> > > > [24/Jan/2019:15:24:41.944805808 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Workers cleaned up.
> > > >
> > > > [24/Jan/2019:15:24:41.948172218 +0200] - INFO -
> > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > later...
> > > > [24/Jan/2019:15:24:41.972718294 +0200] - INFO - dblayer_instance_start
> > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > >
> > > > process is allowed to access the database
> > > > [24/Jan/2019:15:24:42.277287032 +0200] - INFO -
> > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > [24/Jan/2019:15:24:42.524714295 +0200] - INFO - import_main_offline -
> > > > reindex cursdb: Beginning pass number 4
> > > > [24/Jan/2019:15:25:02.589790122 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > > >
> > > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:25:22.648607831 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > > >
> > > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > >
> > > > And it takes a long time. What should I do?
> > >
> > > This is very odd that the index task is not proceeding.  Are there more
> > > than 8108 entries in the database?  Or is that the size of the db in
> > > entries?
> >
> > I have more de 70000 users. So I do not think that is the size of the db.
> > > If the task is still running can you grab a stack traces using this process:
> > >
> > > http://www.port389.org/docs/389ds/FAQ/faq.html#debugging-hangs
> > >
> > > Grab  a few stack traces with that gdb command, and send them to us please.
> >
> > Unfortunatelly I've closed the db2index command and I've restored the
> > Directory Server from a previous backup. I couldn' afford to wait much
> > longer.
> > > Then to fix it I think we need to do an export & import of the
> > > database.  That will regenerate everything.  If you are using
> > > replication then use the "--replication" option with db2ldif, otherwise
> > > do not use that option:
> > >   dsctl <INSTANCE> stop    --->  You might have to kill the process
> > >
> > > if the reindex is hanging :-(
> > >   dsctl <INSTANCE> db2ldif userroot <LDIF file name> --replication
> > >
> > > Then import that LDIF
> > >   dsctl <INSTANCE> ldif2db userroot <LDIF file name>
> > >
> > >   dsctl <INSTANCE> start
> > >
> > >
> > > Then retry your search tests.
> >
> > This should be done on my restored running instace?
> >
> > I have a replication with Active Directory. This will be affected?
> > > Regards,
> > >
> > > Mark
> > > > > This is not contingent on db2index, so you can run the db2index and see if that corrects the issue now (if you have not already).
> > > > >
> > > > > Thanks
> > > > >
> > > > > —
> > > > > Sincerely,
> > > > >
> > > > > William Brown
> > > > > Software Engineer, 389 Directory Server
> > > > > SUSE Labs
> > > > > _______________________________________________
> > > > > 389-users mailing list -- [e-mail]
> > > > > To unsubscribe send an email to [e-mail]
> > > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> > > >
> > > > 389-users mailing list -- [e-mail]
> > > > To unsubscribe send an email to [e-mail]
> > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
>
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mihai Carabas]

Hello,

[root@ldap ~]# dsctl slapd-ldap db2ldif --replication cursdb cursdb.ldif

cursdb.ldif doesn't seem to contain any replication related info. What
should contain related to replication?

Thank you,
Mihai

On Thu, Jan 24, 2019 at 5:53 PM Mark Reynolds  wrote:
> On 1/24/19 10:26 AM, Mihai Carabas wrote:
> > Also I used db2index on the stopped Directory Server. Should I have
> > used db2index.pl on the running one?
>
> IMO, it's best to stop to the server when doing these types of operations.
>
> Mark
> > Thanks,
> > Mihai
> >
> > On Thu, Jan 24, 2019 at 5:24 PM Mihai Carabas  wrote:
> > > Hello Mark,
> > >
> > > On Thu, Jan 24, 2019 at 4:35 PM Mark Reynolds  wrote:
> > > > On 1/24/19 8:37 AM, Mihai Carabas wrote:
> > > > > On Thu, Jan 24, 2019 at 12:52 AM William Brown  wrote:
> > > > > > > On 24 Jan 2019, at 00:50, Mihai Carabas  wrote:
> > > > > > >
> > > > > > > =profesor
> > > > > > >          42815 42818 42821 42824 42827 42830 42833 42836 42839 42842
> > > > > > > 42845 42848 43445 43450 45720 52253
> > > > > > > =profesori
> > > > > > >          7 68 3232 3648 5457 6259 6268 6270 6275 6278 6280 6282 6304
> > > > > > > 6308 6323 7098 21827
> > > > > > Can you also send me the output of :
> > > > > >
> > > > > > ldapsearch -b …. -s sub ‘(ou=Profesori)’ entryid
> > > > >
> > > > > # extended LDIF
> > > > > #
> > > > > # LDAPv3
> > > > > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope subtree
> > > > > # filter: ou=Profesori
> > > > > # requesting: entryid
> > > > > #
> > > > >
> > > > > # Profesori, DPPD, People, curs.pub.ro
> > > > > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > > entryid: 3648
> > > > >
> > > > > # search result
> > > > > search: 2
> > > > > result: 0 Success
> > > > >
> > > > > I issued db2index and I have the following output:
> > > > > the 50% threshold.
> > > > > [24/Jan/2019:15:14:31.578343786 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Ending pass number 1 ...
> > > > >
> > > > > [24/Jan/2019:15:14:31.781708885 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > > >
> > > > > [24/Jan/2019:15:14:32.055444491 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Workers finished; cleaning up...
> > > > >
> > > > > [24/Jan/2019:15:14:32.259020991 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Workers cleaned up.
> > > > >
> > > > > [24/Jan/2019:15:14:32.262209501 +0200] - INFO -
> > > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > > later...
> > > > > [24/Jan/2019:15:14:33.674826562 +0200] - INFO - dblayer_instance_start
> > > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > > >
> > > > > process is allowed to access the database
> > > > > [24/Jan/2019:15:14:33.975430948 +0200] - INFO -
> > > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > > [24/Jan/2019:15:14:33.982718069 +0200] - INFO - import_main_offline -
> > > > > reindex cursdb: Beginning pass number 2
> > > > > [24/Jan/2019:15:14:54.035041942 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 204521866.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > >
> > > > > [24/Jan/2019:15:15:14.086428912 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 104755102.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:15:34.138688984 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 70409167.0/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:15:54.189761953 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 53024187.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:16:14.239427918 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 42524348.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:16:34.483660956 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 35495530.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:16:54.533827623 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 30460703.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:17:14.586325096 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 26676765.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:17:34.636106261 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 23729056.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:17:54.686551928 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 21367956.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:18:14.812847819 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 19434204.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:18:34.883738846 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 17821407.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:18:54.938178725 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 16455782.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:19:14.995408557 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 15284552.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:19:35.047817446 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 14221719.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:19:35.051470957 +0200] - INFO - import_throw_in_towel
> > > > > reindex cursdb: Decided to end this pass because the progress rate
> > > > >
> > > > > has dropped below the 50% threshold.
> > > > > [24/Jan/2019:15:19:35.054926468 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Ending pass number 2 ...
> > > > >
> > > > > [24/Jan/2019:15:19:35.258101594 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > > >
> > > > > [24/Jan/2019:15:19:35.261243303 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Workers finished; cleaning up...
> > > > >
> > > > > [24/Jan/2019:15:19:35.464851131 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Workers cleaned up.
> > > > >
> > > > > [24/Jan/2019:15:19:35.467968441 +0200] - INFO -
> > > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > > later...
> > > > > [24/Jan/2019:15:19:35.506390559 +0200] - INFO - dblayer_instance_start
> > > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > > >
> > > > > process is allowed to access the database
> > > > > [24/Jan/2019:15:19:35.731292752 +0200] - INFO -
> > > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > > [24/Jan/2019:15:19:35.734380561 +0200] - INFO - import_main_offline -
> > > > > reindex cursdb: Beginning pass number 3
> > > > > [24/Jan/2019:15:19:55.782461337 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:20:15.834380724 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > >
> > > > > [24/Jan/2019:15:20:35.886774313 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 71582653.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:20:55.938228899 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 53686989.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:21:15.988693682 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 42949591.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:21:40.661184607 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 34359673.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:22:00.820373724 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 29620408.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:22:20.872956514 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 26030055.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:22:40.928481812 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 23215995.6/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:23:00.983057008 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 20951020.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:23:21.398151214 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 19004244.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:23:41.466437252 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 17459183.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:24:01.517539137 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 16146463.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:24:21.568626321 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 15017339.8/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:24:41.726888036 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 14035814.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:24:41.731112549 +0200] - INFO - import_throw_in_towel
> > > > > reindex cursdb: Decided to end this pass because the progress rate
> > > > >
> > > > > has dropped below the 50% threshold.
> > > > > [24/Jan/2019:15:24:41.734400859 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Ending pass number 3 ...
> > > > >
> > > > > [24/Jan/2019:15:24:41.837514477 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > > >
> > > > > [24/Jan/2019:15:24:41.841081788 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Workers finished; cleaning up...
> > > > >
> > > > > [24/Jan/2019:15:24:41.944805808 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Workers cleaned up.
> > > > >
> > > > > [24/Jan/2019:15:24:41.948172218 +0200] - INFO -
> > > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > > later...
> > > > > [24/Jan/2019:15:24:41.972718294 +0200] - INFO - dblayer_instance_start
> > > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > > >
> > > > > process is allowed to access the database
> > > > > [24/Jan/2019:15:24:42.277287032 +0200] - INFO -
> > > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > > [24/Jan/2019:15:24:42.524714295 +0200] - INFO - import_main_offline -
> > > > > reindex cursdb: Beginning pass number 4
> > > > > [24/Jan/2019:15:25:02.589790122 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > > > >
> > > > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:25:22.648607831 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > > > >
> > > > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > >
> > > > > And it takes a long time. What should I do?
> > > >
> > > > This is very odd that the index task is not proceeding.  Are there more
> > > > than 8108 entries in the database?  Or is that the size of the db in
> > > > entries?
> > >
> > > I have more de 70000 users. So I do not think that is the size of the db.
> > > > If the task is still running can you grab a stack traces using this process:
> > > >
> > > > http://www.port389.org/docs/389ds/FAQ/faq.html#debugging-hangs
> > > >
> > > > Grab  a few stack traces with that gdb command, and send them to us please.
> > >
> > > Unfortunatelly I've closed the db2index command and I've restored the
> > > Directory Server from a previous backup. I couldn' afford to wait much
> > > longer.
> > > > Then to fix it I think we need to do an export & import of the
> > > > database.  That will regenerate everything.  If you are using
> > > > replication then use the "--replication" option with db2ldif, otherwise
> > > > do not use that option:
> > > >   dsctl <INSTANCE> stop    --->  You might have to kill the process
> > > >
> > > > if the reindex is hanging :-(
> > > >   dsctl <INSTANCE> db2ldif userroot <LDIF file name> --replication
> > > >
> > > > Then import that LDIF
> > > >   dsctl <INSTANCE> ldif2db userroot <LDIF file name>
> > > >
> > > >   dsctl <INSTANCE> start
> > > >
> > > >
> > > > Then retry your search tests.
> > >
> > > This should be done on my restored running instace?
> > >
> > > I have a replication with Active Directory. This will be affected?
> > > > Regards,
> > > >
> > > > Mark
> > > > > > This is not contingent on db2index, so you can run the db2index and see if that corrects the issue now (if you have not already).
> > > > > >
> > > > > > Thanks
> > > > > >
> > > > > > —
> > > > > > Sincerely,
> > > > > >
> > > > > > William Brown
> > > > > > Software Engineer, 389 Directory Server
> > > > > > SUSE Labs
> > > > > > _______________________________________________
> > > > > > 389-users mailing list -- [e-mail]
> > > > > > To unsubscribe send an email to [e-mail]
> > > > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> > > > >
> > > > > 389-users mailing list -- [e-mail]
> > > > > To unsubscribe send an email to [e-mail]
> > > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> >
> > 389-users mailing list -- [e-mail]
> > To unsubscribe send an email to [e-mail]
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mark Reynolds]

On 1/24/19 1:54 PM, Mihai Carabas wrote:
> Hello,
>
> [root@ldap ~]# dsctl slapd-ldap db2ldif --replication cursdb cursdb.ldif
>
> cursdb.ldif doesn't seem to contain any replication related info. What
> should contain related to replication?

You should at least see an entry with "dn: 
nsuniqueid=ffffffff-ffffffff-ffffffff-ffffffff", if you don't see this 
entry in the LDIF then it might not be working (sigh).  You can then use 
the legacy tool:

db2ldif -r -n userroot -a LDIF_FILE

Regards,

Mark
> Thank you,
> Mihai
>
> On Thu, Jan 24, 2019 at 5:53 PM Mark Reynolds  wrote:
> > On 1/24/19 10:26 AM, Mihai Carabas wrote:
> > > Also I used db2index on the stopped Directory Server. Should I have
> > > used db2index.pl on the running one?
> >
> > IMO, it's best to stop to the server when doing these types of operations.
> >
> > Mark
> > > Thanks,
> > > Mihai
> > >
> > > On Thu, Jan 24, 2019 at 5:24 PM Mihai Carabas  wrote:
> > > > Hello Mark,
> > > >
> > > > On Thu, Jan 24, 2019 at 4:35 PM Mark Reynolds  wrote:
> > > > > On 1/24/19 8:37 AM, Mihai Carabas wrote:
> > > > > > On Thu, Jan 24, 2019 at 12:52 AM William Brown  wrote:
> > > > > > >> On 24 Jan 2019, at 00:50, Mihai Carabas  wrote:
> > > > > > >>
> > > > > > >> =profesor
> > > > > > >>           42815 42818 42821 42824 42827 42830 42833 42836 42839 42842
> > > > > > >> 42845 42848 43445 43450 45720 52253
> > > > > > >> =profesori
> > > > > > >>           7 68 3232 3648 5457 6259 6268 6270 6275 6278 6280 6282 6304
> > > > > > >> 6308 6323 7098 21827
> > > > > > > Can you also send me the output of :
> > > > > > >
> > > > > > > ldapsearch -b …. -s sub ‘(ou=Profesori)’ entryid
> > > > > > # extended LDIF
> > > > > > #
> > > > > > # LDAPv3
> > > > > > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope subtree
> > > > > > # filter: ou=Profesori
> > > > > > # requesting: entryid
> > > > > > #
> > > > > >
> > > > > > # Profesori, DPPD, People, curs.pub.ro
> > > > > > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > > > entryid: 3648
> > > > > >
> > > > > > # search result
> > > > > > search: 2
> > > > > > result: 0 Success
> > > > > >
> > > > > > I issued db2index and I have the following output:
> > > > > > the 50% threshold.
> > > > > > [24/Jan/2019:15:14:31.578343786 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Ending pass number 1 ...
> > > > > >
> > > > > > [24/Jan/2019:15:14:31.781708885 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > > > >
> > > > > > [24/Jan/2019:15:14:32.055444491 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Workers finished; cleaning up...
> > > > > >
> > > > > > [24/Jan/2019:15:14:32.259020991 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Workers cleaned up.
> > > > > >
> > > > > > [24/Jan/2019:15:14:32.262209501 +0200] - INFO -
> > > > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > > > later...
> > > > > > [24/Jan/2019:15:14:33.674826562 +0200] - INFO - dblayer_instance_start
> > > > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > > > >
> > > > > > process is allowed to access the database
> > > > > > [24/Jan/2019:15:14:33.975430948 +0200] - INFO -
> > > > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > > > [24/Jan/2019:15:14:33.982718069 +0200] - INFO - import_main_offline -
> > > > > > reindex cursdb: Beginning pass number 2
> > > > > > [24/Jan/2019:15:14:54.035041942 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 204521866.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > >
> > > > > > [24/Jan/2019:15:15:14.086428912 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 104755102.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:15:34.138688984 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 70409167.0/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:15:54.189761953 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 53024187.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:16:14.239427918 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 42524348.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:16:34.483660956 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 35495530.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:16:54.533827623 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 30460703.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:17:14.586325096 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 26676765.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:17:34.636106261 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 23729056.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:17:54.686551928 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 21367956.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:18:14.812847819 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 19434204.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:18:34.883738846 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 17821407.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:18:54.938178725 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 16455782.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:19:14.995408557 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 15284552.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:19:35.047817446 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 14221719.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:19:35.051470957 +0200] - INFO - import_throw_in_towel
> > > > > > reindex cursdb: Decided to end this pass because the progress rate
> > > > > >
> > > > > > has dropped below the 50% threshold.
> > > > > > [24/Jan/2019:15:19:35.054926468 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Ending pass number 2 ...
> > > > > >
> > > > > > [24/Jan/2019:15:19:35.258101594 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > > > >
> > > > > > [24/Jan/2019:15:19:35.261243303 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Workers finished; cleaning up...
> > > > > >
> > > > > > [24/Jan/2019:15:19:35.464851131 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Workers cleaned up.
> > > > > >
> > > > > > [24/Jan/2019:15:19:35.467968441 +0200] - INFO -
> > > > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > > > later...
> > > > > > [24/Jan/2019:15:19:35.506390559 +0200] - INFO - dblayer_instance_start
> > > > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > > > >
> > > > > > process is allowed to access the database
> > > > > > [24/Jan/2019:15:19:35.731292752 +0200] - INFO -
> > > > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > > > [24/Jan/2019:15:19:35.734380561 +0200] - INFO - import_main_offline -
> > > > > > reindex cursdb: Beginning pass number 3
> > > > > > [24/Jan/2019:15:19:55.782461337 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:20:15.834380724 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > >
> > > > > > [24/Jan/2019:15:20:35.886774313 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 71582653.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:20:55.938228899 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 53686989.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:21:15.988693682 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 42949591.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:21:40.661184607 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 34359673.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:22:00.820373724 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 29620408.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:22:20.872956514 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 26030055.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:22:40.928481812 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 23215995.6/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:23:00.983057008 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 20951020.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:23:21.398151214 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 19004244.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:23:41.466437252 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 17459183.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:24:01.517539137 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 16146463.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:24:21.568626321 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 15017339.8/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:24:41.726888036 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 14035814.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:24:41.731112549 +0200] - INFO - import_throw_in_towel
> > > > > > reindex cursdb: Decided to end this pass because the progress rate
> > > > > >
> > > > > > has dropped below the 50% threshold.
> > > > > > [24/Jan/2019:15:24:41.734400859 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Ending pass number 3 ...
> > > > > >
> > > > > > [24/Jan/2019:15:24:41.837514477 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > > > >
> > > > > > [24/Jan/2019:15:24:41.841081788 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Workers finished; cleaning up...
> > > > > >
> > > > > > [24/Jan/2019:15:24:41.944805808 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Workers cleaned up.
> > > > > >
> > > > > > [24/Jan/2019:15:24:41.948172218 +0200] - INFO -
> > > > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > > > later...
> > > > > > [24/Jan/2019:15:24:41.972718294 +0200] - INFO - dblayer_instance_start
> > > > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > > > >
> > > > > > process is allowed to access the database
> > > > > > [24/Jan/2019:15:24:42.277287032 +0200] - INFO -
> > > > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > > > [24/Jan/2019:15:24:42.524714295 +0200] - INFO - import_main_offline -
> > > > > > reindex cursdb: Beginning pass number 4
> > > > > > [24/Jan/2019:15:25:02.589790122 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > > > > >
> > > > > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:25:22.648607831 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > > > > >
> > > > > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > >
> > > > > > And it takes a long time. What should I do?
> > > > >
> > > > > This is very odd that the index task is not proceeding.  Are there more
> > > > > than 8108 entries in the database?  Or is that the size of the db in
> > > > > entries?
> > > >
> > > > I have more de 70000 users. So I do not think that is the size of the db.
> > > > > If the task is still running can you grab a stack traces using this process:
> > > > >
> > > > > http://www.port389.org/docs/389ds/FAQ/faq.html#debugging-hangs
> > > > >
> > > > > Grab  a few stack traces with that gdb command, and send them to us please.
> > > >
> > > > Unfortunatelly I've closed the db2index command and I've restored the
> > > > Directory Server from a previous backup. I couldn' afford to wait much
> > > > longer.
> > > > > Then to fix it I think we need to do an export & import of the
> > > > > database.  That will regenerate everything.  If you are using
> > > > > replication then use the "--replication" option with db2ldif, otherwise
> > > > > do not use that option:
> > > > >    dsctl <INSTANCE> stop    --->  You might have to kill the process
> > > > >
> > > > > if the reindex is hanging :-(
> > > > >    dsctl <INSTANCE> db2ldif userroot <LDIF file name> --replication
> > > > >
> > > > > Then import that LDIF
> > > > >    dsctl <INSTANCE> ldif2db userroot <LDIF file name>
> > > > >
> > > > >    dsctl <INSTANCE> start
> > > > >
> > > > >
> > > > > Then retry your search tests.
> > > >
> > > > This should be done on my restored running instace?
> > > >
> > > > I have a replication with Active Directory. This will be affected?
> > > > > Regards,
> > > > >
> > > > > Mark
> > > > > > > This is not contingent on db2index, so you can run the db2index and see if that corrects the issue now (if you have not already).
> > > > > > >
> > > > > > > Thanks
> > > > > > >
> > > > > > > —
> > > > > > > Sincerely,
> > > > > > >
> > > > > > > William Brown
> > > > > > > Software Engineer, 389 Directory Server
> > > > > > > SUSE Labs
> > > > > > > _______________________________________________
> > > > > > > 389-users mailing list -- [e-mail]
> > > > > > > To unsubscribe send an email to [e-mail]
> > > > > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> > > > > > _______________________________________________
> > > > > > 389-users mailing list -- [e-mail]
> > > > > > To unsubscribe send an email to [e-mail]
> > > > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> > >
> > > 389-users mailing list -- [e-mail]
> > > To unsubscribe send an email to [e-mail]
> > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
>
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mihai Carabas]

On Thu, Jan 24, 2019 at 10:17 PM Mark Reynolds  wrote:
> On 1/24/19 1:54 PM, Mihai Carabas wrote:
>
> Hello,
>
> [root@ldap ~]# dsctl slapd-ldap db2ldif --replication cursdb cursdb.ldif
>
> cursdb.ldif doesn't seem to contain any replication related info. What
> should contain related to replication?
>
> You should at least see an entry with "dn: nsuniqueid=ffffffff-ffffffff-ffffffff-ffffffff", if you don't see this entry in the LDIF then it might not be working (sigh).  You can then use the legacy tool:

Is there. All is ok.

After exporting LDIF and importing again, the search still is buggy.

[root@ldap ~]# dsctl slapd-ldap ldif2db cursdb
/var/log/dirsrv/slapd-ldap/cursdb.ldif
[24/Jan/2019:22:30:01.996505122 +0200] - INFO -
ldbm_instance_config_cachememsize_set - force a minimal value 512000
[24/Jan/2019:22:30:02.018018715 +0200] - INFO -
ldbm_instance_config_cachememsize_set - force a minimal value 512000
[24/Jan/2019:22:30:02.185170761 +0200] - INFO - dblayer_instance_start
- Import is running with nsslapd-db-private-import-mem on; No other
process is allowed to access the database
[24/Jan/2019:22:30:02.189742659 +0200] - INFO -
check_and_set_import_cache - pagesize: 4096, available bytes
7582248960, process usage 24457216
[24/Jan/2019:22:30:02.191828258 +0200] - INFO -
check_and_set_import_cache - Import allocates 2961816KB import cache.
[24/Jan/2019:22:30:02.357426205 +0200] - INFO - import_main_offline -
import cursdb: Beginning import job...
[24/Jan/2019:22:30:02.359609704 +0200] - INFO - import_main_offline -
import cursdb: Index buffering enabled with bucket size 100
[24/Jan/2019:22:30:02.560334339 +0200] - INFO - import_producer -
import cursdb: Processing file
"/var/log/dirsrv/slapd-ldap/cursdb.ldif"
[24/Jan/2019:22:30:22.486506161 +0200] - INFO - import_monitor_threads
- import cursdb: Processed 72879 entries -- average rate 3643.6/sec,
recent rate 3643.6/sec, hit ratio 0%
[24/Jan/2019:22:30:24.804083508 +0200] - INFO - import_producer -
import cursdb: Finished scanning file
"/var/log/dirsrv/slapd-ldap/cursdb.ldif" (81772 entries)
[24/Jan/2019:22:30:25.204219378 +0200] - INFO - import_monitor_threads
- import cursdb: Workers finished; cleaning up...
[24/Jan/2019:22:30:25.407087712 +0200] - INFO - import_monitor_threads
- import cursdb: Workers cleaned up.
[24/Jan/2019:22:30:25.444768200 +0200] - INFO - import_main_offline -
import cursdb: Cleaning up producer thread...
[24/Jan/2019:22:30:25.447046899 +0200] - INFO - import_main_offline -
import cursdb: Indexing complete.  Post-processing...
[24/Jan/2019:22:30:25.452563797 +0200] - INFO - import_main_offline -
import cursdb: Generating numsubordinates (this may take several
minutes to complete)...
[24/Jan/2019:22:30:25.498537382 +0200] - INFO - import_main_offline -
import cursdb: Generating numSubordinates complete.
[24/Jan/2019:22:30:25.500966981 +0200] - INFO - ldbm_get_nonleaf_ids -
import cursdb: Gathering ancestorid non-leaf IDs...
[24/Jan/2019:22:30:25.503749080 +0200] - INFO - ldbm_get_nonleaf_ids -
import cursdb: Finished gathering ancestorid non-leaf IDs.
[24/Jan/2019:22:30:25.509673078 +0200] - INFO -
ldbm_ancestorid_new_idl_create_index - import cursdb: Creating
ancestorid index (new idl)...
[24/Jan/2019:22:30:26.432287878 +0200] - INFO -
ldbm_ancestorid_new_idl_create_index - import cursdb: Created
ancestorid index (new idl).
[24/Jan/2019:22:30:26.444136275 +0200] - INFO - import_main_offline -
import cursdb: Flushing caches...
[24/Jan/2019:22:30:26.447897673 +0200] - INFO - import_main_offline -
import cursdb: Closing files...
[24/Jan/2019:22:30:37.306490844 +0200] - INFO - dblayer_pre_close -
All database threads now stopped
[24/Jan/2019:22:30:37.309482243 +0200] - INFO - import_main_offline -
import cursdb: Import complete.  Processed 81772 entries in 35
seconds. (2336.34 entries/sec)
ldif2db successful

Here is the buggy search:
# extended LDIF
#
# LDAPv3
# base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope oneLevel
# filter: ou=Profesori
# requesting: ALL
#

# Profesori, DPPD, People, curs.pub.ro
dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
ou: Profesori
objectClass: top
objectClass: organizationalunit

# Asistenti-Man, DPPD, People, curs.pub.ro
dn: ou=Asistenti-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
objectClass: top
objectClass: organizationalunit
ou: ou=Asistenti-Man
ou: Asistenti-Man

# Profesori-Man, DPPD, People, curs.pub.ro
dn: ou=Profesori-Man,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
objectClass: top
objectClass: organizationalunit
ou: ou=Profesori-Man
ou: Profesori-Man

# Externi, DPPD, People, curs.pub.ro
dn: ou=Externi,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
objectClass: top
objectClass: organizationalunit
ou: ou=Externi
ou: Externi

# Auxiliari, DPPD, People, curs.pub.ro
dn: ou=Auxiliari,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
objectClass: top
objectClass: organizationalunit
ou: Auxiliari

# search result
search: 2
result: 0 Success

# numResponses: 6
# numEntries: 5
> db2ldif -r -n userroot -a LDIF_FILE
>
> Regards,
>
> Mark
>
> Thank you,
> Mihai
>
> On Thu, Jan 24, 2019 at 5:53 PM Mark Reynolds  wrote:
>
> On 1/24/19 10:26 AM, Mihai Carabas wrote:
>
> Also I used db2index on the stopped Directory Server. Should I have
> used db2index.pl on the running one?
>
> IMO, it's best to stop to the server when doing these types of operations.
>
> Mark
>
> Thanks,
> Mihai
>
> On Thu, Jan 24, 2019 at 5:24 PM Mihai Carabas  wrote:
>
> Hello Mark,
>
> On Thu, Jan 24, 2019 at 4:35 PM Mark Reynolds  wrote:
>
> On 1/24/19 8:37 AM, Mihai Carabas wrote:
>
> On Thu, Jan 24, 2019 at 12:52 AM William Brown  wrote:
>
> On 24 Jan 2019, at 00:50, Mihai Carabas  wrote:
>
> =profesor
>          42815 42818 42821 42824 42827 42830 42833 42836 42839 42842
> 42845 42848 43445 43450 45720 52253
> =profesori
>          7 68 3232 3648 5457 6259 6268 6270 6275 6278 6280 6282 6304
> 6308 6323 7098 21827
>
> Can you also send me the output of :
>
> ldapsearch -b …. -s sub ‘(ou=Profesori)’ entryid
>
> # extended LDIF
> #
> # LDAPv3
> # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope subtree
> # filter: ou=Profesori
> # requesting: entryid
> #
>
> # Profesori, DPPD, People, curs.pub.ro
> dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> entryid: 3648
>
> # search result
> search: 2
> result: 0 Success
>
> I issued db2index and I have the following output:
> the 50% threshold.
> [24/Jan/2019:15:14:31.578343786 +0200] - INFO - import_monitor_threads
> reindex cursdb: Ending pass number 1 ...
>
> [24/Jan/2019:15:14:31.781708885 +0200] - INFO - import_monitor_threads
> reindex cursdb: Foreman is done; waiting for workers to finish...
>
> [24/Jan/2019:15:14:32.055444491 +0200] - INFO - import_monitor_threads
> reindex cursdb: Workers finished; cleaning up...
>
> [24/Jan/2019:15:14:32.259020991 +0200] - INFO - import_monitor_threads
> reindex cursdb: Workers cleaned up.
>
> [24/Jan/2019:15:14:32.262209501 +0200] - INFO -
> import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> later...
> [24/Jan/2019:15:14:33.674826562 +0200] - INFO - dblayer_instance_start
> Import is running with nsslapd-db-private-import-mem on; No other
>
> process is allowed to access the database
> [24/Jan/2019:15:14:33.975430948 +0200] - INFO -
> import_sweep_after_pass - reindex cursdb: Sweep done.
> [24/Jan/2019:15:14:33.982718069 +0200] - INFO - import_main_offline -
> reindex cursdb: Beginning pass number 2
> [24/Jan/2019:15:14:54.035041942 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 204521866.1/sec, recent rate 0.0/sec, hit ratio 0%
>
> [24/Jan/2019:15:15:14.086428912 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 104755102.1/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:15:34.138688984 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 70409167.0/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:15:54.189761953 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 53024187.5/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:16:14.239427918 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 42524348.4/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:16:34.483660956 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 35495530.5/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:16:54.533827623 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 30460703.5/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:17:14.586325096 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 26676765.1/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:17:34.636106261 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 23729056.3/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:17:54.686551928 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 21367956.2/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:18:14.812847819 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 19434204.5/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:18:34.883738846 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 17821407.4/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:18:54.938178725 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 16455782.3/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:19:14.995408557 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 15284552.3/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:19:35.047817446 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 2) -- average rate
>
> 14221719.2/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:19:35.051470957 +0200] - INFO - import_throw_in_towel
> reindex cursdb: Decided to end this pass because the progress rate
>
> has dropped below the 50% threshold.
> [24/Jan/2019:15:19:35.054926468 +0200] - INFO - import_monitor_threads
> reindex cursdb: Ending pass number 2 ...
>
> [24/Jan/2019:15:19:35.258101594 +0200] - INFO - import_monitor_threads
> reindex cursdb: Foreman is done; waiting for workers to finish...
>
> [24/Jan/2019:15:19:35.261243303 +0200] - INFO - import_monitor_threads
> reindex cursdb: Workers finished; cleaning up...
>
> [24/Jan/2019:15:19:35.464851131 +0200] - INFO - import_monitor_threads
> reindex cursdb: Workers cleaned up.
>
> [24/Jan/2019:15:19:35.467968441 +0200] - INFO -
> import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> later...
> [24/Jan/2019:15:19:35.506390559 +0200] - INFO - dblayer_instance_start
> Import is running with nsslapd-db-private-import-mem on; No other
>
> process is allowed to access the database
> [24/Jan/2019:15:19:35.731292752 +0200] - INFO -
> import_sweep_after_pass - reindex cursdb: Sweep done.
> [24/Jan/2019:15:19:35.734380561 +0200] - INFO - import_main_offline -
> reindex cursdb: Beginning pass number 3
> [24/Jan/2019:15:19:55.782461337 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:20:15.834380724 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
>
> [24/Jan/2019:15:20:35.886774313 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 71582653.1/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:20:55.938228899 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 53686989.9/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:21:15.988693682 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 42949591.9/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:21:40.661184607 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 34359673.5/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:22:00.820373724 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 29620408.2/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:22:20.872956514 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 26030055.7/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:22:40.928481812 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 23215995.6/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:23:00.983057008 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 20951020.4/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:23:21.398151214 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 19004244.2/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:23:41.466437252 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 17459183.7/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:24:01.517539137 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 16146463.1/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:24:21.568626321 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 15017339.8/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:24:41.726888036 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 3) -- average rate
>
> 14035814.3/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:24:41.731112549 +0200] - INFO - import_throw_in_towel
> reindex cursdb: Decided to end this pass because the progress rate
>
> has dropped below the 50% threshold.
> [24/Jan/2019:15:24:41.734400859 +0200] - INFO - import_monitor_threads
> reindex cursdb: Ending pass number 3 ...
>
> [24/Jan/2019:15:24:41.837514477 +0200] - INFO - import_monitor_threads
> reindex cursdb: Foreman is done; waiting for workers to finish...
>
> [24/Jan/2019:15:24:41.841081788 +0200] - INFO - import_monitor_threads
> reindex cursdb: Workers finished; cleaning up...
>
> [24/Jan/2019:15:24:41.944805808 +0200] - INFO - import_monitor_threads
> reindex cursdb: Workers cleaned up.
>
> [24/Jan/2019:15:24:41.948172218 +0200] - INFO -
> import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> later...
> [24/Jan/2019:15:24:41.972718294 +0200] - INFO - dblayer_instance_start
> Import is running with nsslapd-db-private-import-mem on; No other
>
> process is allowed to access the database
> [24/Jan/2019:15:24:42.277287032 +0200] - INFO -
> import_sweep_after_pass - reindex cursdb: Sweep done.
> [24/Jan/2019:15:24:42.524714295 +0200] - INFO - import_main_offline -
> reindex cursdb: Beginning pass number 4
> [24/Jan/2019:15:25:02.589790122 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 4) -- average rate
>
> 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> [24/Jan/2019:15:25:22.648607831 +0200] - INFO - import_monitor_threads
> reindex cursdb: Processed 8108 entries (pass 4) -- average rate
>
> 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
>
> And it takes a long time. What should I do?
>
> This is very odd that the index task is not proceeding.  Are there more
> than 8108 entries in the database?  Or is that the size of the db in
> entries?
>
> I have more de 70000 users. So I do not think that is the size of the db.
>
> If the task is still running can you grab a stack traces using this process:
>
> http://www.port389.org/docs/389ds/FAQ/faq.html#debugging-hangs
>
> Grab  a few stack traces with that gdb command, and send them to us please.
>
> Unfortunatelly I've closed the db2index command and I've restored the
> Directory Server from a previous backup. I couldn' afford to wait much
> longer.
>
> Then to fix it I think we need to do an export & import of the
> database.  That will regenerate everything.  If you are using
> replication then use the "--replication" option with db2ldif, otherwise
> do not use that option:
>   dsctl <INSTANCE> stop    --->  You might have to kill the process
>
> if the reindex is hanging :-(
>   dsctl <INSTANCE> db2ldif userroot <LDIF file name> --replication
>
> Then import that LDIF
>   dsctl <INSTANCE> ldif2db userroot <LDIF file name>
>
>   dsctl <INSTANCE> start
>
>
> Then retry your search tests.
>
> This should be done on my restored running instace?
>
> I have a replication with Active Directory. This will be affected?
>
> Regards,
>
> Mark
>
> This is not contingent on db2index, so you can run the db2index and see if that corrects the issue now (if you have not already).
>
> Thanks
>
> —
> Sincerely,
>
> William Brown
> Software Engineer, 389 Directory Server
> SUSE Labs
> _______________________________________________
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
>
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
>
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
>
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mark Reynolds]

On 1/24/19 3:35 PM, Mihai Carabas wrote:
> On Thu, Jan 24, 2019 at 10:17 PM Mark Reynolds  wrote:
> > On 1/24/19 1:54 PM, Mihai Carabas wrote:
> >
> > Hello,
> >
> > [root@ldap ~]# dsctl slapd-ldap db2ldif --replication cursdb cursdb.ldif
> >
> > cursdb.ldif doesn't seem to contain any replication related info. What
> > should contain related to replication?
> >
> > You should at least see an entry with "dn: nsuniqueid=ffffffff-ffffffff-ffffffff-ffffffff", if you don't see this entry in the LDIF then it might not be working (sigh).  You can then use the legacy tool:
>
> Is there. All is ok.
>
> After exporting LDIF and importing again, the search still is buggy.

Yeah this is looking like a known bug that we will be working on soon...

Question, would you be willing to try a "special logging" build to see 
we can figure out why the reindex task is hanging?  The stacktraces did 
not show anything helpful, so we need to see which entry is causing the 
issue and the easiest way, besides walking you through using gdb (which 
I would be willing to do), would be to provide a special build that logs 
extra info to the errors log.   I know that is a lot to ask, so no 
worries if you aren't comfortable with it.

Thanks,
Mark

[William Brown]

> On 25 Jan 2019, at 10:08, Mark Reynolds  wrote:
>
> On 1/24/19 3:35 PM, Mihai Carabas wrote:
> > On Thu, Jan 24, 2019 at 10:17 PM Mark Reynolds  wrote:
> > > On 1/24/19 1:54 PM, Mihai Carabas wrote:
> > >
> > > Hello,
> > >
> > > [root@ldap ~]# dsctl slapd-ldap db2ldif --replication cursdb cursdb.ldif
> > >
> > > cursdb.ldif doesn't seem to contain any replication related info. What
> > > should contain related to replication?
> > >
> > > You should at least see an entry with "dn: nsuniqueid=ffffffff-ffffffff-ffffffff-ffffffff", if you don't see this entry in the LDIF then it might not be working (sigh).  You can then use the legacy tool:
> >
> > Is there. All is ok.
> >
> > After exporting LDIF and importing again, the search still is buggy.
>
> Yeah this is looking like a known bug that we will be working on soon…

Looking at the entryid and indexes, everything seems correct, so this does seem like a bug. Have we got an issue id Mark?
> Question, would you be willing to try a "special logging" build to see we can figure out why the reindex task is hanging?  The stacktraces did not show anything helpful, so we need to see which entry is causing the issue and the easiest way, besides walking you through using gdb (which I would be willing to do), would be to provide a special build that logs extra info to the errors log.   I know that is a lot to ask, so no worries if you aren't comfortable with it.
>
> Thanks,
> Mark
> _______________________________________________
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

—
Sincerely,

William Brown
Software Engineer, 389 Directory Server
SUSE Labs

[Ludwig]

On 01/24/2019 10:34 PM, William Brown wrote:
> > On 25 Jan 2019, at 10:08, Mark Reynolds  wrote:
> >
> > On 1/24/19 3:35 PM, Mihai Carabas wrote:
> > > On Thu, Jan 24, 2019 at 10:17 PM Mark Reynolds  wrote:
> > > > On 1/24/19 1:54 PM, Mihai Carabas wrote:
> > > >
> > > > Hello,
> > > >
> > > > [root@ldap ~]# dsctl slapd-ldap db2ldif --replication cursdb cursdb.ldif
> > > >
> > > > cursdb.ldif doesn't seem to contain any replication related info. What
> > > > should contain related to replication?
> > > >
> > > > You should at least see an entry with "dn: nsuniqueid=ffffffff-ffffffff-ffffffff-ffffffff", if you don't see this entry in the LDIF then it might not be working (sigh).  You can then use the legacy tool:
> > >
> > > Is there. All is ok.
> > >
> > > After exporting LDIF and importing again, the search still is buggy.
> >
> > Yeah this is looking like a known bug that we will be working on soon…
>
> Looking at the entryid and indexes, everything seems correct, so this does seem like a bug. Have we got an issue id Mark?

I think it is: https://pagure.io/389-ds-base/issue/50103, the fix is not 
yet ready

you can repair it by explicitely reindexing the entryrdn index. ..... -t 
entryrdn
> > Question, would you be willing to try a "special logging" build to see we can figure out why the reindex task is hanging?  The stacktraces did not show anything helpful, so we need to see which entry is causing the issue and the easiest way, besides walking you through using gdb (which I would be willing to do), would be to provide a special build that logs extra info to the errors log.   I know that is a lot to ask, so no worries if you aren't comfortable with it.
> >
> > Thanks,
> > Mark
> > _______________________________________________
> > 389-users mailing list -- [e-mail]
> > To unsubscribe send an email to [e-mail]
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
>
> —
> Sincerely,
>
> William Brown
> Software Engineer, 389 Directory Server
> SUSE Labs
> _______________________________________________
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mihai Carabas]

On Mon, Jan 28, 2019 at 10:04 AM Ludwig  wrote:
> On 01/24/2019 10:34 PM, William Brown wrote:
> > > On 25 Jan 2019, at 10:08, Mark Reynolds  wrote:
> > >
> > > On 1/24/19 3:35 PM, Mihai Carabas wrote:
> > > > On Thu, Jan 24, 2019 at 10:17 PM Mark Reynolds  wrote:
> > > > > On 1/24/19 1:54 PM, Mihai Carabas wrote:
> > > > >
> > > > > Hello,
> > > > >
> > > > > [root@ldap ~]# dsctl slapd-ldap db2ldif --replication cursdb cursdb.ldif
> > > > >
> > > > > cursdb.ldif doesn't seem to contain any replication related info. What
> > > > > should contain related to replication?
> > > > >
> > > > > You should at least see an entry with "dn: nsuniqueid=ffffffff-ffffffff-ffffffff-ffffffff", if you don't see this entry in the LDIF then it might not be working (sigh).  You can then use the legacy tool:
> > > >
> > > > Is there. All is ok.
> > > >
> > > > After exporting LDIF and importing again, the search still is buggy.
> > >
> > > Yeah this is looking like a known bug that we will be working on soon…
> >
> > Looking at the entryid and indexes, everything seems correct, so this does seem like a bug. Have we got an issue id Mark?
>
> I think it is: https://pagure.io/389-ds-base/issue/50103, the fix is not
> yet ready

I am a little confused. I have read the issue: is this issue about my
ldapsearch problem or about the reindex problem?
> you can repair it by explicitely reindexing the entryrdn index. ..... -t
> entryrdn

Why on entryrdn will work? When you say entryrdn in my case, you are
refering at what rdn?

Thank you and sorry for the dumb questions,
Mihai
> > > Question, would you be willing to try a "special logging" build to see we can figure out why the reindex task is hanging?  The stacktraces did not show anything helpful, so we need to see which entry is causing the issue and the easiest way, besides walking you through using gdb (which I would be willing to do), would be to provide a special build that logs extra info to the errors log.   I know that is a lot to ask, so no worries if you aren't comfortable with it.
> > >
> > > Thanks,
> > > Mark
> > > _______________________________________________
> > > 389-users mailing list -- [e-mail]
> > > To unsubscribe send an email to [e-mail]
> > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> >
> > —
> > Sincerely,
> >
> > William Brown
> > Software Engineer, 389 Directory Server
> > SUSE Labs
> > _______________________________________________
> > 389-users mailing list -- [e-mail]
> > To unsubscribe send an email to [e-mail]
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Ludwig]

On 01/28/2019 09:20 AM, Mihai Carabas wrote:
> On Mon, Jan 28, 2019 at 10:04 AM Ludwig  wrote:
> > On 01/24/2019 10:34 PM, William Brown wrote:
> > > > On 25 Jan 2019, at 10:08, Mark Reynolds  wrote:
> > > >
> > > > On 1/24/19 3:35 PM, Mihai Carabas wrote:
> > > > > On Thu, Jan 24, 2019 at 10:17 PM Mark Reynolds  wrote:
> > > > > > On 1/24/19 1:54 PM, Mihai Carabas wrote:
> > > > > >
> > > > > > Hello,
> > > > > >
> > > > > > [root@ldap ~]# dsctl slapd-ldap db2ldif --replication cursdb cursdb.ldif
> > > > > >
> > > > > > cursdb.ldif doesn't seem to contain any replication related info. What
> > > > > > should contain related to replication?
> > > > > >
> > > > > > You should at least see an entry with "dn: nsuniqueid=ffffffff-ffffffff-ffffffff-ffffffff", if you don't see this entry in the LDIF then it might not be working (sigh).  You can then use the legacy tool:
> > > > >
> > > > > Is there. All is ok.
> > > > >
> > > > > After exporting LDIF and importing again, the search still is buggy.
> > > >
> > > > Yeah this is looking like a known bug that we will be working on soon…
> > >
> > > Looking at the entryid and indexes, everything seems correct, so this does seem like a bug. Have we got an issue id Mark?
> >
> > I think it is: https://pagure.io/389-ds-base/issue/50103, the fix is not
> > yet ready
>
> I am a little confused. I have read the issue: is this issue about my
> ldapsearch problem or about the reindex problem?

that issue is about the problem that after a db2index the 
nsuniqueid=ffffffff-ffffffff-ffffffff-ffffffff entry is not found. And 
the cause ist that the general reindex without any specified attribute 
takes a different code path than when reindexing only one or more 
specific attributes.

So just reindexing the entryrdn index can help
> > you can repair it by explicitely reindexing the entryrdn index. ..... -t
> > entryrdn
>
> Why on entryrdn will work? When you say entryrdn in my case, you are
> refering at what rdn?
>
> Thank you and sorry for the dumb questions,
> Mihai
> > > > Question, would you be willing to try a "special logging" build to see we can figure out why the reindex task is hanging?  The stacktraces did not show anything helpful, so we need to see which entry is causing the issue and the easiest way, besides walking you through using gdb (which I would be willing to do), would be to provide a special build that logs extra info to the errors log.   I know that is a lot to ask, so no worries if you aren't comfortable with it.
> > > >
> > > > Thanks,
> > > > Mark
> > > > _______________________________________________
> > > > 389-users mailing list -- [e-mail]
> > > > To unsubscribe send an email to [e-mail]
> > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> > >
> > > —
> > > Sincerely,
> > >
> > > William Brown
> > > Software Engineer, 389 Directory Server
> > > SUSE Labs
> > > _______________________________________________
> > > 389-users mailing list -- [e-mail]
> > > To unsubscribe send an email to [e-mail]
> > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mihai Carabas]

On Thu, Jan 24, 2019 at 11:08 PM Mark Reynolds  wrote:
> On 1/24/19 3:35 PM, Mihai Carabas wrote:
> > On Thu, Jan 24, 2019 at 10:17 PM Mark Reynolds  wrote:
> > > On 1/24/19 1:54 PM, Mihai Carabas wrote:
> > >
> > > Hello,
> > >
> > > [root@ldap ~]# dsctl slapd-ldap db2ldif --replication cursdb cursdb.ldif
> > >
> > > cursdb.ldif doesn't seem to contain any replication related info. What
> > > should contain related to replication?
> > >
> > > You should at least see an entry with "dn: nsuniqueid=ffffffff-ffffffff-ffffffff-ffffffff", if you don't see this entry in the LDIF then it might not be working (sigh).  You can then use the legacy tool:
> >
> > Is there. All is ok.
> >
> > After exporting LDIF and importing again, the search still is buggy.
>
> Yeah this is looking like a known bug that we will be working on soon...
>
> Question, would you be willing to try a "special logging" build to see
> we can figure out why the reindex task is hanging?  The stacktraces did
> not show anything helpful, so we need to see which entry is causing the
> issue and the easiest way, besides walking you through using gdb (which
> I would be willing to do), would be to provide a special build that logs
> extra info to the errors log.   I know that is a lot to ask, so no
> worries if you aren't comfortable with it.

So to clearly understand these are to different bugs, right?

If so, what is the timeframe of solving the bug with the search?

Regarding the second one, I can help you but I have to create a test
environment with this dataset. I cannot afford playing on production
environment.

Cu bine,
Mihai
> Thanks,
> Mark

[Mark Reynolds]

On 1/24/19 10:24 AM, Mihai Carabas wrote:
> Hello Mark,
>
> On Thu, Jan 24, 2019 at 4:35 PM Mark Reynolds  wrote:
> > On 1/24/19 8:37 AM, Mihai Carabas wrote:
> > > On Thu, Jan 24, 2019 at 12:52 AM William Brown  wrote:
> > > > > On 24 Jan 2019, at 00:50, Mihai Carabas  wrote:
> > > > >
> > > > > =profesor
> > > > >          42815 42818 42821 42824 42827 42830 42833 42836 42839 42842
> > > > > 42845 42848 43445 43450 45720 52253
> > > > > =profesori
> > > > >          7 68 3232 3648 5457 6259 6268 6270 6275 6278 6280 6282 6304
> > > > > 6308 6323 7098 21827
> > > >
> > > > Can you also send me the output of :
> > > >
> > > > ldapsearch -b …. -s sub ‘(ou=Profesori)’ entryid
> > >
> > > # extended LDIF
> > > #
> > > # LDAPv3
> > > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope subtree
> > > # filter: ou=Profesori
> > > # requesting: entryid
> > > #
> > >
> > > # Profesori, DPPD, People, curs.pub.ro
> > > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > entryid: 3648
> > >
> > > # search result
> > > search: 2
> > > result: 0 Success
> > >
> > > I issued db2index and I have the following output:
> > > the 50% threshold.
> > > [24/Jan/2019:15:14:31.578343786 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Ending pass number 1 ...
> > >
> > > [24/Jan/2019:15:14:31.781708885 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > >
> > > [24/Jan/2019:15:14:32.055444491 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Workers finished; cleaning up...
> > >
> > > [24/Jan/2019:15:14:32.259020991 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Workers cleaned up.
> > >
> > > [24/Jan/2019:15:14:32.262209501 +0200] - INFO -
> > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > later...
> > > [24/Jan/2019:15:14:33.674826562 +0200] - INFO - dblayer_instance_start
> > > Import is running with nsslapd-db-private-import-mem on; No other
> > >
> > > process is allowed to access the database
> > > [24/Jan/2019:15:14:33.975430948 +0200] - INFO -
> > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > [24/Jan/2019:15:14:33.982718069 +0200] - INFO - import_main_offline -
> > > reindex cursdb: Beginning pass number 2
> > > [24/Jan/2019:15:14:54.035041942 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 204521866.1/sec, recent rate 0.0/sec, hit ratio 0%
> > >
> > > [24/Jan/2019:15:15:14.086428912 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 104755102.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:15:34.138688984 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 70409167.0/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:15:54.189761953 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 53024187.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:16:14.239427918 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 42524348.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:16:34.483660956 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 35495530.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:16:54.533827623 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 30460703.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:17:14.586325096 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 26676765.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:17:34.636106261 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 23729056.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:17:54.686551928 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 21367956.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:18:14.812847819 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 19434204.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:18:34.883738846 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 17821407.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:18:54.938178725 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 16455782.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:19:14.995408557 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 15284552.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:19:35.047817446 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > >
> > > 14221719.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:19:35.051470957 +0200] - INFO - import_throw_in_towel
> > > reindex cursdb: Decided to end this pass because the progress rate
> > >
> > > has dropped below the 50% threshold.
> > > [24/Jan/2019:15:19:35.054926468 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Ending pass number 2 ...
> > >
> > > [24/Jan/2019:15:19:35.258101594 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > >
> > > [24/Jan/2019:15:19:35.261243303 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Workers finished; cleaning up...
> > >
> > > [24/Jan/2019:15:19:35.464851131 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Workers cleaned up.
> > >
> > > [24/Jan/2019:15:19:35.467968441 +0200] - INFO -
> > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > later...
> > > [24/Jan/2019:15:19:35.506390559 +0200] - INFO - dblayer_instance_start
> > > Import is running with nsslapd-db-private-import-mem on; No other
> > >
> > > process is allowed to access the database
> > > [24/Jan/2019:15:19:35.731292752 +0200] - INFO -
> > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > [24/Jan/2019:15:19:35.734380561 +0200] - INFO - import_main_offline -
> > > reindex cursdb: Beginning pass number 3
> > > [24/Jan/2019:15:19:55.782461337 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:20:15.834380724 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > >
> > > [24/Jan/2019:15:20:35.886774313 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 71582653.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:20:55.938228899 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 53686989.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:21:15.988693682 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 42949591.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:21:40.661184607 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 34359673.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:22:00.820373724 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 29620408.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:22:20.872956514 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 26030055.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:22:40.928481812 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 23215995.6/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:23:00.983057008 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 20951020.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:23:21.398151214 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 19004244.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:23:41.466437252 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 17459183.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:24:01.517539137 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 16146463.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:24:21.568626321 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 15017339.8/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:24:41.726888036 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > >
> > > 14035814.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:24:41.731112549 +0200] - INFO - import_throw_in_towel
> > > reindex cursdb: Decided to end this pass because the progress rate
> > >
> > > has dropped below the 50% threshold.
> > > [24/Jan/2019:15:24:41.734400859 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Ending pass number 3 ...
> > >
> > > [24/Jan/2019:15:24:41.837514477 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > >
> > > [24/Jan/2019:15:24:41.841081788 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Workers finished; cleaning up...
> > >
> > > [24/Jan/2019:15:24:41.944805808 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Workers cleaned up.
> > >
> > > [24/Jan/2019:15:24:41.948172218 +0200] - INFO -
> > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > later...
> > > [24/Jan/2019:15:24:41.972718294 +0200] - INFO - dblayer_instance_start
> > > Import is running with nsslapd-db-private-import-mem on; No other
> > >
> > > process is allowed to access the database
> > > [24/Jan/2019:15:24:42.277287032 +0200] - INFO -
> > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > [24/Jan/2019:15:24:42.524714295 +0200] - INFO - import_main_offline -
> > > reindex cursdb: Beginning pass number 4
> > > [24/Jan/2019:15:25:02.589790122 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > >
> > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > [24/Jan/2019:15:25:22.648607831 +0200] - INFO - import_monitor_threads
> > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > >
> > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > >
> > > And it takes a long time. What should I do?
> >
> > This is very odd that the index task is not proceeding.  Are there more
> > than 8108 entries in the database?  Or is that the size of the db in
> > entries?
>
> I have more de 70000 users. So I do not think that is the size of the db.

Okay, hmm this kind of sounds "like" a known issue that was fixed in 
1.4.0.17, but without more info htere is not much I can do about it 
now.  If it ever happens again check the CPU utilization, and grab as 
few of those stack traces.  Then open a new ticket so we can investigate it.
> > If the task is still running can you grab a stack traces using this process:
> >
> > http://www.port389.org/docs/389ds/FAQ/faq.html#debugging-hangs
> >
> > Grab  a few stack traces with that gdb command, and send them to us please.
>
> Unfortunatelly I've closed the db2index command and I've restored the
> Directory Server from a previous backup. I couldn' afford to wait much
> longer.

Understood
> > Then to fix it I think we need to do an export & import of the
> > database.  That will regenerate everything.  If you are using
> > replication then use the "--replication" option with db2ldif, otherwise
> > do not use that option:
> >   dsctl <INSTANCE> stop    --->  You might have to kill the process
> >
> > if the reindex is hanging :-(
> >   dsctl <INSTANCE> db2ldif userroot <LDIF file name> --replication
> >
> > Then import that LDIF
> >   dsctl <INSTANCE> ldif2db userroot <LDIF file name>
> >
> >   dsctl <INSTANCE> start
> >
> >
> > Then retry your search tests.
>
> This should be done on my restored running instace?

If the search is still acting up I would do this export/import (with 
--replication option) because the backup/restore is just a snap shot.  
db2ldif/ldif2db regenerates all the indexes, etc.  A 70k entry db should 
only take a few seconds to import (assuming the import does not hang on 
entry 8108).

Mark
> I have a replication with Active Directory. This will be affected?
> > Regards,
> >
> > Mark
> > > > This is not contingent on db2index, so you can run the db2index and see if that corrects the issue now (if you have not already).
> > > >
> > > > Thanks
> > > >
> > > > —
> > > > Sincerely,
> > > >
> > > > William Brown
> > > > Software Engineer, 389 Directory Server
> > > > SUSE Labs
> > > > _______________________________________________
> > > > 389-users mailing list -- [e-mail]
> > > > To unsubscribe send an email to [e-mail]
> > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> > >
> > > 389-users mailing list -- [e-mail]
> > > To unsubscribe send an email to [e-mail]
> > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
>
> 389-users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mihai Carabas]

Hello,

In order to help you to help me ;), I've re-run db2index and collected
the attached stacktraces.

Thank you,
Mihai

On Thu, Jan 24, 2019 at 5:52 PM Mark Reynolds  wrote:
> On 1/24/19 10:24 AM, Mihai Carabas wrote:
> > Hello Mark,
> >
> > On Thu, Jan 24, 2019 at 4:35 PM Mark Reynolds  wrote:
> > > On 1/24/19 8:37 AM, Mihai Carabas wrote:
> > > > On Thu, Jan 24, 2019 at 12:52 AM William Brown  wrote:
> > > > > > On 24 Jan 2019, at 00:50, Mihai Carabas  wrote:
> > > > > >
> > > > > > =profesor
> > > > > >          42815 42818 42821 42824 42827 42830 42833 42836 42839 42842
> > > > > > 42845 42848 43445 43450 45720 52253
> > > > > > =profesori
> > > > > >          7 68 3232 3648 5457 6259 6268 6270 6275 6278 6280 6282 6304
> > > > > > 6308 6323 7098 21827
> > > > >
> > > > > Can you also send me the output of :
> > > > >
> > > > > ldapsearch -b …. -s sub ‘(ou=Profesori)’ entryid
> > > >
> > > > # extended LDIF
> > > > #
> > > > # LDAPv3
> > > > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope subtree
> > > > # filter: ou=Profesori
> > > > # requesting: entryid
> > > > #
> > > >
> > > > # Profesori, DPPD, People, curs.pub.ro
> > > > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > entryid: 3648
> > > >
> > > > # search result
> > > > search: 2
> > > > result: 0 Success
> > > >
> > > > I issued db2index and I have the following output:
> > > > the 50% threshold.
> > > > [24/Jan/2019:15:14:31.578343786 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Ending pass number 1 ...
> > > >
> > > > [24/Jan/2019:15:14:31.781708885 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > >
> > > > [24/Jan/2019:15:14:32.055444491 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Workers finished; cleaning up...
> > > >
> > > > [24/Jan/2019:15:14:32.259020991 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Workers cleaned up.
> > > >
> > > > [24/Jan/2019:15:14:32.262209501 +0200] - INFO -
> > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > later...
> > > > [24/Jan/2019:15:14:33.674826562 +0200] - INFO - dblayer_instance_start
> > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > >
> > > > process is allowed to access the database
> > > > [24/Jan/2019:15:14:33.975430948 +0200] - INFO -
> > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > [24/Jan/2019:15:14:33.982718069 +0200] - INFO - import_main_offline -
> > > > reindex cursdb: Beginning pass number 2
> > > > [24/Jan/2019:15:14:54.035041942 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 204521866.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > >
> > > > [24/Jan/2019:15:15:14.086428912 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 104755102.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:15:34.138688984 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 70409167.0/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:15:54.189761953 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 53024187.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:16:14.239427918 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 42524348.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:16:34.483660956 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 35495530.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:16:54.533827623 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 30460703.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:17:14.586325096 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 26676765.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:17:34.636106261 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 23729056.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:17:54.686551928 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 21367956.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:18:14.812847819 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 19434204.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:18:34.883738846 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 17821407.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:18:54.938178725 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 16455782.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:19:14.995408557 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 15284552.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:19:35.047817446 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > >
> > > > 14221719.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:19:35.051470957 +0200] - INFO - import_throw_in_towel
> > > > reindex cursdb: Decided to end this pass because the progress rate
> > > >
> > > > has dropped below the 50% threshold.
> > > > [24/Jan/2019:15:19:35.054926468 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Ending pass number 2 ...
> > > >
> > > > [24/Jan/2019:15:19:35.258101594 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > >
> > > > [24/Jan/2019:15:19:35.261243303 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Workers finished; cleaning up...
> > > >
> > > > [24/Jan/2019:15:19:35.464851131 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Workers cleaned up.
> > > >
> > > > [24/Jan/2019:15:19:35.467968441 +0200] - INFO -
> > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > later...
> > > > [24/Jan/2019:15:19:35.506390559 +0200] - INFO - dblayer_instance_start
> > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > >
> > > > process is allowed to access the database
> > > > [24/Jan/2019:15:19:35.731292752 +0200] - INFO -
> > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > [24/Jan/2019:15:19:35.734380561 +0200] - INFO - import_main_offline -
> > > > reindex cursdb: Beginning pass number 3
> > > > [24/Jan/2019:15:19:55.782461337 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:20:15.834380724 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > >
> > > > [24/Jan/2019:15:20:35.886774313 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 71582653.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:20:55.938228899 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 53686989.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:21:15.988693682 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 42949591.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:21:40.661184607 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 34359673.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:22:00.820373724 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 29620408.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:22:20.872956514 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 26030055.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:22:40.928481812 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 23215995.6/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:23:00.983057008 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 20951020.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:23:21.398151214 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 19004244.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:23:41.466437252 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 17459183.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:24:01.517539137 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 16146463.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:24:21.568626321 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 15017339.8/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:24:41.726888036 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > >
> > > > 14035814.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:24:41.731112549 +0200] - INFO - import_throw_in_towel
> > > > reindex cursdb: Decided to end this pass because the progress rate
> > > >
> > > > has dropped below the 50% threshold.
> > > > [24/Jan/2019:15:24:41.734400859 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Ending pass number 3 ...
> > > >
> > > > [24/Jan/2019:15:24:41.837514477 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > >
> > > > [24/Jan/2019:15:24:41.841081788 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Workers finished; cleaning up...
> > > >
> > > > [24/Jan/2019:15:24:41.944805808 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Workers cleaned up.
> > > >
> > > > [24/Jan/2019:15:24:41.948172218 +0200] - INFO -
> > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > later...
> > > > [24/Jan/2019:15:24:41.972718294 +0200] - INFO - dblayer_instance_start
> > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > >
> > > > process is allowed to access the database
> > > > [24/Jan/2019:15:24:42.277287032 +0200] - INFO -
> > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > [24/Jan/2019:15:24:42.524714295 +0200] - INFO - import_main_offline -
> > > > reindex cursdb: Beginning pass number 4
> > > > [24/Jan/2019:15:25:02.589790122 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > > >
> > > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > [24/Jan/2019:15:25:22.648607831 +0200] - INFO - import_monitor_threads
> > > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > > >
> > > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > >
> > > > And it takes a long time. What should I do?
> > >
> > > This is very odd that the index task is not proceeding.  Are there more
> > > than 8108 entries in the database?  Or is that the size of the db in
> > > entries?
> >
> > I have more de 70000 users. So I do not think that is the size of the db.
>
> Okay, hmm this kind of sounds "like" a known issue that was fixed in
> 1.4.0.17, but without more info htere is not much I can do about it
> now.  If it ever happens again check the CPU utilization, and grab as
> few of those stack traces.  Then open a new ticket so we can investigate it.
> > > If the task is still running can you grab a stack traces using this process:
> > >
> > > http://www.port389.org/docs/389ds/FAQ/faq.html#debugging-hangs
> > >
> > > Grab  a few stack traces with that gdb command, and send them to us please.
> >
> > Unfortunatelly I've closed the db2index command and I've restored the
> > Directory Server from a previous backup. I couldn' afford to wait much
> > longer.
>
> Understood
> > > Then to fix it I think we need to do an export & import of the
> > > database.  That will regenerate everything.  If you are using
> > > replication then use the "--replication" option with db2ldif, otherwise
> > > do not use that option:
> > >   dsctl <INSTANCE> stop    --->  You might have to kill the process
> > >
> > > if the reindex is hanging :-(
> > >   dsctl <INSTANCE> db2ldif userroot <LDIF file name> --replication
> > >
> > > Then import that LDIF
> > >   dsctl <INSTANCE> ldif2db userroot <LDIF file name>
> > >
> > >   dsctl <INSTANCE> start
> > >
> > >
> > > Then retry your search tests.
> >
> > This should be done on my restored running instace?
>
> If the search is still acting up I would do this export/import (with
> --replication option) because the backup/restore is just a snap shot.
> db2ldif/ldif2db regenerates all the indexes, etc.  A 70k entry db should
> only take a few seconds to import (assuming the import does not hang on
> entry 8108).
>
> Mark
> > I have a replication with Active Directory. This will be affected?
> > > Regards,
> > >
> > > Mark
> > > > > This is not contingent on db2index, so you can run the db2index and see if that corrects the issue now (if you have not already).
> > > > >
> > > > > Thanks
> > > > >
> > > > > —
> > > > > Sincerely,
> > > > >
> > > > > William Brown
> > > > > Software Engineer, 389 Directory Server
> > > > > SUSE Labs
> > > > > _______________________________________________
> > > > > 389-users mailing list -- [e-mail]
> > > > > To unsubscribe send an email to [e-mail]
> > > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> > > >
> > > > 389-users mailing list -- [e-mail]
> > > > To unsubscribe send an email to [e-mail]
> > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> >
> > 389-users mailing list -- [e-mail]
> > To unsubscribe send an email to [e-mail]
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mark Reynolds]

On 1/24/19 1:18 PM, Mihai Carabas wrote:
> Hello,
>
> In order to help you to help me ;), I've re-run db2index and collected
> the attached stacktraces.

Did you see really high CPU?
> Thank you,
> Mihai
>
> On Thu, Jan 24, 2019 at 5:52 PM Mark Reynolds  wrote:
> > On 1/24/19 10:24 AM, Mihai Carabas wrote:
> > > Hello Mark,
> > >
> > > On Thu, Jan 24, 2019 at 4:35 PM Mark Reynolds  wrote:
> > > > On 1/24/19 8:37 AM, Mihai Carabas wrote:
> > > > > On Thu, Jan 24, 2019 at 12:52 AM William Brown  wrote:
> > > > > > > On 24 Jan 2019, at 00:50, Mihai Carabas  wrote:
> > > > > > >
> > > > > > > =profesor
> > > > > > >           42815 42818 42821 42824 42827 42830 42833 42836 42839 42842
> > > > > > > 42845 42848 43445 43450 45720 52253
> > > > > > > =profesori
> > > > > > >           7 68 3232 3648 5457 6259 6268 6270 6275 6278 6280 6282 6304
> > > > > > > 6308 6323 7098 21827
> > > > > > Can you also send me the output of :
> > > > > >
> > > > > > ldapsearch -b …. -s sub ‘(ou=Profesori)’ entryid
> > > > >
> > > > > # extended LDIF
> > > > > #
> > > > > # LDAPv3
> > > > > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope subtree
> > > > > # filter: ou=Profesori
> > > > > # requesting: entryid
> > > > > #
> > > > >
> > > > > # Profesori, DPPD, People, curs.pub.ro
> > > > > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > > entryid: 3648
> > > > >
> > > > > # search result
> > > > > search: 2
> > > > > result: 0 Success
> > > > >
> > > > > I issued db2index and I have the following output:
> > > > > the 50% threshold.
> > > > > [24/Jan/2019:15:14:31.578343786 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Ending pass number 1 ...
> > > > >
> > > > > [24/Jan/2019:15:14:31.781708885 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > > >
> > > > > [24/Jan/2019:15:14:32.055444491 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Workers finished; cleaning up...
> > > > >
> > > > > [24/Jan/2019:15:14:32.259020991 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Workers cleaned up.
> > > > >
> > > > > [24/Jan/2019:15:14:32.262209501 +0200] - INFO -
> > > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > > later...
> > > > > [24/Jan/2019:15:14:33.674826562 +0200] - INFO - dblayer_instance_start
> > > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > > >
> > > > > process is allowed to access the database
> > > > > [24/Jan/2019:15:14:33.975430948 +0200] - INFO -
> > > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > > [24/Jan/2019:15:14:33.982718069 +0200] - INFO - import_main_offline -
> > > > > reindex cursdb: Beginning pass number 2
> > > > > [24/Jan/2019:15:14:54.035041942 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 204521866.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > >
> > > > > [24/Jan/2019:15:15:14.086428912 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 104755102.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:15:34.138688984 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 70409167.0/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:15:54.189761953 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 53024187.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:16:14.239427918 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 42524348.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:16:34.483660956 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 35495530.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:16:54.533827623 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 30460703.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:17:14.586325096 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 26676765.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:17:34.636106261 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 23729056.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:17:54.686551928 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 21367956.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:18:14.812847819 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 19434204.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:18:34.883738846 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 17821407.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:18:54.938178725 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 16455782.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:19:14.995408557 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 15284552.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:19:35.047817446 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > >
> > > > > 14221719.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:19:35.051470957 +0200] - INFO - import_throw_in_towel
> > > > > reindex cursdb: Decided to end this pass because the progress rate
> > > > >
> > > > > has dropped below the 50% threshold.
> > > > > [24/Jan/2019:15:19:35.054926468 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Ending pass number 2 ...
> > > > >
> > > > > [24/Jan/2019:15:19:35.258101594 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > > >
> > > > > [24/Jan/2019:15:19:35.261243303 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Workers finished; cleaning up...
> > > > >
> > > > > [24/Jan/2019:15:19:35.464851131 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Workers cleaned up.
> > > > >
> > > > > [24/Jan/2019:15:19:35.467968441 +0200] - INFO -
> > > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > > later...
> > > > > [24/Jan/2019:15:19:35.506390559 +0200] - INFO - dblayer_instance_start
> > > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > > >
> > > > > process is allowed to access the database
> > > > > [24/Jan/2019:15:19:35.731292752 +0200] - INFO -
> > > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > > [24/Jan/2019:15:19:35.734380561 +0200] - INFO - import_main_offline -
> > > > > reindex cursdb: Beginning pass number 3
> > > > > [24/Jan/2019:15:19:55.782461337 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:20:15.834380724 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > >
> > > > > [24/Jan/2019:15:20:35.886774313 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 71582653.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:20:55.938228899 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 53686989.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:21:15.988693682 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 42949591.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:21:40.661184607 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 34359673.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:22:00.820373724 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 29620408.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:22:20.872956514 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 26030055.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:22:40.928481812 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 23215995.6/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:23:00.983057008 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 20951020.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:23:21.398151214 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 19004244.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:23:41.466437252 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 17459183.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:24:01.517539137 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 16146463.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:24:21.568626321 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 15017339.8/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:24:41.726888036 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > >
> > > > > 14035814.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:24:41.731112549 +0200] - INFO - import_throw_in_towel
> > > > > reindex cursdb: Decided to end this pass because the progress rate
> > > > >
> > > > > has dropped below the 50% threshold.
> > > > > [24/Jan/2019:15:24:41.734400859 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Ending pass number 3 ...
> > > > >
> > > > > [24/Jan/2019:15:24:41.837514477 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > > >
> > > > > [24/Jan/2019:15:24:41.841081788 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Workers finished; cleaning up...
> > > > >
> > > > > [24/Jan/2019:15:24:41.944805808 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Workers cleaned up.
> > > > >
> > > > > [24/Jan/2019:15:24:41.948172218 +0200] - INFO -
> > > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > > later...
> > > > > [24/Jan/2019:15:24:41.972718294 +0200] - INFO - dblayer_instance_start
> > > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > > >
> > > > > process is allowed to access the database
> > > > > [24/Jan/2019:15:24:42.277287032 +0200] - INFO -
> > > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > > [24/Jan/2019:15:24:42.524714295 +0200] - INFO - import_main_offline -
> > > > > reindex cursdb: Beginning pass number 4
> > > > > [24/Jan/2019:15:25:02.589790122 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > > > >
> > > > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > [24/Jan/2019:15:25:22.648607831 +0200] - INFO - import_monitor_threads
> > > > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > > > >
> > > > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > >
> > > > > And it takes a long time. What should I do?
> > > >
> > > > This is very odd that the index task is not proceeding.  Are there more
> > > > than 8108 entries in the database?  Or is that the size of the db in
> > > > entries?
> > >
> > > I have more de 70000 users. So I do not think that is the size of the db.
> >
> > Okay, hmm this kind of sounds "like" a known issue that was fixed in
> > 1.4.0.17, but without more info htere is not much I can do about it
> > now.  If it ever happens again check the CPU utilization, and grab as
> > few of those stack traces.  Then open a new ticket so we can investigate it.
> > > > If the task is still running can you grab a stack traces using this process:
> > > >
> > > > http://www.port389.org/docs/389ds/FAQ/faq.html#debugging-hangs
> > > >
> > > > Grab  a few stack traces with that gdb command, and send them to us please.
> > >
> > > Unfortunatelly I've closed the db2index command and I've restored the
> > > Directory Server from a previous backup. I couldn' afford to wait much
> > > longer.
> >
> > Understood
> > > > Then to fix it I think we need to do an export & import of the
> > > > database.  That will regenerate everything.  If you are using
> > > > replication then use the "--replication" option with db2ldif, otherwise
> > > > do not use that option:
> > > >    dsctl <INSTANCE> stop    --->  You might have to kill the process
> > > >
> > > > if the reindex is hanging :-(
> > > >    dsctl <INSTANCE> db2ldif userroot <LDIF file name> --replication
> > > >
> > > > Then import that LDIF
> > > >    dsctl <INSTANCE> ldif2db userroot <LDIF file name>
> > > >
> > > >    dsctl <INSTANCE> start
> > > >
> > > >
> > > > Then retry your search tests.
> > >
> > > This should be done on my restored running instace?
> >
> > If the search is still acting up I would do this export/import (with
> > --replication option) because the backup/restore is just a snap shot.
> > db2ldif/ldif2db regenerates all the indexes, etc.  A 70k entry db should
> > only take a few seconds to import (assuming the import does not hang on
> > entry 8108).
> >
> > Mark
> > > I have a replication with Active Directory. This will be affected?
> > > > Regards,
> > > >
> > > > Mark
> > > > > > This is not contingent on db2index, so you can run the db2index and see if that corrects the issue now (if you have not already).
> > > > > >
> > > > > > Thanks
> > > > > >
> > > > > > —
> > > > > > Sincerely,
> > > > > >
> > > > > > William Brown
> > > > > > Software Engineer, 389 Directory Server
> > > > > > SUSE Labs
> > > > > > _______________________________________________
> > > > > > 389-users mailing list -- [e-mail]
> > > > > > To unsubscribe send an email to [e-mail]
> > > > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> > > > >
> > > > > 389-users mailing list -- [e-mail]
> > > > > To unsubscribe send an email to [e-mail]
> > > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> > >
> > > 389-users mailing list -- [e-mail]
> > > To unsubscribe send an email to [e-mail]
> > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> > >
> > > 389-users mailing list -- [e-mail]
> > > To unsubscribe send an email to [e-mail]
> > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....

[Mihai Carabas]

Mihai Carabas
> On 24 Jan 2019, at 22:15, Mark Reynolds  wrote:
> > On 1/24/19 1:18 PM, Mihai Carabas wrote:
> > Hello,
> >
> > In order to help you to help me ;), I've re-run db2index and collected
> > the attached stacktraces.
>
> Did you see really high CPU?

Not at all. Almost 0. It seems that ns-slapd is barely getting on Cpu. It looks like a deadlock?
> > Thank you,
> > Mihai
> >
> > On Thu, Jan 24, 2019 at 5:52 PM Mark Reynolds  wrote:
> > > > On 1/24/19 10:24 AM, Mihai Carabas wrote:
> > > > Hello Mark,
> > > >
> > > > On Thu, Jan 24, 2019 at 4:35 PM Mark Reynolds  wrote:
> > > > > > On 1/24/19 8:37 AM, Mihai Carabas wrote:
> > > > > > > On Thu, Jan 24, 2019 at 12:52 AM William Brown  wrote:
> > > > > > >> On 24 Jan 2019, at 00:50, Mihai Carabas  wrote:
> > > > > > >> 
> > > > > > >> =profesor
> > > > > > >>          42815 42818 42821 42824 42827 42830 42833 42836 42839 42842
> > > > > > >> 42845 42848 43445 43450 45720 52253
> > > > > > >> =profesori
> > > > > > >>          7 68 3232 3648 5457 6259 6268 6270 6275 6278 6280 6282 6304
> > > > > > >> 6308 6323 7098 21827
> > > > > > > Can you also send me the output of :
> > > > > > > 
> > > > > > > ldapsearch -b …. -s sub ‘(ou=Profesori)’ entryid
> > > > > > # extended LDIF
> > > > > > #
> > > > > > # LDAPv3
> > > > > > # base <ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro> with scope subtree
> > > > > > # filter: ou=Profesori
> > > > > > # requesting: entryid
> > > > > > #
> > > > > >
> > > > > > # Profesori, DPPD, People, curs.pub.ro
> > > > > > dn: ou=Profesori,ou=DPPD,ou=People,dc=curs,dc=pub,dc=ro
> > > > > > entryid: 3648
> > > > > >
> > > > > > # search result
> > > > > > search: 2
> > > > > > result: 0 Success
> > > > > >
> > > > > > I issued db2index and I have the following output:
> > > > > > the 50% threshold.
> > > > > > [24/Jan/2019:15:14:31.578343786 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Ending pass number 1 ...
> > > > > >
> > > > > > [24/Jan/2019:15:14:31.781708885 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > > > >
> > > > > > [24/Jan/2019:15:14:32.055444491 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Workers finished; cleaning up...
> > > > > >
> > > > > > [24/Jan/2019:15:14:32.259020991 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Workers cleaned up.
> > > > > >
> > > > > > [24/Jan/2019:15:14:32.262209501 +0200] - INFO -
> > > > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > > > later...
> > > > > > [24/Jan/2019:15:14:33.674826562 +0200] - INFO - dblayer_instance_start
> > > > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > > > >
> > > > > > process is allowed to access the database
> > > > > > [24/Jan/2019:15:14:33.975430948 +0200] - INFO -
> > > > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > > > [24/Jan/2019:15:14:33.982718069 +0200] - INFO - import_main_offline -
> > > > > > reindex cursdb: Beginning pass number 2
> > > > > > [24/Jan/2019:15:14:54.035041942 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 204521866.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > >
> > > > > > [24/Jan/2019:15:15:14.086428912 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 104755102.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:15:34.138688984 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 70409167.0/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:15:54.189761953 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 53024187.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:16:14.239427918 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 42524348.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:16:34.483660956 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 35495530.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:16:54.533827623 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 30460703.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:17:14.586325096 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 26676765.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:17:34.636106261 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 23729056.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:17:54.686551928 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 21367956.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:18:14.812847819 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 19434204.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:18:34.883738846 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 17821407.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:18:54.938178725 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 16455782.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:19:14.995408557 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 15284552.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:19:35.047817446 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 2) -- average rate
> > > > > >
> > > > > > 14221719.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:19:35.051470957 +0200] - INFO - import_throw_in_towel
> > > > > > reindex cursdb: Decided to end this pass because the progress rate
> > > > > >
> > > > > > has dropped below the 50% threshold.
> > > > > > [24/Jan/2019:15:19:35.054926468 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Ending pass number 2 ...
> > > > > >
> > > > > > [24/Jan/2019:15:19:35.258101594 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > > > >
> > > > > > [24/Jan/2019:15:19:35.261243303 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Workers finished; cleaning up...
> > > > > >
> > > > > > [24/Jan/2019:15:19:35.464851131 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Workers cleaned up.
> > > > > >
> > > > > > [24/Jan/2019:15:19:35.467968441 +0200] - INFO -
> > > > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > > > later...
> > > > > > [24/Jan/2019:15:19:35.506390559 +0200] - INFO - dblayer_instance_start
> > > > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > > > >
> > > > > > process is allowed to access the database
> > > > > > [24/Jan/2019:15:19:35.731292752 +0200] - INFO -
> > > > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > > > [24/Jan/2019:15:19:35.734380561 +0200] - INFO - import_main_offline -
> > > > > > reindex cursdb: Beginning pass number 3
> > > > > > [24/Jan/2019:15:19:55.782461337 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:20:15.834380724 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > >
> > > > > > [24/Jan/2019:15:20:35.886774313 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 71582653.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:20:55.938228899 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 53686989.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:21:15.988693682 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 42949591.9/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:21:40.661184607 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 34359673.5/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:22:00.820373724 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 29620408.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:22:20.872956514 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 26030055.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:22:40.928481812 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 23215995.6/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:23:00.983057008 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 20951020.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:23:21.398151214 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 19004244.2/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:23:41.466437252 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 17459183.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:24:01.517539137 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 16146463.1/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:24:21.568626321 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 15017339.8/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:24:41.726888036 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 3) -- average rate
> > > > > >
> > > > > > 14035814.3/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:24:41.731112549 +0200] - INFO - import_throw_in_towel
> > > > > > reindex cursdb: Decided to end this pass because the progress rate
> > > > > >
> > > > > > has dropped below the 50% threshold.
> > > > > > [24/Jan/2019:15:24:41.734400859 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Ending pass number 3 ...
> > > > > >
> > > > > > [24/Jan/2019:15:24:41.837514477 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Foreman is done; waiting for workers to finish...
> > > > > >
> > > > > > [24/Jan/2019:15:24:41.841081788 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Workers finished; cleaning up...
> > > > > >
> > > > > > [24/Jan/2019:15:24:41.944805808 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Workers cleaned up.
> > > > > >
> > > > > > [24/Jan/2019:15:24:41.948172218 +0200] - INFO -
> > > > > > import_sweep_after_pass - reindex cursdb: Sweeping files for merging
> > > > > > later...
> > > > > > [24/Jan/2019:15:24:41.972718294 +0200] - INFO - dblayer_instance_start
> > > > > > Import is running with nsslapd-db-private-import-mem on; No other
> > > > > >
> > > > > > process is allowed to access the database
> > > > > > [24/Jan/2019:15:24:42.277287032 +0200] - INFO -
> > > > > > import_sweep_after_pass - reindex cursdb: Sweep done.
> > > > > > [24/Jan/2019:15:24:42.524714295 +0200] - INFO - import_main_offline -
> > > > > > reindex cursdb: Beginning pass number 4
> > > > > > [24/Jan/2019:15:25:02.589790122 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > > > > >
> > > > > > 214747959.4/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > > [24/Jan/2019:15:25:22.648607831 +0200] - INFO - import_monitor_threads
> > > > > > reindex cursdb: Processed 8108 entries (pass 4) -- average rate
> > > > > >
> > > > > > 107373979.7/sec, recent rate 0.0/sec, hit ratio 0%
> > > > > >
> > > > > > And it takes a long time. What should I do?
> > > > >
> > > > > This is very odd that the index task is not proceeding.  Are there more
> > > > > than 8108 entries in the database?  Or is that the size of the db in
> > > > > entries?
> > > >
> > > > I have more de 70000 users. So I do not think that is the size of the db.
> > >
> > > Okay, hmm this kind of sounds "like" a known issue that was fixed in
> > > 1.4.0.17, but without more info htere is not much I can do about it
> > > now.  If it ever happens again check the CPU utilization, and grab as
> > > few of those stack traces.  Then open a new ticket so we can investigate it.
> > > > > If the task is still running can you grab a stack traces using this process:
> > > > >
> > > > > http://www.port389.org/docs/389ds/FAQ/faq.html#debugging-hangs
> > > > >
> > > > > Grab  a few stack traces with that gdb command, and send them to us please.
> > > >
> > > > Unfortunatelly I've closed the db2index command and I've restored the
> > > > Directory Server from a previous backup. I couldn' afford to wait much
> > > > longer.
> > >
> > > Understood
> > > > > Then to fix it I think we need to do an export & import of the
> > > > > database.  That will regenerate everything.  If you are using
> > > > > replication then use the "--replication" option with db2ldif, otherwise
> > > > > do not use that option:
> > > > >   dsctl <INSTANCE> stop    --->  You might have to kill the process
> > > > >
> > > > > if the reindex is hanging :-(
> > > > >   dsctl <INSTANCE> db2ldif userroot <LDIF file name> --replication
> > > > >
> > > > > Then import that LDIF
> > > > >   dsctl <INSTANCE> ldif2db userroot <LDIF file name>
> > > > >
> > > > >   dsctl <INSTANCE> start
> > > > >
> > > > >
> > > > > Then retry your search tests.
> > > >
> > > > This should be done on my restored running instace?
> > >
> > > If the search is still acting up I would do this export/import (with
> > > --replication option) because the backup/restore is just a snap shot.
> > > db2ldif/ldif2db regenerates all the indexes, etc.  A 70k entry db should
> > > only take a few seconds to import (assuming the import does not hang on
> > > entry 8108).
> > >
> > > Mark
> > > > I have a replication with Active Directory. This will be affected?
> > > > > Regards,
> > > > >
> > > > > Mark
> > > > > > > This is not contingent on db2index, so you can run the db2index and see if that corrects the issue now (if you have not already).
> > > > > > > 
> > > > > > > Thanks
> > > > > > > 
> > > > > > > —
> > > > > > > Sincerely,
> > > > > > > 
> > > > > > > William Brown
> > > > > > > Software Engineer, 389 Directory Server
> > > > > > > SUSE Labs
> > > > > > > _______________________________________________
> > > > > > > 389-users mailing list -- [e-mail]
> > > > > > > To unsubscribe send an email to [e-mail]
> > > > > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> > > > > > _______________________________________________
> > > > > > 389-users mailing list -- [e-mail]
> > > > > > To unsubscribe send an email to [e-mail]
> > > > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> > > >
> > > > 389-users mailing list -- [e-mail]
> > > > To unsubscribe send an email to [e-mail]
> > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....
> > > >
> > > > 389-users mailing list -- [e-mail]
> > > > To unsubscribe send an email to [e-mail]
> > > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > > List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]....