<html>
<head>
<meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
On 04/19/2012 11:38 AM, Russell Beall wrote:
<blockquote cite="mid:684CC4CB-4DCC-42A0-B3B2-F2A929122FA8@usc.edu"
type="cite">That is by far the largest example we have. We use
groups with the uniquemember attribute linking to account entries
and more than a few of the groups have tens of thousands of values
for uniquemember. We create more of these groups regularly and it
will be a problem for it to take many hours to construct such a
group versus seconds/minutes with Sun DS. Our metadirectory
process does not use ldapadd to create the group pre-populated,
the group is created and then ldapmodify is run to add members.
Three times a year at the change of semester, many thousands of
group membership changes are processed and we already have a
problem with it taking multiple days to process the entire set...</blockquote>
<br>
OK. If you've ruled out the possibility that some plugin is
interfering with the processing, then it must be something we will
have to fix in the core server. Please file a ticket at
<a class="moz-txt-link-freetext" href="https://fedorahosted.org/389">https://fedorahosted.org/389</a><br>
<br>
<blockquote cite="mid:684CC4CB-4DCC-42A0-B3B2-F2A929122FA8@usc.edu"
type="cite">
<div><br>
</div>
<div>We also have large quantities of eduPersonEntitlement on
account records, but those sets are not nearly as numerously
populated. I can delete and re-add the eduPersonEntitlement
attribute across 110,000 records in about 40 minutes (20 minutes
each way -- with 389).<br>
<div>
<div><br>
</div>
<div>Russ.</div>
<div><br>
</div>
<div>On Apr 19, 2012, at 10:18 AM, Rich Megginson wrote:</div>
<br class="Apple-interchange-newline">
<blockquote type="cite">
<meta content="text/html; charset=UTF-8"
http-equiv="Content-Type">
<div bgcolor="#FFFFFF" text="#000000"> On 04/19/2012 10:50
AM, Russell Beall wrote:
<blockquote
cite="mid:DA1B66D7-4E91-4836-91C7-B1319D01C0DA@usc.edu"
type="cite">Thanks for the tips. I scanned the dse.ldif
for those plugins and I found definitions for them all,
but they all have nsslapd-pluginEnabled: off.
<div><br>
</div>
<div>There is something special about the uniquemember
attribute that requires additional processing
different from other attributes... Ldapmodify of
other attributes runs pretty quick.</div>
</blockquote>
<br>
Is uniquemember the only attribute using large numbers of
multiple values in ldapmodify operations?<br>
<br>
<blockquote
cite="mid:DA1B66D7-4E91-4836-91C7-B1319D01C0DA@usc.edu"
type="cite">
<div><br>
</div>
<div>Regards,</div>
<div>Russ.</div>
<div><br>
<div>
<div>On Apr 19, 2012, at 2:20 AM, Andrey Ivanov
wrote:</div>
<br class="Apple-interchange-newline">
<blockquote type="cite">Hi Russel,<br>
<br>
<br>
<div class="gmail_quote">Le 18 avril 2012 23:06,
Russell Beall <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:beall@usc.edu">beall@usc.edu</a>></span>
a écrit :<br>
<blockquote class="gmail_quote" style="margin:0
0 0 .8ex;border-left:1px #ccc
solid;padding-left:1ex">
<div style="word-wrap:break-word">
<div class="im">
<div>On Apr 18, 2012, at 11:15 AM, Rich
Megginson wrote:</div>
<div>
<blockquote type="cite"><span
style="border-collapse:separate;font-family:Helvetica;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-size:medium">Yeah,
this particular operation has not
been optimized. I believe SunDS
added explicit optimizations for
this particular case.<br>
</span></blockquote>
<br>
</div>
</div>
<div class="im">
<div><span
style="border-collapse:separate;font-family:Helvetica;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-size:medium"><br>
</span></div>
</div>
<div><span
style="border-collapse:separate;font-family:Helvetica;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-size:medium">It
is becoming painfully apparent as I
write more detailed tests. 389 takes
time to add or delete uniquemember
values proportionate to the number of
values being operated on and is using
about twice as much time to delete as it
does to add. Sun DS appears to have
perhaps an almost O(1) algorithm in play
on both adding and deleting values.</span></div>
<div><span
style="border-collapse:separate;font-family:Helvetica;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-size:medium"><br>
</span></div>
<div><span
style="border-collapse:separate;font-family:Helvetica;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-size:medium">Is
there perhaps some kind of referential
integrity setting that is being used and
forcing some kind of lookup of each
value, one that we could perhaps turn
off? We wouldn't need such a check
because our metadirectory process
handles the integrity/consistency
checking already.</span></div>
</div>
</blockquote>
<div><br>
There is memberOf plugin that maintains the
memberOf attribute for groups. I don't know
whether it is activated by default or not.
You could try to disable it. There is also
referential integrity plugin, attribute
uniqueness plugin, maybe USN plugin or custom
indexes that could consume a lot of CPU. Make
sure you've disabled them if you don't need
them.<br>
<br>
@+<br>
</div>
</div>
--<br>
389 users mailing list<br>
<a moz-do-not-send="true"
href="mailto:389-users@lists.fedoraproject.org">389-users@lists.fedoraproject.org</a><br>
<a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="https://admin.fedoraproject.org/mailman/listinfo/389-users">https://admin.fedoraproject.org/mailman/listinfo/389-users</a></blockquote>
</div>
<br>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">--
389 users mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:389-users@lists.fedoraproject.org">389-users@lists.fedoraproject.org</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="https://admin.fedoraproject.org/mailman/listinfo/389-users">https://admin.fedoraproject.org/mailman/listinfo/389-users</a></pre>
</blockquote>
<br>
</div>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">--
389 users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:389-users@lists.fedoraproject.org">389-users@lists.fedoraproject.org</a>
<a class="moz-txt-link-freetext" href="https://admin.fedoraproject.org/mailman/listinfo/389-users">https://admin.fedoraproject.org/mailman/listinfo/389-users</a></pre>
</blockquote>
<br>
</body>
</html>