Speedup the availability of updates (was: Re: Push scripts, mash) pushes in Bodhi (urgent call for feedback))

[Josef Bacik]

On Fri, Mar 5, 2010 at 1:29 PM, Mike McGrath <mmcgrath at redhat.com> wrote:
> On Fri, 5 Mar 2010, Bill Nottingham wrote:
>
>> Till Maas (opensource at till.name) said:
>> > I have some ideas to speedup the availability of updates. Are there any
>> > reasons except that the tools to do this do not exist yet, to switch to
>> > this? I created a wiki page for this:
>> > https://fedoraproject.org/wiki/User:Till/update_availability_speedup_ideas
>>
>> It seems to be missing something - it says 'all rpms that are not included
>> in the prior metadata will be deleted', but there's nothing in that proposal
>> as written that will cause rpms to fall out of the metadata.
>>
>> With respect to hardlinks, the updates repos that are created *are*
>> hardlinks (to the koji packages); the only copying that's involved is
>> pushing them from the koji storage to the mirror storage.
>>
>
> Side note about this, it's a 10T ext3 filesystem exportetd via nfs.  Does
> anyone happen to know if hardlinking is particularly expensive in this
> setup?  We're doing profiling and things and haven't actually tested this
> yet but I thought I'd ask.
>

Hard-linking is as expensive as creating empty files, so if you are
happy with the create speed then you will be happy with the hardlink
speed.  Thanks,

Josef