On Wed, 10 Apr 2013 10:53:25 -0400
John.Florian(a)dart.biz wrote:
> From: seth vidal <skvidal(a)fedoraproject.org>
>
> The metadata doesn't get downloaded if it hasn't changed - the
> problem though is that the metadata DOES change often. Normally
> everyday.
Is there anything that could be done to make it unnecessary to pull
the complete metadata for every update? For example, IIRC this is
all sqlite data, but what if this was in a plain-text data dump form
where something like rsync could be used to efficiently transfer only
those bits that have changed. Client CPU time to reconstruct the DB
is probably cheaper than the bandwidth. Maybe such a mode would only
be used if the DB size exceeded some threshold.
You'll have to talk to those folks who are trying to work on a delta
metadata format.
And rsync is not efficient from a bunch of clients to a mirror server.
It would cripple a mirror server in a moment.
-sv