Sync github projects on fedorahosted

[Konstantin Ryabitsev]

On Tue, Feb 25, 2014 at 9:36 AM, Pierre-Yves Chibon <pingou at pingoured.fr>wrote:
>
> >    I've not approached them for anything like this, but I would imagine a
> >    single manifest file would not work at all for all of github's
> >    repositories. The largest collection we currently manage with
> grokmirror
> >    is 5,500 repositories and though it does admirably well, it's getting
> to
> >    the point where parsing/writing the manifest file is taking upwards
> of a
> >    second. They could probably generate a manifest file per user, but
> not a
> >    single manifest for all the repositories they host.
>
> Per-user or per-organization might already just do the job. Tbh, I was even
> thinking of a per-project manifest.
>

Per-project would largely defeat the purpose of grokmirror. The goal was to
be able to check the status of thousands of repositories with only one REST
call. If you have as many manifest files as there are projects, just doing
"git pull" in each project would be about as efficient as a "http get", so
might as well just run "grok-dumb-pull".

Regards,
-K
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.fedoraproject.org/pipermail/infrastructure/attachments/20140225/fa828457/attachment.html>