About MirrorManager2

[David Gay]

----- Original Message -----
> From: "Pierre-Yves Chibon" <pingou at pingoured.fr>
> To: "Fedora Infrastructure" <infrastructure at lists.fedoraproject.org>
> Sent: Wednesday, February 11, 2015 5:10:01 AM
> Subject: About MirrorManager2

[snip]

> Before we move MirrorManager2 to prod, here is what I think would be nice to
> do/have:
> 
> - Pickle validation
>   - Figure a way to validate a pickle after its creation and before moving it
>   to
>     the mirrorlist boxes
> - Find out if we can improve our tests some more
>   (to improve our confidence that we're ready)
> - Engage the mirror mailing list and try to get them to react on the coming
>   changes
> 
> The pickle validation might also be an interesting idea to check if there is
> a
> difference between the pickle generated by prod and the one generated in stg.
> 
>  
> Finally, at DevConf we have been speaking quite a bit with Dennis around
> updates and MirrorManager and here is some of the ideas we spoke about:
>  
> - Be able to run the UMDL script on only a part of the tree
>   (ie: be able to say, we updated f21-updates and we only update this part)
> - Crawl the mirrors for only a part of the tree
>   (This goes together with updating only part of the tree via UMDL)
> - Consider if we should/could drop the content of the host_category_dir table
>   before running the crawler
> - Mirror versioning:
>   - run UMDL, detect changes, increase master mirror's version by 1
>   - run the crawler, check for the changes, align that mirror's version with
>   the
>     master mirror one
>   - be able to see the difference between two versions
>   - be able to crawl a mirror only for the difference between the version it
>   is
>     at and the version the master mirror is at
>   note: we might still want to run a full crawl once in a while (daily?
>   bi-daily?)
>  
> This list of ideas is more a long term todo list, not something we would want
> to
> have working for pushing MirrorManager2 to prod.
> 
> 
> Thoughts? Agreements? Disagreements?

Hi!

I'd like to help move this along to production. I have very limited knowledge of the MM codebase, but I did attend the MM FAD, so I have at least a vague understanding of how it works. Are there any changes to these lists since last week? What might be productive to work on? Like I said, my knowledge is limited, but pickle validation sounds like a pretty general Python task. Maybe I could look into that?

Any direction and info on some task(s) I could try my hand at is appreciated. :)

-- David