alviss Fedora mirror syncing
Greetings. I have been reviewing the rsync logs for Fedora's master
mirror servers (download*.fedora.redhat.com), and am seeing some unusual
behavior from your mirror alviss. In the 5d8h between April 12 and
April 17, alviss synced (successfully) 3380 times. I believe this is
just a bit excessive. I understand wishing to keep up-to-date, but as
the content on the master mirrors changes at most 4 times a day, syncing
something every 2 minutes simply adds extra load to our servers and to
yours.
Instead of syncing each of the content directories separately as you do:
# Syncs # rsync module
371 fedora-linux-development/i386/
368 fedora-linux-development/ppc/
376 fedora-linux-development/ppc64/
383 fedora-linux-development/source/
374 fedora-linux-development/x86_64/
381 fedora-linux-updates/10/
386 fedora-linux-updates/9/
363 fedora-linux-updates/testing/10/
378 fedora-linux-updates/testing/9/
Could you instead sync the top-level fedora-linux-development, or
fedora-linux-updates modules, and not their subdirectories, and sync
less frequently (say, once an hour at most)? Fedora-linux-development
is updated at most once a day (typically around 5am Eastern Standard
Time US). Syncing it more often is pointless.
For comparison, you sync 3x more often than even Red Hat's internal
mirrors and kernel.org, which themselves sync 3x more often than nearly
any other mirror. (yes, your 3380 syncs vs most mirrors under 300 in
the same time period).
I also see you sync using download.fedora.redhat.com. Because this is
name is a DNS round-robin, could you instead chose one to sync from
(such as download3.fedora.redhat.com), such that you consistently sync
from the same server?
Furthermore, we have instituted a "tiering" policy, whereby we're asking
mirrors to help reduce load on our masters by syncing to a "Tier 1"
mirror, as listed here:
https://fedoraproject.org/wiki/Infrastructure/Mirroring/Tiering
Please consider syncing from a Tier 1 mirror instead of
download*.fedora.redhat.com.
Thanks for your longstanding support of Fedora. It is greatly
appreciated.
-Matt
Fedora Mirror Wrangler
--
Matt Domsch
Linux Technology Strategist, Dell Office of the CTO
linux.dell.com & www.dell.com/linux