On Tue, Apr 2, 2024 at 7:08 PM Kevin Fenzi <kevin(a)scrye.com> wrote:
On Tue, Apr 02, 2024 at 12:35:53PM +0200, Carsten Otto wrote:
> Hi,
Hello.
> I'm one of the admins of ftp.halifax.rwth-aachen.de, which offers fedora
> and fedora-epel among other distributions and projects. I've recently
> noticed that many Fedora users (including EPEL, CentOS, and BlackArch)
> frequently re-download "repodata" files that haven't been updated
since
> the previous request.
How are you determining this? From IP address?
Those could be a large number of different machines behind a nat proxy
no?
> As some of those files are rather large ("filelists") and others are hit
> extremely often, I added fail2ban rules to deny users access to our
> service for some time.
Recent versions of fedora do not even download the filelists unless a
user requests/looks up something that needs it. For normal install or
updates, it shouldn't be pulled. Can you tell what OS/versions this is
happening with?
In general clients should pull the repomd.xml file and check if it's
changed, if not, use their cached versions.
An exception to this would be people building containers.
Theytypically remove the metadata at the end of each build. So do not
have it cached. However, the described behaviour would seem to be
more widespread than some people building containers, which may
indicate some other reason that a group of people are repeatedly
grabbing the same data. It would be interesting to know if they are
only getting repodata or also downloading rpms and other things.
Dennis
> > Please adjust your software so that file mirrors like ours are not
> > (ab)used like this. Files that haven't been changed usually shouldn't
be
> > downloaded.
>
> This should normally already be the case, so I wonder what is happening
> here, could be a bug in some version/os or otherwise something
> unexpected.
>
> kevin
> --
> _______________________________________________
> Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
> To unsubscribe send an email to mirror-admin-leave(a)lists.fedoraproject.org
> Fedora Code of Conduct:
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines:
https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
https://lists.fedoraproject.org/archives/list/mirror-admin@lists.fedorapr...
> Do not reply to spam, report it:
https://pagure.io/fedora-infrastructure/new_issue