EPEL Django deprecated

[Stephen John Smoogen]

On 7 June 2013 13:48, Matthew Miller <mattdm at fedoraproject.org> wrote:

> On Fri, Jun 07, 2013 at 01:31:36PM -0600, Stephen John Smoogen wrote:
> > The easiest way I could see is just get a better sampling method which
> > would be to have funding for a mirror which we then put into
> mirror-manager
> > and we know that this is a sampling versus a request info. (basically we
> > would see what packages are downloaded directly and then extend that
> sample
> > from the amount of downloads to the 500,000 systems that check in via
> > mirrormanager). The problems involved are paying for systems, storage,
> and
> > bandwidth for such items.
>
> Maybe one of the mirrors would be able to provide logs?
>
>
Possibly. In the past mirror admins have not wanted to do so for many
reasons (can't keep logs longer than 24 hours for policy reasons, can't
give over logs without a formal agreement and then with as much redacted as
possible, if we do it for X then we have to do it for everyone so no
thankyou.) When I was at my university gig, it had to go up 4 levels of
management before I gave up at the sub-CIO level.)

I have tried looking at the top level mirrors but most of the data is
swamped out by other sites mirroring and lots of people doing development
work and pointing to repos directly. This led to some strange statistics
where trying to pull out even most of the noise made for various packages
to "stand out" until I realized they were pulled in for cross-compiles and
such (or the site that likes to do partial mirrors every couple of hours
but always pulls in the same 4 packages each time even when it pulls in
others.) I am expecting that other mirrors are going to run into that which
means that stuff that a lot of sites could give out (just the urls per day)
versus the IP address, URL would mean that the data would have a lot of
weird noise that makes say zvbi show up high because it is both getting
mirrored as the last package on the server and also because 8 packages use
it as depends (not true but I can't remember the package that showed up a
ton.)

In either case, it is what got me to realize that a mirror is needed to
allow for better statistics of this sort because the data can be cleaned as
needed versus pre-cleaned and reanimated.


-- 
Stephen J Smoogen.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.fedoraproject.org/pipermail/epel-devel/attachments/20130607/34a5f214/attachment-0001.html>