Need help with script problem

[Paul W. Frields]

On Wed, Jul 10, 2013 at 04:59:58PM -0600, Kevin Fenzi wrote:
> On Wed, 10 Jul 2013 17:12:23 -0400
> "Paul W. Frields" <stickster at gmail.com> wrote:
> 
> > The direct download numbers I'm gathering via script for F19 seem way
> > off.  So much so that I think I must be missing a good bit of data.
> > 
> > The script I'm using is attached.  Can someone help me understand
> > where I might be missing relevant data?  Looking through the entire
> > hosts log structure is kind of daunting but I'm thinking there might
> > have been some well-known change that moved a chunk of log data to a
> > place I'm not looking through.
> 
> For one thing the logs are now bz2'ed... 
> 
> ie: 
> 
> /var/log/hosts/proxy09.vpn.fedoraproject.org/2013/07/09/http/download.fedoraproject.org-access.log.bz2
> 
> [kevin at log02 ~]$ egrep
> "Fedora-19.*\.iso" /var/log/hosts/proxy09.vpn.fedoraproject.org/2013/07/09/http/download.fedoraproject.org-access.log.bz2
> | wc -l 0 
> [kevin at log02 ~]$ bzgrep
> "Fedora-19.*\.iso" /var/log/hosts/proxy09.vpn.fedoraproject.org/2013/07/09/http/download.fedoraproject.org-access.log.bz2
> | wc -l 1478
> 
> Patch: 
> 
> 15,16c15,16
> <   egrep "Fedora-$RELEASE.*\.iso" \
> <       /var/log/hosts/proxy*/${YEAR}/${MONTH}/${DAY}/http/download.fedoraproject.org-access.log
> | \ ---
> >   bzgrep "Fedora-$RELEASE.*\.iso" \
> >       /var/log/hosts/proxy*/${YEAR}/${MONTH}/${DAY}/http/download.fedoraproject.org-access.log.bz2
> > | \
> 
> I have no idea if those numbers look better or not tho, there might be
> something more going on. 

Still looks really anemic.

$ NDAYS=9 ~/bin/dl-stats.sh
Direct downloads: 
  2013-07-02 672
  2013-07-03 5130
  2013-07-04 4769
  2013-07-05 2942
  2013-07-06 2540
  2013-07-07 1762
  2013-07-08 1495
  2013-07-09 2051
  2013-07-10 1852

That's roughly a half order of magnitude off from what I'd expect.

-- 
Paul W. Frields                                http://paul.frields.org/
  gpg fingerprint: 3DA6 A0AC 6D58 FEC4 0233  5906 ACDB C937 BD11 3717
  http://redhat.com/   -  -  -  -   http://pfrields.fedorapeople.org/
    The open source story continues to grow: http://opensource.com