Problems mirroring http://repos.fedorapeople.org/repos/openstack/*

[Jan van Eldik]

Happy New Year to all!

We are using mrepo to mirror from 
http://repos.fedorapeople.org/repos/openstack. However, mrepo chokes on 
these links:

 
http://repos.fedorapeople.org/repos/openstack/openstack-grizzly/fedora-17...
 
http://repos.fedorapeople.org/repos/openstack/openstack-folsom/fedora-17/...

They seem to point to empty subdirectories.

I am not sure why mrepo chokes on them, but I am not sure if these empty 
directories are useful either. Other repo's (like 
openstack-grizzly/epel-6/) do not seem to have such a SRPMS subdir.

             thanks, cheers, Jan

[Matthias Runge]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 01/08/2013 11:32 AM, Jan van Eldik wrote:
>  Happy New Year to all!
>  
>  We are using mrepo to mirror from 
>  http://repos.fedorapeople.org/repos/openstack. However, mrepo
>  chokes on these links:
>  
>  
>  http://repos.fedorapeople.org/repos/openstack/openstack-grizzly/fedora-17...
>
>
>  
>  
>  http://repos.fedorapeople.org/repos/openstack/openstack-folsom/fedora-17/...
>
>
>  
>  
>  They seem to point to empty subdirectories. 
If you need to mirror those, what about wget? afterwards one should
run createrepo

- -- 
Matthias Runge <mrunge(a)matthias-runge.de&gt;
               <mrunge(a)fedoraproject.org&gt;
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.13 (GNU/Linux)
> Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
>
> iQEcBAEBAgAGBQJQ6/ZtAAoJEOnz8qQwcaIW2sAH/jCg8QVouQLwDg34RvCd0ZNQ
> q70X9jFb4mHaj4Q0sX0UNI1Zka5fpO73sLCPNzoWTMb1wXVoYoWXAyRQxva/Hq8p
> uV7r2vLIY/3cBahVPeJz3ATLb4CoTW3FfGhwehqFSJRreinyZYXsIt7TyDT7ZNLz
> HxAz2w9Mgye7LIXCuBIBpWv0yB85p7hazenWdXy1N4SFcRgS2ujgcLfw0Qq1/JFL
> ReGnsTWmVcHZ1jWWq784rmjKix8cGfsFLTxp//oPlPoAI+cruYEaaQx++zgul1Qg
> Xm5G8p9lrjbPtOnI7Krw90Mt/Ll9ema4VusVqMj5PFtycSOz9vF0m4DUa2peB7k=
> =ROZv
> -----END PGP SIGNATURE-----

On 08.01.2013 10:35, Matthias Runge wrote:
>  -----BEGIN PGP SIGNED MESSAGE-----
>  Hash: SHA1
>
>  On 01/08/2013 11:32 AM, Jan van Eldik wrote:
> > Happy New Year to all!
> >
> > We are using mrepo to mirror from
> > http://repos.fedorapeople.org/repos/openstack. However, mrepo
> > chokes on these links:
> >
> >
> > 
> > http://repos.fedorapeople.org/repos/openstack/openstack-grizzly/fedora-17...
> >
> >
> >
> >
> > 
> > http://repos.fedorapeople.org/repos/openstack/openstack-folsom/fedora-17/...
> >
> >
> >
> >
> > They seem to point to empty subdirectories.
>
>  If you need to mirror those, what about wget? afterwards one should
>  run createrepo 
Check out also lftp, it can do ftp/http "mirroring".

-- 
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

[Pádraig Brady]

On 01/08/2013 10:32 AM, Jan van Eldik wrote:
>  Happy New Year to all!
>
>  We are using mrepo to mirror from http://repos.fedorapeople.org/repos/openstack. However,
> mrepo chokes on these links:
>
>
>  http://repos.fedorapeople.org/repos/openstack/openstack-grizzly/fedora-17...
>
>  http://repos.fedorapeople.org/repos/openstack/openstack-folsom/fedora-17/...
>
>  They seem to point to empty subdirectories.
>
>  I am not sure why mrepo chokes on them, but I am not sure if these empty directories are
> useful either. Other repo's (like openstack-grizzly/epel-6/) do not seem to have such
> a SRPMS subdir.
>
>               thanks, cheers, Jan 
The directories aren't empty.
They have a .htaccess with a redirect (to the parent dir) for compatability.
This was done when I consolidated the Fedora and EPEL repos
to have the same structure with non separated RPMs and SRPMs.

I can see how redirects like could be an issue for mirroring tools.
Should I just remove the SRPMS dir and not worry about compat?
Alternatively if you have a fedorapeople.org a/c you could:

rsync -az --progress -e ssh fedorapeople.org:/srv/repos/openstack/ /your/path

thanks,
Pádraig.

[Thomas Oulevey]

Please note noarch seems to have the same redirect.

-- 
Thomas

On 8 janv. 2013, at 12:23, "Pádraig Brady" <P(a)draigBrady.com&gt; wrote:

>  On 01/08/2013 10:32 AM, Jan van Eldik wrote:
> > Happy New Year to all!
> > 
> > We are using mrepo to mirror from http://repos.fedorapeople.org/repos/openstack.
> However, mrepo chokes on these links:
> > 
> > 
> > http://repos.fedorapeople.org/repos/openstack/openstack-grizzly/fedora-17...
> > 
> > http://repos.fedorapeople.org/repos/openstack/openstack-folsom/fedora-17/...
> > 
> > They seem to point to empty subdirectories.
> > 
> > I am not sure why mrepo chokes on them, but I am not sure if these empty directories
> are useful either. Other repo's (like openstack-grizzly/epel-6/) do not seem to have
> such a SRPMS subdir.
> > 
> >             thanks, cheers, Jan
>  
>  The directories aren't empty.
>  They have a .htaccess with a redirect (to the parent dir) for compatability.
>  This was done when I consolidated the Fedora and EPEL repos
>  to have the same structure with non separated RPMs and SRPMs.
>  
>  I can see how redirects like could be an issue for mirroring tools.
>  Should I just remove the SRPMS dir and not worry about compat?
>  Alternatively if you have a fedorapeople.org a/c you could:
>  
>  rsync -az --progress -e ssh fedorapeople.org:/srv/repos/openstack/ /your/path
>  
>  thanks,
>  Pádraig.

[Jan van Eldik]

Hi Pádraig,

>  The directories aren't empty.
>  They have a .htaccess with a redirect (to the parent dir) for
>  compatability.
>  This was done when I consolidated the Fedora and EPEL repos
>  to have the same structure with non separated RPMs and SRPMs. 
Thanks for the explanation.

>  I can see how redirects like could be an issue for mirroring tools.
>  Should I just remove the SRPMS dir and not worry about compat? 
We would appreciate that! Also, Thomas noticed that the "noarch"
subdirs have the same issue.

            thanks, Jan

[Pádraig Brady]

On 01/08/2013 01:22 PM, Jan van Eldik wrote:
>  Hi Pádraig,
>
> > The directories aren't empty.
> > They have a .htaccess with a redirect (to the parent dir) for
> > compatability.
> > This was done when I consolidated the Fedora and EPEL repos
> > to have the same structure with non separated RPMs and SRPMs.
>
>  Thanks for the explanation.
>
> > I can see how redirects like could be an issue for mirroring tools.
> > Should I just remove the SRPMS dir and not worry about compat?
>
>  We would appreciate that! Also, Thomas noticed that the "noarch"
>  subdirs have the same issue. 
Done.

thanks,
Pádraig