"Baseurl" download source for now?

[Dmitry Butskoy]

I've discovered data inconsistencies in a (nearest) mirror of Fedora.

For me, 
"https://mirrors.fedoraproject.org/metalink?repo=updates-released-f$releasever&arch=$basearch"

return a mirror at "mirror.yandex.ru".

Assuming it is some temporary issues, I prefer to switch (for a while) 
to the "baseurl" in the repo config file, ie. to 
http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/$b... 
.
But any attempt to address this link returns me the same mirror at 
yandex.ru.

IOW, it seems that "baseurl" is the same behavior as "mirrorlist".

How can I download something from the "primary", "baseurl" Fedora
repos 
(not from mirrors)?


Regards,
Dmitry Butskoy
http://www.fedoraproject.org/wiki/DmitryButskoy

[Seth Vidal]

On Wed, 2011-09-07 at 17:53 +0400, Dmitry Butskoy wrote:
>  I've discovered data inconsistencies in a (nearest) mirror of
> Fedora.
>  
>  For me, 
>
> "https://mirrors.fedoraproject.org/metalink?repo=updates-released-f$releasever&arch=$basearch"
>
>  return a mirror at "mirror.yandex.ru".
>  
>  Assuming it is some temporary issues, I prefer to switch (for a while) 
>  to the "baseurl" in the repo config file, ie. to 
>  http://download.fedoraproject.org/pub/fedora/linux/updates/$releasever/$b... 
>  .
>  But any attempt to address this link returns me the same mirror at 
>  yandex.ru.
>  
>  IOW, it seems that "baseurl" is the same behavior as "mirrorlist".
>  
>  How can I download something from the "primary", "baseurl" Fedora
> repos 
>  (not from mirrors)?
>   
download.fedoraproject.org hits a redirector which sends you to the
nearest mirror from mirrormanager.

-sv

[Dmitry Butskoy]

seth vidal wrote:
>  download.fedoraproject.org hits a redirector which sends you to the
>  nearest mirror from mirrormanager.
>      
Well, but what should I do if that mirror seems broken? Try to obtain 
the full mirror list and try each mirror step by step? Why we no more 
provide just a true "baseurl"?


Regards,
Dmitry

[Seth Vidal]

On Wed, 2011-09-07 at 18:04 +0400, Dmitry Butskoy wrote:
>  seth vidal wrote:
>  > download.fedoraproject.org hits a redirector which sends you to the
>  > nearest mirror from mirrormanager.
>  >    
>  
>  Well, but what should I do if that mirror seems broken?  

Broken how? If the mirror is not functional yum should switch to the
next mirror in your mirrorlist from mirrormanager.

>  Try to obtain 
>  the full mirror list and try each mirror step by step? Why we no more 
>  provide just a true "baseurl"? 
Go to the url from the mirrorlist= line in a webbrowser and it will give
you all the baseurls you could possibly desire.

-sv

[Jos Vos]

On Wed, Sep 07, 2011 at 10:22:48AM -0400, seth vidal wrote:

>  Broken how? If the mirror is not functional yum should switch to the
>  next mirror in your mirrorlist from mirrormanager. 
Well, I have had broken (kickstart) installs more than once, because
packages couldn't be found etc.  I had to solve this by specifying a
well-known mirror as base url.

If a mirror is accessible, but has a broken repository, you're lost.

-- 
--    Jos Vos <jos(a)xos.nl&gt;
--    X/OS Experts in Open Systems BV   |   Phone: [phone]
--    Amsterdam, The Netherlands        |     Fax: [phone]

[Adam Williamson]

On Wed, 2011-09-07 at 16:28 +0200, Jos Vos wrote:
>  On Wed, Sep 07, 2011 at 10:22:48AM -0400, seth vidal wrote:
>  
>  > Broken how? If the mirror is not functional yum should switch to the
>  > next mirror in your mirrorlist from mirrormanager.
>  
>  Well, I have had broken (kickstart) installs more than once, because
>  packages couldn't be found etc.  I had to solve this by specifying a
>  well-known mirror as base url.
>  
>  If a mirror is accessible, but has a broken repository, you're lost. 
Sounds like anaconda could do with cribbing yum's code for falling back
to alternate mirrors when it can't find a file on the first mirror it
tries.
-- 
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Twitter: AdamW_Fedora | identi.ca: adamwfedora
http://www.happyassassin.net

[Josh Boyer]

On Wed, Sep 7, 2011 at 3:31 PM, Adam Williamson <awilliam(a)redhat.com&gt; wrote:
>  On Wed, 2011-09-07 at 16:28 +0200, Jos Vos wrote:
> > On Wed, Sep 07, 2011 at 10:22:48AM -0400, seth vidal wrote:
> >
> > > Broken how? If the mirror is not functional yum should switch to the
> > > next mirror in your mirrorlist from mirrormanager.
> >
> > Well, I have had broken (kickstart) installs more than once, because
> > packages couldn't be found etc.  I had to solve this by specifying a
> > well-known mirror as base url.
> >
> > If a mirror is accessible, but has a broken repository, you're lost.
>
>  Sounds like anaconda could do with cribbing yum's code for falling back
>  to alternate mirrors when it can't find a file on the first mirror it
>  tries. 
I'm pretty sure anaconda already uses yum for this.  IIRC, giving a
repo to anaconda via kickstart is like specifying baseurl to yum,
which also doesn't fall back.  You need mirrorlist for that
functionality.

josh

[Jesse Keating]

On Sep 7, 2011, at 1:37 PM, Josh Boyer wrote:
>  On Wed, Sep 7, 2011 at 3:31 PM, Adam Williamson
> <awilliam(a)redhat.com&gt; wrote:
> > On Wed, 2011-09-07 at 16:28 +0200, Jos Vos wrote:
> >> On Wed, Sep 07, 2011 at 10:22:48AM -0400, seth vidal wrote:
> >> 
> >>> Broken how? If the mirror is not functional yum should switch to the
> >>> next mirror in your mirrorlist from mirrormanager.
> >> 
> >> Well, I have had broken (kickstart) installs more than once, because
> >> packages couldn't be found etc.  I had to solve this by specifying a
> >> well-known mirror as base url.
> >> 
> >> If a mirror is accessible, but has a broken repository, you're lost.
> > 
> > Sounds like anaconda could do with cribbing yum's code for falling back
> > to alternate mirrors when it can't find a file on the first mirror it
> > tries.
>  
>  I'm pretty sure anaconda already uses yum for this.  IIRC, giving a
>  repo to anaconda via kickstart is like specifying baseurl to yum,
>  which also doesn't fall back.  You need mirrorlist for that
>  functionality.
>  
>  josh 

See https://fedoraproject.org/wiki/Anaconda/Kickstart#repo for specific instructions on
how to supply a mirror list in kickstart.

- jlk

[Jos Vos]

On Wed, Sep 07, 2011 at 01:55:53PM -0700, Jesse Keating wrote:

>  See https://fedoraproject.org/wiki/Anaconda/Kickstart#repo for
> specific instructions on how to supply a mirror list in kickstart. 
But isn't it so that yum/anaconda stay with the same mirror once one
is selected?

My problem was that --mirrorlist didn't work because the selected
mirror probably had an inconsistent repo (I tried 2 or 3 installs
that all failed) and I had to specify a well-known mirror with
--baseurl to solve this problem.

-- 
--    Jos Vos <jos(a)xos.nl&gt;
--    X/OS Experts in Open Systems BV   |   Phone: [phone]
--    Amsterdam, The Netherlands        |     Fax: [phone]

[Adam Williamson]

On Wed, 2011-09-07 at 23:22 +0200, Jos Vos wrote:
>  On Wed, Sep 07, 2011 at 01:55:53PM -0700, Jesse Keating wrote:
>  
>  > See https://fedoraproject.org/wiki/Anaconda/Kickstart#repo for specific instructions
> on how to supply a mirror list in kickstart.
>  
>  But isn't it so that yum/anaconda stay with the same mirror once one
>  is selected? 
No. If an update includes package foo-1.0-1.fc16, and the initially
selected repo doesn't have that package, yum cycles through other repos
on the list until it finds one which does have the package. It only
fails if it can't find any repo with the package.
-- 
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Twitter: AdamW_Fedora | identi.ca: adamwfedora
http://www.happyassassin.net

[Dmitry Butskoy]

seth vidal wrote:
>  On Wed, 2011-09-07 at 18:04 +0400, Dmitry Butskoy wrote:
>     
> > Well, but what should I do if that mirror seems broken?
> >      
>
>  Broken how? 
Some SRPMS in fedora/linux/updates/14/SRPMS are missed.

>  Go to the url from the mirrorlist= line in a webbrowser and it will
> give
>  you all the baseurls you could possibly desire.
>      
Thanks. I just have recollected download.fedora.redhat.com ;)

BTW is there a way to filter some particular url from the mirrorlist?


Regards,
Dmitry

[Dmitry Butskoy]

Dmitry Butskoy wrote:
>  seth vidal wrote:
>     
> > On Wed, 2011-09-07 at 18:04 +0400, Dmitry Butskoy wrote:
> >
> >      
> >> Well, but what should I do if that mirror seems broken?
> >>
> >>        
> > Broken how?
> >      
>  Some SRPMS in fedora/linux/updates/14/SRPMS are missed.
>      
Now the files have appeared, but the repomd.xml files are still differ.

Compare:
http://download.fedora.redhat.com/pub/fedora/linux/updates/14/SRPMS/repod...
and
http://mirror.yandex.ru/fedora/linux/updates/14/SRPMS/repodata/repomd.xml

It seems something is not reliable in the mirroring process...


Regards,
Dmitry Butskoy

[Seth Vidal]

On Wed, 2011-09-07 at 19:16 +0400, Dmitry Butskoy wrote:
>  Dmitry Butskoy wrote:
>  > seth vidal wrote:
>  >    
>  >> On Wed, 2011-09-07 at 18:04 +0400, Dmitry Butskoy wrote:
>  >>
>  >>      
>  >>> Well, but what should I do if that mirror seems broken?
>  >>>
>  >>>        
>  >> Broken how?
>  >>      
>  > Some SRPMS in fedora/linux/updates/14/SRPMS are missed.
>  >    
>  
>  Now the files have appeared, but the repomd.xml files are still differ.
>  
>  Compare:
>  http://download.fedora.redhat.com/pub/fedora/linux/updates/14/SRPMS/repod...
>  and
>  http://mirror.yandex.ru/fedora/linux/updates/14/SRPMS/repodata/repomd.xml
>  
>  It seems something is not reliable in the mirroring process...
>   
it is a mirror - it happens gradually.

-sv

[Josh Boyer]

On Wed, Sep 7, 2011 at 11:18 AM, seth vidal <skvidal(a)fedoraproject.org&gt; wrote:
>  On Wed, 2011-09-07 at 19:16 +0400, Dmitry Butskoy wrote:
> > Dmitry Butskoy wrote:
> > > seth vidal wrote:
> > >
> > >> On Wed, 2011-09-07 at 18:04 +0400, Dmitry Butskoy wrote:
> > >>
> > >>
> > >>> Well, but what should I do if that mirror seems broken?
> > >>>
> > >>>
> > >> Broken how?
> > >>
> > > Some SRPMS in fedora/linux/updates/14/SRPMS are missed.
> > >
> >
> > Now the files have appeared, but the repomd.xml files are still differ.
> >
> > Compare:
> >
> http://download.fedora.redhat.com/pub/fedora/linux/updates/14/SRPMS/repod...
> > and
> > http://mirror.yandex.ru/fedora/linux/updates/14/SRPMS/repodata/repomd.xml
> >
> > It seems something is not reliable in the mirroring process...
> >
>
>  it is a mirror - it happens gradually. 
It might be worth pointing out that mirrors.kernel.org has been down
for a couple of days, so any of the other mirrors that sync from that
will be stale.

josh

[Seth Vidal]

On Wed, 2011-09-07 at 11:30 -0400, Josh Boyer wrote:
>  On Wed, Sep 7, 2011 at 11:18 AM, seth vidal
> <skvidal(a)fedoraproject.org&gt; wrote:
>  > On Wed, 2011-09-07 at 19:16 +0400, Dmitry Butskoy wrote:
>  >> Dmitry Butskoy wrote:
>  >> > seth vidal wrote:
>  >> >
>  >> >> On Wed, 2011-09-07 at 18:04 +0400, Dmitry Butskoy wrote:
>  >> >>
>  >> >>
>  >> >>> Well, but what should I do if that mirror seems broken?
>  >> >>>
>  >> >>>
>  >> >> Broken how?
>  >> >>
>  >> > Some SRPMS in fedora/linux/updates/14/SRPMS are missed.
>  >> >
>  >>
>  >> Now the files have appeared, but the repomd.xml files are still differ.
>  >>
>  >> Compare:
>  >>
> http://download.fedora.redhat.com/pub/fedora/linux/updates/14/SRPMS/repod...
>  >> and
>  >> http://mirror.yandex.ru/fedora/linux/updates/14/SRPMS/repodata/repomd.xml
>  >>
>  >> It seems something is not reliable in the mirroring process...
>  >>
>  >
>  > it is a mirror - it happens gradually.
>  
>  It might be worth pointing out that mirrors.kernel.org has been down
>  for a couple of days, so any of the other mirrors that sync from that
>  will be stale. 
A good point.
-sv