make yum.conf do a user ftp login for baseurl

[Harry Putnam]

How can I get yum to do a user type ftp login for the baseurl?

It will need username and password at some point.

[Tom Diehl]

On Sat, 4 Sep 2004, Harry Putnam wrote:

>  How can I get yum to do a user type ftp login for the baseurl?
>  
>  It will need username and password at some point. 
How about something like this: ftp://username:[e-mail]/$releasever

Tom

[Harry Putnam]

Tom Diehl <tdiehl(a)rogueind.com&gt; writes:

>  On Sat, 4 Sep 2004, Harry Putnam wrote:
>
> > How can I get yum to do a user type ftp login for the baseurl? 
> > It will need username and password at some point. 
Tom wrote:
>  How about something like this:
> ftp://username:[e-mail]/$releasever 
That might work if the ftp server was a real IP on the internet but
addresses like ftp://... don't seem to work inside my non resolvalbe
lan.

ftp will find reader.local.net0 but not ftp://reader.local.net0

I wonder if there is a way to work a HERE document or something into
the syntax?

[david walcroft]

Harry Putnam wrote:

> >>How can I get yum to do a user type ftp login for the baseurl?
>
> >>It will need username and password at some point.
>  
>  
>  Tom wrote:
>  
> >How about something like this:
> ftp://username:[e-mail]/$releasever
>  
>  
>  That might work if the ftp server was a real IP on the internet but
>  addresses like ftp://... don't seem to work inside my non resolvalbe
>  lan.
>  
>  ftp will find reader.local.net0 but not ftp://reader.local.net0
>  
>  I wonder if there is a way to work a HERE document or something into
>  the syntax?
>  
>   
This is what I use in yum.conf and works every time.

[updates-ftp]
name=Fedora 2 planetmirror ftp Updates
baseurl=ftp://user:[e-mail]/pub/fedora/linux/updates/2/i386

   david

[Harry Putnam]

david walcroft <david_walcroft(a)yahoo.com.au&gt; writes:

>  [updates-ftp]
>  name=Fedora 2 planetmirror ftp Updates
>  baseurl=ftp://user:[e-mail]/pub/fedora/linux/updates/2/i386
You probably hadn't seen my post yet detailing why that sort of
address scheme doesn't work inside my [unresolvable via dns] lan.

ftp apparently uses dns to find the host when address is of the
`ftp://' type.  So for me.
  ftp my.local.host
works but
  ftp://ftp.my.local.host
does not.

Apparently the former searches no further than my /etc/hosts file
and the later uses a dns lookup on line.

So I'll need some kind of scheme to get the uid and passwd passed into
the baseurl.
 
any guesses?

[david walcroft]

Harry Putnam wrote:
>  david walcroft <david_walcroft(a)yahoo.com.au&gt; writes:
>  
>  
> >[updates-ftp]
> >name=Fedora 2 planetmirror ftp Updates
> >baseurl=ftp://user:[e-mail]/pub/fedora/linux/updates/2/i386
>  
>  
>  You probably hadn't seen my post yet detailing why that sort of
>  address scheme doesn't work inside my [unresolvable via dns] lan.
>  
>  ftp apparently uses dns to find the host when address is of the
>  `ftp://' type.  So for me.
>    ftp my.local.host
>  works but
>    ftp://ftp.my.local.host
>  does not.
>  
>  Apparently the former searches no further than my /etc/hosts file
>  and the later uses a dns lookup on line.
>  
>  So I'll need some kind of scheme to get the uid and passwd passed into
>  the baseurl.
>   
>  any guesses? 
>  
>   
oops :-] should have kept my mouth shut.

   david

[Jef Spaleta]

On Sat, 04 Sep 2004 15:05:45 -0500, Harry Putnam <reader(a)newsguy.com&gt; wrote:
>  That might work if the ftp server was a real IP on the internet but
>  addresses like ftp://... don't seem to work inside my non resolvalbe
>  lan.
>  
>  ftp will find reader.local.net0 but not ftp://reader.local.net0
>  
>  I wonder if there is a way to work a HERE document or something into
>  the syntax? 
Sounds like a limitation on urlgrabber that yum uses.  This probably
needs to be filed as a bug so that it can be fixed so lookups from the
hosts file behave correctly.

-jef

[Harry Putnam]

Jeff Spaleta <jspaleta(a)gmail.com&gt; writes:

> > ftp will find reader.local.net0 but not ftp://reader.local.net0
> > 
> > I wonder if there is a way to work a HERE document or something into
> > the syntax?
>
>  Sounds like a limitation on urlgrabber that yum uses.  This probably
>  needs to be filed as a bug so that it can be fixed so lookups from the
>  hosts file behave correctly. 
Not sure I follow your reasoning here unless you are saying that yum
should be able to handle ftp, ssh, smb etc connections that are not
resolvable by dns.

It is really ftp that is not working in the scheme I laid out.

However it would be nice if there was provision in yum to pass a
uid/passwd when connecting by ftp or ssh.  Is that what you mean or
would that be a request for enhancement or something?

Anyway I found my solution by finally realizing I could use the http
protocol and do it thru apache instead of ftp.... (A little slow here...)

[seth vidal]

On Sat, 2004-09-04 at 20:41 -0400, Jeff Spaleta wrote:
>  On Sat, 04 Sep 2004 15:05:45 -0500, Harry Putnam
> <reader(a)newsguy.com&gt; wrote:
>  > That might work if the ftp server was a real IP on the internet but
>  > addresses like ftp://... don't seem to work inside my non resolvalbe
>  > lan.
>  > 
>  > ftp will find reader.local.net0 but not ftp://reader.local.net0
>  > 
>  > I wonder if there is a way to work a HERE document or something into
>  > the syntax?
>  
>  Sounds like a limitation on urlgrabber that yum uses.  This probably
>  needs to be filed as a bug so that it can be fixed so lookups from the
>  hosts file behave correctly. 
umm urlgrabber definitely supports ftp urls.

more info on this would be appreciated in bugzilla.

-sv

[Harry Putnam]

seth vidal <skvidal(a)phy.duke.edu&gt; writes:

>  umm urlgrabber definitely supports ftp urls.
>
>  more info on this would be appreciated in bugzilla. 
Did you see my respone to Jeff?

Im not sure there is a url scheme for this usage.

My setup is an internal ftp server with no (Internet) IP.  That is, it
has a local made up IP in the private range. 
   192.168.xxx.xxx = reader.local.net0.

ftp has no provision for handing that url a uid and password in the
url that I'm aware of.  Shemes beginning ftp:// do not work in that
case.  Isn't that a short comming of ftp protocol or are you saying
yum should fix that?

If I were to run my own nameserver. I guess the problem would
disappear.  In any event I can cure my trouble by using the http
protocol instead.  http://reader.local.net0/fed3raw 
That url scheme works inside the lan long as I have the httpd server
running on reader.local.net.  No nameserver required.

Someone give me more clue if this is bug material please.

[Tom Diehl]

On Sat, 4 Sep 2004, Harry Putnam wrote:

>  Tom Diehl <tdiehl(a)rogueind.com&gt; writes:
>  
>  > On Sat, 4 Sep 2004, Harry Putnam wrote:
>  >
>  >> How can I get yum to do a user type ftp login for the baseurl? 
>  >> It will need username and password at some point.
>  
>  Tom wrote:
>  > How about something like this:
> ftp://username:[e-mail]/$releasever
>  
>  That might work if the ftp server was a real IP on the internet but
>  addresses like ftp://... don't seem to work inside my non resolvalbe
>  lan. 
Even if you do not have a nameserver running, if you have entries in /etc/hosts this 
should work. Something else sounds weird here.

>  ftp will find reader.local.net0 but not ftp://reader.local.net0
>  
>  I wonder if there is a way to work a HERE document or something into
>  the syntax? 
Not that I know of but one thing I do here is setup autofs to allow things
like "cd /machinename/yumrepo" to work. That way you avoid the use of ftp on
the internal network. No passwds etc. nfs and autofs are trivial to setup these
days. Just mount them read only. Yum works very well in this configuration.

HTH,

Tom

[Harry Putnam]

Tom Diehl <tdiehl(a)rogueind.com&gt; writes:

> > Tom wrote:
> > > How about something like this:
> ftp://username:[e-mail]/$releasever
> > 
> > That might work if the ftp server was a real IP on the internet but
> > addresses like ftp://... don't seem to work inside my non resolvalbe
> > lan.
>
>  Even if you do not have a nameserver running, if you have entries in /etc/hosts this 
>  should work. Something else sounds weird here. 
I've never seen that to be true here.

my /etc/hosts on remote client has:
--
192.168.0.4     reader.local.net0    reader   # fedcore3 t1
--

ftp reader.local.net0 
works as expected for anonymous login and 

However:

ftp ftp://reader.local.net0  gives me:

  [root@expfc cf]# ftp ftp://reader.local.net0
ftp: ftp://reader.local.net0: Name or service not known
ftp>

while:
 ftp reader.local.net0
Connected to reader.local.net0 (192.168.0.4).
220 (vsFTPd 2.0.1)
Name (reader.local.net0:reader):

Connects as expected.

I see something I hadn't noticed here today.  ncftp can do what I
wanted ... so its apparently a shortcoming of the standard ftp client.
 (password obscured for posting)
  ncftp ftp://reader:[e-mail]0:~/no_bak/fedraw

does connect as expected.

But `ftp://reader:[e-mail]0:~/no_bak/fedraw
used as baseurl in yum.conf fails:


   yum list updates
  Yum Version: 2.1.3
  COMMAND: yum list updates 
  Installroot: /
  Reading Local RPMDB
  Setting up Repo:  development
  Baseurl(s) for repo: ['ftp://reader:[e-mail]0:~/no_bak/fedraw']
  repodata/repomd.xml: [Errno 4] IOError: <urlopen error (-2, 'Name or service not
known')>
  Cannot open/read repomd.xml file for repository: development
  failure: repodata/repomd.xml from development: [Errno 256] No more mirrors to try.

[Harry Putnam]

Harry Putnam <reader(a)newsguy.com&gt; writes:

>  I see something I hadn't noticed here today.  ncftp can do what
> I
>  wanted ... so its apparently a shortcoming of the standard ftp client.
>   (password obscured for posting)
>    ncftp ftp://reader:[e-mail]0:~/no_bak/fedraw
>
>  does connect as expected.
>
>  But `ftp://reader:[e-mail]0:~/no_bak/fedraw
>  used as baseurl in yum.conf fails: 
Can one set what gets used as ftp client somehow?

[Jeffrey C. Ollie]

On Sun, 2004-09-05 at 12:48 -0500, Harry Putnam wrote:
>  ftp ftp://reader.local.net0  gives me:
>  
>    [root@expfc cf]# ftp ftp://reader.local.net0
>  ftp: ftp://reader.local.net0: Name or service not known
>  [...]
>  so its apparently a shortcoming of the standard ftp client. 
Yes, the standard "ftp" client does not support URLs.

>  But `ftp://reader:[e-mail]0:~/no_bak/fedraw
>  used as baseurl in yum.conf fails: 
This is not a valid URL.  As you can see from the following example:

> >> import urlparse
> >>
> urlparse.urlparse('ftp://reader:[e-mail]0:~/no_bak/fedraw') 
 
      ('ftp', 'reader:[e-mail]0:~',
'/no_bak/fedraw', '', '', '')
        
Python is interpreting the '~' as part of the hostname, not as part of the path. 
Try using something like:

ftp://reader:[e-mail]0/home/no_bak/fedraw

Note that you should use the full path and not the '~' expansion.

Jeff Ollie

[Harry Putnam]

"Jeffrey C. Ollie" <jeff(a)ollie.clive.ia.us&gt; writes:

> > But `ftp://reader:[e-mail]0:~/no_bak/fedraw
> > used as baseurl in yum.conf fails:
>
>  This is not a valid URL.  As you can see from the following example:
>
>          >>> import urlparse
>          >>>
> urlparse.urlparse('ftp://reader:[e-mail]0:~/no_bak/fedraw')
>          ('ftp', 'reader:[e-mail]0:~',
> '/no_bak/fedraw', '', '', '')
>          
>  Python is interpreting the '~' as part of the hostname, not as part of the path. 
> Try using something like:
>
>  ftp://reader:[e-mail]0/home/no_bak/fedraw
>
>  Note that you should use the full path and not the '~' expansion. 
Ahh I see I've overlooked some stuff.  

Trying your formula a connection is made so I see now that the url
scheme is supported by yum.  However I still get a failed to change
dir ftp error.

In this scheme:
 ftp://reader:[e-mail]0/home/reader/no_bak/fedraw
  (password obfuscated for mailing)
`fedraw' is actually a symlink to /mnt/pack/fedraw (Which is also 
chowned reader:reader)

But I see from yum output that the address worked or at least the
address was seen correctly:

   yum list updates
  Yum Version: 2.1.3
  COMMAND: yum list updates 
  Installroot: /
  Reading Local RPMDB
  Setting up Repo:  development
  Baseurl(s) for repo:
['ftp://reader:[e-mail]0/home/reader/no_bak/fedraw']
  repodata/repomd.xml: [Errno 4] IOError: [Errno ftp error] 550 Failed to change
directory.
  Cannot open/read repomd.xml file for repository: development
  [...]

So I thought maybe it was because of the symlink
But..
This scheme:
   ftp://reader:[e-mail]0/mnt/pack/fedraw

Gets the same ftp error.

  yum list updates
  Yum Version: 2.1.3
  COMMAND: yum list updates 
  Installroot: /
  Reading Local RPMDB
  Setting up Repo:  development
  Baseurl(s) for repo: ['ftp://reader:[e-mail]0/mnt/pack/fedraw']
  repodata/repomd.xml: [Errno 4] IOError: [Errno ftp error] 550 Failed to change
directory.
  Cannot open/read repomd.xml file for repository: development
  failure: repodata/repomd.xml from development: [Errno 256] No more mirrors to tr

I'm a little gun shy now calling this a yum problem.  Do you see
further bumbling on my part?

[Mike Chambers]

On Sun, 2004-09-05 at 15:53 -0500, Harry Putnam wrote:

>  But I see from yum output that the address worked or at least the
>  address was seen correctly:
>  
>     yum list updates
>    Yum Version: 2.1.3
>    COMMAND: yum list updates 
>    Installroot: /
>    Reading Local RPMDB
>    Setting up Repo:  development
>    Baseurl(s) for repo:
> ['ftp://reader:[e-mail]0/home/reader/no_bak/fedraw']
>    repodata/repomd.xml: [Errno 4] IOError: [Errno ftp error] 550 Failed to change
> directory.
>    Cannot open/read repomd.xml file for repository: development
>    [...]
>  
>  So I thought maybe it was because of the symlink
>  But..
>  This scheme:
>     ftp://reader:[e-mail]0/mnt/pack/fedraw
>  
>  Gets the same ftp error.
>  
>    yum list updates
>    Yum Version: 2.1.3
>    COMMAND: yum list updates 
>    Installroot: /
>    Reading Local RPMDB
>    Setting up Repo:  development
>    Baseurl(s) for repo: ['ftp://reader:[e-mail]0/mnt/pack/fedraw']
>    repodata/repomd.xml: [Errno 4] IOError: [Errno ftp error] 550 Failed to change
> directory.
>    Cannot open/read repomd.xml file for repository: development
>    failure: repodata/repomd.xml from development: [Errno 256] No more mirrors to tr
>  
>  I'm a little gun shy now calling this a yum problem.  Do you see
>  further bumbling on my part? 
Actually, I got the same errors trying to connect to Dag's and
FreshRPM's sites, and they are http URL's.  I think this is maybe the
newer 2.1 yum packages and those sites not compat with them yet or
something?

-- 
Mike Chambers
Madisonville, KY

"It's only funny until someone gets hurt...Then it's hilarious!"

[Ricardo Veguilla]

On Sun, 2004-09-05 at 16:33 -0500, Mike Chambers wrote: 
>  > Gets the same ftp error.
>  > 
>  >   yum list updates
>  >   Yum Version: 2.1.3
>  >   COMMAND: yum list updates 
>  >   Installroot: /
>  >   Reading Local RPMDB
>  >   Setting up Repo:  development
>  >   Baseurl(s) for repo:
> ['ftp://reader:[e-mail]0/mnt/pack/fedraw']
>  >   repodata/repomd.xml: [Errno 4] IOError: [Errno ftp error] 550 Failed to change
> directory.
>  >   Cannot open/read repomd.xml file for repository: development
>  >   failure: repodata/repomd.xml from development: [Errno 256] No more mirrors to tr
>  > 
>  > I'm a little gun shy now calling this a yum problem.  Do you see
>  > further bumbling on my part?
>  
>  Actually, I got the same errors trying to connect to Dag's and
>  FreshRPM's sites, and they are http URL's.  I think this is maybe the
>  newer 2.1 yum packages and those sites not compat with them yet or
>  something? 
Both Dag's and FreshRPM's support the new yum repository format. I've
been using them successfully for a few days now. 

That error seems to say that yum can't find the new repo metadata, so
either its a problem with the URL, or the repository doesnt support the
new repository format...right?!?

-- 
Ricardo Veguilla <veguilla(a)hpcf.upr.edu&gt;

[Harry Putnam]

Ricardo Veguilla <veguilla(a)hpcf.upr.edu&gt; writes:

> > Actually, I got the same errors trying to connect to Dag's
> and
> > FreshRPM's sites, and they are http URL's.  I think this is maybe the
> > newer 2.1 yum packages and those sites not compat with them yet or
> > something? 
You had and ftp `can't change directory' error?

>  Both Dag's and FreshRPM's support the new yum repository
> format. I've
>  been using them successfully for a few days now.  
>  That error seems to say that yum can't find the new repo
> metadata, so
>  either its a problem with the URL, or the repository doesnt support the
>  new repository format...right?!? 
Well it says that but isn't it because of not being able to change
directory to the repo directory?

I think its not getting to the repo. 

Please not the error is:

[Errno 4] IOError: [Errno ftp error] 550 Failed to change directory.

Is this even yums error output? Or from ftp protocol?

[Mike Chambers]

On Sun, 2004-09-05 at 17:59 -0400, Ricardo Veguilla wrote:

>  Both Dag's and FreshRPM's support the new yum repository
> format. I've
>  been using them successfully for a few days now. 
What uRL are you using for those two?

-- 
Mike Chambers
Madisonville, KY

"It's only funny until someone gets hurt...Then it's hilarious!"

[Tom Diehl]

On Sun, 5 Sep 2004, Harry Putnam wrote:

>  "Jeffrey C. Ollie" <jeff(a)ollie.clive.ia.us&gt; writes:
>  
>  >> But `ftp://reader:[e-mail]0:~/no_bak/fedraw
>  >> used as baseurl in yum.conf fails:
>  >
>  > This is not a valid URL.  As you can see from the following example:
>  >
>  >         >>> import urlparse
>  >         >>>
> urlparse.urlparse('ftp://reader:[e-mail]0:~/no_bak/fedraw')
>  >         ('ftp', 'reader:[e-mail]0:~',
> '/no_bak/fedraw', '', '', '')
>  >         
>  > Python is interpreting the '~' as part of the hostname, not as part of the
> path.  Try using something like:
>  >
>  > ftp://reader:[e-mail]0/home/no_bak/fedraw
>  >
>  > Note that you should use the full path and not the '~' expansion.
>  
>  Ahh I see I've overlooked some stuff.  
>  
>  Trying your formula a connection is made so I see now that the url
>  scheme is supported by yum.  However I still get a failed to change
>  dir ftp error.
>  
>  In this scheme:
>   ftp://reader:[e-mail]0/home/reader/no_bak/fedraw
>    (password obfuscated for mailing)
>  `fedraw' is actually a symlink to /mnt/pack/fedraw (Which is also 
>  chowned reader:reader)
>  
>  But I see from yum output that the address worked or at least the
>  address was seen correctly:
>  
>     yum list updates
>    Yum Version: 2.1.3
>    COMMAND: yum list updates 
>    Installroot: /
>    Reading Local RPMDB
>    Setting up Repo:  development
>    Baseurl(s) for repo:
> ['ftp://reader:[e-mail]0/home/reader/no_bak/fedraw']
>    repodata/repomd.xml: [Errno 4] IOError: [Errno ftp error] 550 Failed to change
> directory.
>    Cannot open/read repomd.xml file for repository: development
>    [...]
>  
>  So I thought maybe it was because of the symlink
>  But..
>  This scheme:
>     ftp://reader:[e-mail]0/mnt/pack/fedraw
>  
>  Gets the same ftp error.
>  
>    yum list updates
>    Yum Version: 2.1.3
>    COMMAND: yum list updates 
>    Installroot: /
>    Reading Local RPMDB
>    Setting up Repo:  development
>    Baseurl(s) for repo: ['ftp://reader:[e-mail]0/mnt/pack/fedraw']
>    repodata/repomd.xml: [Errno 4] IOError: [Errno ftp error] 550 Failed to change
> directory.
>    Cannot open/read repomd.xml file for repository: development
>    failure: repodata/repomd.xml from development: [Errno 256] No more mirrors to tr
>  
>  I'm a little gun shy now calling this a yum problem.  Do you see
>  further bumbling on my part? 
I will bet it is not a yum problem. The easiest way I have found to
troubleshoot this type of problem is to use a web browser to connect to your
repo. If that does not work neither will yum. OTOH if the web browser can
browse the repodata directory then yum should work. It would appear you have
some kind of permission problem.

Tom

[Harry Putnam]

Tom Diehl <tdiehl(a)rogueind.com&gt; writes:

> > I'm a little gun shy now calling this a yum problem.  Do you
> see
> > further bumbling on my part?
>
>  I will bet it is not a yum problem. The easiest way I have found to
>  troubleshoot this type of problem is to use a web browser to connect to your
>  repo. If that does not work neither will yum. OTOH if the web browser can
>  browse the repodata directory then yum should work. It would appear you have
>  some kind of permission problem. 
I'm inclined to agree and using your test with http:
  (http://reader:[e-mail]0/home/reader/no_bak/fedraw)

I get a message saying `you are trying to access reader.local.net0
with uid reader, that does not require authentication.  Is this the
site you want?

Answering yes gets a 404

If I put a symlink to fedraw in /var/www/html then:
 http://reader.local.net0/fedraw

Works fine and hits my repo.

So it appears this problem occurs only with authenticating type urls.
And maybe even only when using ftp.

The fact that: http://reader.local.net0/fedraw as a base url works,
and yum does updates and installs etc from it should answer the other
question you posted running special command to create repos.

It is mirror of already created repo on carroll.cac

[Tom Diehl]

On Sun, 5 Sep 2004, Harry Putnam wrote:

>  Tom Diehl <tdiehl(a)rogueind.com&gt; writes:
>  
>  >> I'm a little gun shy now calling this a yum problem.  Do you see
>  >> further bumbling on my part?
>  >
>  > I will bet it is not a yum problem. The easiest way I have found to
>  > troubleshoot this type of problem is to use a web browser to connect to your
>  > repo. If that does not work neither will yum. OTOH if the web browser can
>  > browse the repodata directory then yum should work. It would appear you have
>  > some kind of permission problem.
>  
>  I'm inclined to agree and using your test with http:
>    (http://reader:[e-mail]0/home/reader/no_bak/fedraw)
>  
>  I get a message saying `you are trying to access reader.local.net0
>  with uid reader, that does not require authentication.  Is this the
>  site you want?
>  
>  Answering yes gets a 404
>  
>  If I put a symlink to fedraw in /var/www/html then:
>   http://reader.local.net0/fedraw
>  
>  Works fine and hits my repo.
>  
>  So it appears this problem occurs only with authenticating type urls.
>  And maybe even only when using ftp. 
Hummm, just a guess but try using ftp:// path. You get a 404 with http
because it is not in the document root of the web server. The symlink fixes
that. The web browser knows what to do with ftp:// type url's. BTW: yum will
follow symlinks just fine also. I have numerous local repos symlinked
together.

>  
>  The fact that: http://reader.local.net0/fedraw as a base url works,
>  and yum does updates and installs etc from it should answer the other
>  question you posted running special command to create repos.
>  
>  It is mirror of already created repo on carroll.cac 
OK. Sounds logical.

Tom

[Harry Putnam]

Tom Diehl <tdiehl(a)rogueind.com&gt; writes:

> > If I put a symlink to fedraw in /var/www/html then:
> >  http://reader.local.net0/fedraw
> > 
> > Works fine and hits my repo.
> > 
> > So it appears this problem occurs only with authenticating type urls.
> > And maybe even only when using ftp.
>
>  Hummm, just a guess but try using ftp:// path. You get a 404 with http
>  because it is not in the document root of the web server. The symlink fixes
>  that. The web browser knows what to do with ftp:// type url's. BTW: yum will
>  follow symlinks just fine also. I have numerous local repos symlinked
>  together. 
Yup using ftp:// and the authenticating url blazes right thru using
mozilla.  I guess that means it is a bug in yum... yes?

I have this same issue posed on the yum list, so maybe someone there
will know about what the urlgrabber thingy in yum is supposed to do
with a url like that.  I think your test is sort of indicative though.

Just an aside here.  I new earlier today I had gotten to those
directories with mozilla and an authenticating url, but when I went
back to try it again I forgot it had been by using an ftp url as
you suggest, so for a while here I was starting to get that `I know
I'm not crazy' syndrome when I couldn't get it to work again.

[Tom Diehl]

On Sun, 5 Sep 2004, Harry Putnam wrote:

>  Tom Diehl <tdiehl(a)rogueind.com&gt; writes:
>  
>  >> If I put a symlink to fedraw in /var/www/html then:
>  >>  http://reader.local.net0/fedraw
>  >> 
>  >> Works fine and hits my repo.
>  >> 
>  >> So it appears this problem occurs only with authenticating type urls.
>  >> And maybe even only when using ftp.
>  >
>  > Hummm, just a guess but try using ftp:// path. You get a 404 with http
>  > because it is not in the document root of the web server. The symlink fixes
>  > that. The web browser knows what to do with ftp:// type url's. BTW: yum will
>  > follow symlinks just fine also. I have numerous local repos symlinked
>  > together.
>  
>  Yup using ftp:// and the authenticating url blazes right thru using
>  mozilla.  I guess that means it is a bug in yum... yes? 
Anytime I have cut and pasted the url out of the yum.conf file and mozilla
could find the repo yum could too. So it sure sounds like like a yum bug to
me, but I am not a python programmer. :-)

>  I have this same issue posed on the yum list, so maybe someone there
>  will know about what the urlgrabber thingy in yum is supposed to do
>  with a url like that.  I think your test is sort of indicative though. 
Yes, I saw the post. Seth and or one of the other yum developers will
most likely comment on this when they get a chance. I have not tried the
new version of yum yet. I am kind of waiting for the dust to settle.

>  Just an aside here.  I new earlier today I had gotten to those
>  directories with mozilla and an authenticating url, but when I went
>  back to try it again I forgot it had been by using an ftp url as
>  you suggest, so for a while here I was starting to get that `I know
>  I'm not crazy' syndrome when I couldn't get it to work again. 
:-))

Tom

[Tom Diehl]

On Sun, 5 Sep 2004, Harry Putnam wrote:

>  "Jeffrey C. Ollie" <jeff(a)ollie.clive.ia.us&gt; writes:
>  
>  >> But `ftp://reader:[e-mail]0:~/no_bak/fedraw
>  >> used as baseurl in yum.conf fails:
>  >
>  > This is not a valid URL.  As you can see from the following example:
>  >
>  >         >>> import urlparse
>  >         >>>
> urlparse.urlparse('ftp://reader:[e-mail]0:~/no_bak/fedraw')
>  >         ('ftp', 'reader:[e-mail]0:~',
> '/no_bak/fedraw', '', '', '')
>  >         
>  > Python is interpreting the '~' as part of the hostname, not as part of the
> path.  Try using something like:
>  >
>  > ftp://reader:[e-mail]0/home/no_bak/fedraw
>  >
>  > Note that you should use the full path and not the '~' expansion.
>  
>  Ahh I see I've overlooked some stuff.  
>  
>  Trying your formula a connection is made so I see now that the url
>  scheme is supported by yum.  However I still get a failed to change
>  dir ftp error.
>  
>  In this scheme:
>   ftp://reader:[e-mail]0/home/reader/no_bak/fedraw
>    (password obfuscated for mailing)
>  `fedraw' is actually a symlink to /mnt/pack/fedraw (Which is also 
>  chowned reader:reader)
>  
>  But I see from yum output that the address worked or at least the
>  address was seen correctly:
>  
>     yum list updates
>    Yum Version: 2.1.3
>    COMMAND: yum list updates 
>    Installroot: /
>    Reading Local RPMDB
>    Setting up Repo:  development
>    Baseurl(s) for repo:
> ['ftp://reader:[e-mail]0/home/reader/no_bak/fedraw']
>    repodata/repomd.xml: [Errno 4] IOError: [Errno ftp error] 550 Failed to change
> directory.
>    Cannot open/read repomd.xml file for repository: development
>    [...]
>  
>  So I thought maybe it was because of the symlink
>  But..
>  This scheme:
>     ftp://reader:[e-mail]0/mnt/pack/fedraw
>  
>  Gets the same ftp error.
>  
>    yum list updates
>    Yum Version: 2.1.3
>    COMMAND: yum list updates 
>    Installroot: /
>    Reading Local RPMDB
>    Setting up Repo:  development
>    Baseurl(s) for repo: ['ftp://reader:[e-mail]0/mnt/pack/fedraw']
>    repodata/repomd.xml: [Errno 4] IOError: [Errno ftp error] 550 Failed to change
> directory.
>    Cannot open/read repomd.xml file for repository: development
>    failure: repodata/repomd.xml from development: [Errno 256] No more mirrors to tr
>  
>  I'm a little gun shy now calling this a yum problem.  Do you see
>  further bumbling on my part? 
To add another comment to this thread, it looks like you are using the devel version
of yum. Did you run the createrepo thing??

Tom

[Tom Diehl]

On Sun, 5 Sep 2004, Harry Putnam wrote:

>  Tom Diehl <tdiehl(a)rogueind.com&gt; writes:
>  
>  >> Tom wrote:
>  >> > How about something like this:
> ftp://username:[e-mail]/$releasever
>  >> 
>  >> That might work if the ftp server was a real IP on the internet but
>  >> addresses like ftp://... don't seem to work inside my non resolvalbe
>  >> lan.
>  >
>  > Even if you do not have a nameserver running, if you have entries in /etc/hosts this
>
>  > should work. Something else sounds weird here.
>  
>  I've never seen that to be true here.
>  
>  my /etc/hosts on remote client has:
>  --
>  192.168.0.4     reader.local.net0    reader   # fedcore3 t1
>  --
>  
>  ftp reader.local.net0 
>  works as expected for anonymous login and 
>  
>  However:
>  
>  ftp ftp://reader.local.net0  gives me: 
Ok, but Yum uses the urlgrabber to resolve the ftp://stuff not a particular ftp
client. It works on my local network and externally. Granted I have a working
name server on my internal network. Maybe you should ask on the yum list if
the urlgrabber is expected to work with /etc/hosts? If it is not working as
expected then I would recommend doing as Seth suggested and file a bug here:
http://devel.linux.duke.edu/bugzilla/

HTH,

Tom