Private Mirror/Repository

[Jonathan Allen]

Hi there !

A client has a number of machines on their internal LAN, all running FC4.
To keep them all up2date takes quite a lot time and bandwidth because
even at 512M broadband speeds the stuff has to be downloaded for all
the machines on the network.  Could I set them up with their firewall
machine holding a mirror of the Fedora Core and Extras repositories and
have all the network machines point to the firewall for repositories ?

Any pointers to doing this and gotchas to beware of would be welcome ...

Jonathan

[Joel Jaeggli]

You could have one host mirror the yum repositories for the version of the 
os you run, then point all the hosts at the url for the base directory 
for the updates, and they would pull from there.

a lot of the mirrors (mine included) support rsync access for precisely 
this reason.

regards
joelja

On Wed, 18 Jan 2006, Jonathan Allen wrote:
> Hi there !
>
> A client has a number of machines on their internal LAN, all running FC4.
> To keep them all up2date takes quite a lot time and bandwidth because
> even at 512M broadband speeds the stuff has to be downloaded for all
> the machines on the network.  Could I set them up with their firewall
> machine holding a mirror of the Fedora Core and Extras repositories and
> have all the network machines point to the firewall for repositories ?
>
> Any pointers to doing this and gotchas to beware of would be welcome ...
>
> Jonathan

[Chris Adams]

Once upon a time, Jonathan Allen  said:
> A client has a number of machines on their internal LAN, all running FC4.
> To keep them all up2date takes quite a lot time and bandwidth because
> even at 512M broadband speeds the stuff has to be downloaded for all
> the machines on the network.  Could I set them up with their firewall
> machine holding a mirror of the Fedora Core and Extras repositories and
> have all the network machines point to the firewall for repositories ?

Yes.  There are a couple of ways to mirror the files:

- some mirrors offer rsync access - this is the easiest

- or you can use a program like "mirror" to fetch everything via FTP

Then you change the /etc/yum.repos.d/* files to point to your internal
server: comment out the "mirrorlist" line and uncomment the "baseurl"
line and change it to point to your server instead of the Fedora master
servers.

You'll need a web server running on the inside interface of your
firewall; thttpd from Extras is a lightweight server that works just
fine for serving this (easier to configure than Apache too).

[Paul Howarth]

Jonathan Allen wrote:
> Hi there !
>
> A client has a number of machines on their internal LAN, all running FC4.
> To keep them all up2date takes quite a lot time and bandwidth because
> even at 512M broadband speeds the stuff has to be downloaded for all
> the machines on the network.  Could I set them up with their firewall
> machine holding a mirror of the Fedora Core and Extras repositories and
> have all the network machines point to the firewall for repositories ?
>
> Any pointers to doing this and gotchas to beware of would be welcome ...

Try:
http://www.tqmcube.com/repo.htm

For FC3 or later, you'd be editing .repo files from /etc/yum.repos.d 
rather than /etc/yum.conf but the basic procedure is as described there.

Paul.

[Don Maxwell]

On 1/18/06, Paul Howarth  wrote:
> Jonathan Allen wrote:
> > Hi there !
> >
> > A client has a number of machines on their internal LAN, all running
>
> FC4.
> > To keep them all up2date takes quite a lot time and bandwidth because
> > even at 512M broadband speeds the stuff has to be downloaded for all
> > the machines on the network.  Could I set them up with their firewall
> > machine holding a mirror of the Fedora Core and Extras repositories and
> > have all the network machines point to the firewall for repositories ?
> >
> > Any pointers to doing this and gotchas to beware of would be welcome ...
>
> Try:
> http://www.tqmcube.com/repo.htm
>
> For FC3 or later, you'd be editing .repo files from /etc/yum.repos.d
> rather than /etc/yum.conf but the basic procedure is as described there.

The firewall may not be the best place to mirror yum repositories.  Perhaps
one server could be setup as a local repository.  I did to solve firewall
incompatiablity issues.  Mine is currently using about 16GB.

The folks at fedoranews.org did a fine job documenting how to setup a local
respository:
http://fedoranews.org/contributors/hal_canary/yum/

[Chasecreek Systemhouse]

On 1/18/06, Don Maxwell  wrote:
> ...  Mine is currently using about 16GB.

My local PPC FC5 mirror is using about 8GB just for the rpms --
but I download and keep everything during testing...

--
WC -Sx- Jones | http://ccsh.us/ | Open Source Consulting

[Jonathan Allen]

Paul Howarth wrote:
> > A client has a number of machines on their internal LAN, all running FC4.
> > To keep them all up2date takes quite a lot time and bandwidth because
> > even at 512M broadband speeds the stuff has to be downloaded for all
> > the machines on the network.  Could I set them up with their firewall
> > machine holding a mirror of the Fedora Core and Extras repositories and
> > have all the network machines point to the firewall for repositories ?
> >
> > Any pointers to doing this and gotchas to beware of would be welcome ...
>
> Try:
> http://www.tqmcube.com/repo.htm

Thanks - I'm under way with a test system !

Jonathan

[William Stearns]

Good afternoon, Jonathan, all,

On Wed, 18 Jan 2006, Jonathan Allen wrote:
> A client has a number of machines on their internal LAN, all running FC4.
> To keep them all up2date takes quite a lot time and bandwidth because
> even at 512M broadband speeds the stuff has to be downloaded for all
> the machines on the network.  Could I set them up with their firewall
> machine holding a mirror of the Fedora Core and Extras repositories and
> have all the network machines point to the firewall for repositories ?
>
> Any pointers to doing this and gotchas to beware of would be welcome ...

I've put together a script to handle mirroring repositories 
locally.  http://www.stearns.org/yum-pull/ has the script and a howto 
document on how to set it all up.
    Best of luck!
    Cheers,
    - Bill

---------------------------------------------------------------------------
    "Software is largely a service industry operating under the
persistent but unfounded delusion that it is a manufacturing industry."
    -- Eric Raymond
--------------------------------------------------------------------------
William Stearns ([e-mail]).  Mason, Buildkernel, freedups, p0f,
rsync-backup, ssh-keyinstall, dns-check, more at:   http://www.stearns.org
--------------------------------------------------------------------------

[David Cary Hart]

On Wed, 18 Jan 2006 15:59:26 +0000
Jonathan Allen  opined:
> Hi there !
>
> A client has a number of machines on their internal LAN, all running FC4.
> To keep them all up2date takes quite a lot time and bandwidth because
> even at 512M broadband speeds the stuff has to be downloaded for all
> the machines on the network.  Could I set them up with their firewall
> machine holding a mirror of the Fedora Core and Extras repositories and
> have all the network machines point to the firewall for repositories ?
>
> Any pointers to doing this and gotchas to beware of would be welcome ...
>
> Jonathan

http://tqmcube.com/repo.htm

[Charles Curley]

On Wed, Jan 18, 2006 at 04:16:10PM +0000, Paul Howarth wrote:
> Jonathan Allen wrote:
> > Hi there !
> >
> > A client has a number of machines on their internal LAN, all running FC4.
> > To keep them all up2date takes quite a lot time and bandwidth because
> > even at 512M broadband speeds the stuff has to be downloaded for all
> > the machines on the network.  Could I set them up with their firewall
> > machine holding a mirror of the Fedora Core and Extras repositories and
> > have all the network machines point to the firewall for repositories ?
> >
> > Any pointers to doing this and gotchas to beware of would be welcome ...
>
> Try:
> http://www.tqmcube.com/repo.htm

Nice, but for base, this howto requires extracting the files from the
ISOs. My techinique is a bit more involved (you set up a CD server)
but that cuts your disk usage for base in half (unless you discard the
ISOs, which I recommend against. http://www.charlescurley.com/yum.html
> For FC3 or later, you'd be editing .repo files from /etc/yum.repos.d 
> rather than /etc/yum.conf but the basic procedure is as described
> there.

And on mine. Hmmm, time to update mine. :-)

[Alan]

On Wed, 18 Jan 2006, Charles Curley wrote:
> On Wed, Jan 18, 2006 at 04:16:10PM +0000, Paul Howarth wrote:
> > Jonathan Allen wrote:
> > > Hi there !
> > >
> > > A client has a number of machines on their internal LAN, all running FC4.
> > > To keep them all up2date takes quite a lot time and bandwidth because
> > > even at 512M broadband speeds the stuff has to be downloaded for all
> > > the machines on the network.  Could I set them up with their firewall
> > > machine holding a mirror of the Fedora Core and Extras repositories and
> > > have all the network machines point to the firewall for repositories ?
> > >
> > > Any pointers to doing this and gotchas to beware of would be welcome ...
> >
> > Try:
> > http://www.tqmcube.com/repo.htm
>
> Nice, but for base, this howto requires extracting the files from the
> ISOs. My techinique is a bit more involved (you set up a CD server)
> but that cuts your disk usage for base in half (unless you discard the
> ISOs, which I recommend against. http://www.charlescurley.com/yum.html
> > For FC3 or later, you'd be editing .repo files from /etc/yum.repos.d 
> > rather than /etc/yum.conf but the basic procedure is as described
> > there.
>
> And on mine. Hmmm, time to update mine. :-)

One of the methods I used for Mac OS X updates was to use squid as a proxy 
with a big monster cache.  Every time it went to look for the files, if it 
already existed it would pull the copy from the proxy, not from the net.  
First one to look for the file pulled it down for everyone else to use.

Or you can just use rsync and have an internal yum server.

[John Pierce]

Hello!

I have 5 machine on the local net, one is a file server.  I have an
nfs export of one of my partitions.  I have all of my downloads stored
on this partition and my config files use that as the repository
holder.

/dev/hdb1 is an xfs file system mounted on /prtdata

/prtdata is exported by nfs and all other machines mount it on /prtdata.

/prtdata has the following directories

/prtdata/fc4yum
/prtdata/yum.repos.d

/prtdata has the following file

/prtdata/yum.conf

Below is the contents of /prtdata/yum.conf

[main]
cachedir=/prtdata/fc4yum
reposdir=/prtdata/yum.repos.d
debuglevel=2
logfile=/var/log/yum.log
pkgpolicy=newest
distroverpkg=redhat-release
tolerant=1
exactarch=1
retries=20
obsoletes=1
gpgcheck=1

# PUT YOUR REPOS HERE OR IN separate files named file.repo
# in /etc/yum.repos.d

Pay special attention to the cachedir and reposdir as they are
pointing to /prtdata.

Below is a simple one line bash script that I have in all of my
/usr/bin directories on every machine.

#!/bin/bash
#
#
# A simple script to use yum with a non-standard configuration.
#
sudo yum -c /prtdata/yum.conf update $1

Note: I have prefaced the command with a sudo, I do not normally
become root to do anything.  I simply use sudo.  Also, the $1 would be
expanded if present, just incase I only want to update a specific
package.

Good luck!

John Pierce
--
Registered Linux User 263680, get counted at
http://counter.li.org

[Tim]

On Wed, 2006-01-18 at 15:12 -0800, alan wrote:
> One of the methods I used for Mac OS X updates was to use squid as a
> proxy with a big monster cache.  Every time it went to look for the
> files, if it already existed it would pull the copy from the proxy,
> not from the net.  First one to look for the file pulled it down for
> everyone else to use.

Works for Windows too, but not Fedora because YUM uses a different
mirror each time, by default (well recently it change to using the same
mirror for YUM updates that you do close together, timewise).  To simply
proxy YUM updates, you need to reconfigure YUM to always use the same
address.

[Guido Leisker]

> Hi there !
>
> A client has a number of machines on their internal LAN, all running FC4.
> To keep them all up2date takes quite a lot time and bandwidth because
> even at 512M broadband speeds the stuff has to be downloaded for all
> the machines on the network.  Could I set them up with their firewall
> machine holding a mirror of the Fedora Core and Extras repositories and
> have all the network machines point to the firewall for repositories ?
>
> Any pointers to doing this and gotchas to beware of would be welcome ...

Isn't that a typical use for proxies? The proxyserver will cache the 
packages and after the first download all packages will be downloaded 
from the caching proxy with high speed and without using our internet 
bandwidth.

[Peter Arremann]

On Thursday 19 January 2006 02:55, Guido Leisker wrote:
> > Hi there !
> >
> > A client has a number of machines on their internal LAN, all running FC4.
> > To keep them all up2date takes quite a lot time and bandwidth because
> > even at 512M broadband speeds the stuff has to be downloaded for all
> > the machines on the network.  Could I set them up with their firewall
> > machine holding a mirror of the Fedora Core and Extras repositories and
> > have all the network machines point to the firewall for repositories ?
> >
> > Any pointers to doing this and gotchas to beware of would be welcome ...

We're running such a setup. Basically we mirror the fedora site and then 
create our own yum repository from there. All clients have their own yum 
configurations to point to our repository rather than the official mirror 
list.
You can find some good info at 
http://servers.linux.com/article.pl?sid=04/07/22/1718242&tid=42
But any google search for "running your own yum repository" will yield quite a 
few results.
> Isn't that a typical use for proxies? The proxyserver will cache the
> packages and after the first download all packages will be downloaded
> from the caching proxy with high speed and without using our internet
> bandwidth.

Not quite. Most proxies refuse to cache larger packages (that can be tweaked) 
and they don't give you control over what is cached - you can't set up a 
proxy to automatically download things at 2am so that everything is ready for 
your daily updates when you get into the office in the morning.

Peter.

[Paul Howarth]

Peter Arremann wrote:
> On Thursday 19 January 2006 02:55, Guido Leisker wrote:
> > > Hi there !
> > >
> > > A client has a number of machines on their internal LAN, all running FC4.
> > > To keep them all up2date takes quite a lot time and bandwidth because
> > > even at 512M broadband speeds the stuff has to be downloaded for all
> > > the machines on the network.  Could I set them up with their firewall
> > > machine holding a mirror of the Fedora Core and Extras repositories and
> > > have all the network machines point to the firewall for repositories ?
> > >
> > > Any pointers to doing this and gotchas to beware of would be welcome ...
>
> We're running such a setup. Basically we mirror the fedora site and then 
> create our own yum repository from there. All clients have their own yum 
> configurations to point to our repository rather than the official mirror 
> list.
> You can find some good info at 
> http://servers.linux.com/article.pl?sid=04/07/22/1718242&tid=42

I came across that article yesterday when I was looking for references 
to use in my earlier reply. It's a good article, but having been written 
  for FC2 is a little out of date now ("createrepo" should be used 
instead of "yum-arch", and the configuration file updates should be made 
to .repo files in /etc/yum.repos.d rather than /etc/yum.conf).

Paul.

[John Pierce]

I don't know how we got on the subject of proxy servers, in my
previous post I said nothing about proxies, the configuration I use is
only a cache of packages previously downloaded on the first update.

Look at my previous post, based on that configuration when I run yumu
on ns1.local.net any packages that need to be updated will be
downloaded and installed, for example kernel-2.6.14-1.1656_FC4.  When
I move to the next machine ns2.local.net and run yumu and it sets
kernel-2.6.14-1.1656_FC4 to be updated it will state downloading
files, yum then realizes that the file already exists in the cache and
the signatures match so it will not be downloaded just pulled from the
cache.

My setup is not trying to mirror a server, I am just pulling in
packages that I need to have for updates.  I know that it works, I do
it several times a week and packages are only downloaded once and the
other 4 machine all use the cached packages.

John
--
Registered Linux User 263680, get counted at
http://counter.li.org

[Tim]

On Thu, 2006-01-19 at 09:05 -0600, John Pierce wrote:
> I don't know how we got on the subject of proxy servers, in my
> previous post I said nothing about proxies, the configuration I use is
> only a cache of packages previously downloaded on the first update.
>
> Look at my previous post, based on that configuration when I run yumu
> on ns1.local.net any packages that need to be updated will be
> downloaded and installed, for example kernel-2.6.14-1.1656_FC4.  When
> I move to the next machine ns2.local.net and run yumu and it sets
> kernel-2.6.14-1.1656_FC4 to be updated it will state downloading
> files, yum then realizes that the file already exists in the cache and
> the signatures match so it will not be downloaded just pulled from the
> cache.

Well, that is the sort of thing that caching proxies can do.  So using
one is a simple enough way to do the same trick.

[James Pifer]

> I've put together a script to handle mirroring repositories 
> locally.  http://www.stearns.org/yum-pull/ has the script and a howto 
> document on how to set it all up.
>    Best of luck!
>    Cheers,
> Bill

Bill,

I'm trying to use your yum-pull script and think I have it mostly set
up. Trying to do FC4 right now. I will also add CentOS and Suse at some
point.

Questions for you though. On my FC4 system I have the following
directories from using yum:
atrpms  
base 
extras  
freshrpms  
livna 
release  
updates  
updates-released

These all work as parameters of yum-pull except base, release, and
updates-released. Should I be concerned about this? Is this expected?
base and updates-released both have RPMs in the packages directory.

Also, I want to add CentOS 4.2, does specifying ce_4.0_i386 cover it, or
does the script need to be updated for 4.2?

Also, do you know where to get netatalk for CentOS 4? That's what I'm
running this on.

Thanks,
James

[David Cary Hart]

On Sat, 11 Feb 2006 13:55:56 -0500
James Pifer  opined:
> > I've put together a script to handle mirroring repositories 
> > locally.  http://www.stearns.org/yum-pull/ has the script and a howto 
> > document on how to set it all up.
> >    Best of luck!
> >    Cheers,
> > Bill
>
> Bill,
>
> I'm trying to use your yum-pull script and think I have it mostly set
> up. Trying to do FC4 right now. I will also add CentOS and Suse at some
> point.

I still think you are better off with the rsync approach. Correct me
if I am wrong but I believe that rsync provides much better
throughput than yum plus compression. Have you looked at
http://tqmcube.com/repo.php ?

BTW, extras is now using repoview (which I recommend). You can get a
look at it here: http://fedoraproject.org/extras/4/i386/repodata/

[James Pifer]

> I still think you are better off with the rsync approach. Correct me
> if I am wrong but I believe that rsync provides much better
> throughput than yum plus compression. Have you looked at
> http://tqmcube.com/repo.php ?
>
> BTW, extras is now using repoview (which I recommend). You can get a
> look at it here: http://fedoraproject.org/extras/4/i386/repodata/

I started to do the rsync approach first, and it did seem faster than
the rate yum-pull is going, but it seemed like yum-pull was easier to
setup and get going with all the stuff that I wanted. Any chance you
have some more examples than are on that page? Maybe I'm making it
harder than it needs to be. I'm not a yum expert so figuring out where
to get everything, and understanding the directory structure is a little
confusing.

I would like to do FC4 with updates and extras plus atrpms, livna,
freshrpms, maybe dag. I'd also like to do CentOS 4.2 and Suse 9.2/9.3.

Any help is appreciated.
James

[David Cary Hart]

On Sat, 11 Feb 2006 15:22:39 -0500
James Pifer  opined:
> > I still think you are better off with the rsync approach. Correct me
> > if I am wrong but I believe that rsync provides much better
> > throughput than yum plus compression. Have you looked at
> > http://tqmcube.com/repo.php ?
> >
> > BTW, extras is now using repoview (which I recommend). You can get a
> > look at it here: http://fedoraproject.org/extras/4/i386/repodata/
>
> I started to do the rsync approach first, and it did seem faster than
> the rate yum-pull is going, but it seemed like yum-pull was easier to
> setup and get going with all the stuff that I wanted. Any chance you
> have some more examples than are on that page? Maybe I'm making it
> harder than it needs to be. I'm not a yum expert so figuring out where
> to get everything, and understanding the directory structure is a little
> confusing.
>
> I would like to do FC4 with updates and extras plus atrpms, livna,
> freshrpms, maybe dag. I'd also like to do CentOS 4.2 and Suse 9.2/9.3.

If you get Fedora updates working, everything else will work.

1. Create paths/directories:

/var/www/html/yum/Fedora/core/4/updates/i386
/var/www/cache

2. Download updates to that directory with ftp.

3. run "createrepo \
-c /var/www/cache /var/www/html/yum/Fedora/core/4/updates/

3. Add a ".repo" file or adjust yum.conf

[updates-released]
name=Fedora Core $releasever - $basearch - Released Updates
baseurl=http://localhost%7CLAN IP/yum/Fedora/core/$releasever/updates/$basearch/
enabled=1

4. Cron a daily rsync:

rsync -avrt rsync://mirrors.kernel.org/fedora/core/updates/4/i386 \
     --exclude=debug/ --exclude=repodata/ --exclude=*debuginfo* --exclude=*i18* \
     --exclude=*langpack*/var/www/html/yum/Fedora/core/4/updates

5. Followed by:

createrepo \
-c /var/www/cache /var/www/html/yum/Fedora/core/4/updates/

Once you are sure that is working, add repoview from extras to
provide the browser file and RSS.

[William Stearns]

Good afternoon, James,

On Sat, 11 Feb 2006, James Pifer wrote:
> > I've put together a script to handle mirroring repositories
> > locally.  http://www.stearns.org/yum-pull/ has the script and a howto
> > document on how to set it all up.
> >    Best of luck!
>
> I'm trying to use your yum-pull script and think I have it mostly set
> up. Trying to do FC4 right now. I will also add CentOS and Suse at some
> point.
>
> Questions for you though. On my FC4 system I have the following
> directories from using yum:
> atrpms
> base
> extras
> freshrpms
> livna
> release
> updates
> updates-released
>
> These all work as parameters of yum-pull except base, release, and
> updates-released. Should I be concerned about this? Is this expected?
> base and updates-released both have RPMs in the packages directory.

"base" is either where some of the package indexes are stored or 
another name for core.  "updates-released" is the same as "updates" in 
yum-pull.  "release", I think, may be another name for "core".
    Nothing to be concerned about.
> Also, I want to add CentOS 4.2, does specifying ce_4.0_i386 cover it, or
> does the script need to be updated for 4.2?

It needed to be updated for centos 4.2.  I've just put out a 
version 1.58 which has centos 4.2 as well, although not many repositories 
have direct support for it.
    I don't use all the distributions supported by the script, so I 
don't always know the compatibility tricks such as "Centos 3.4 is fully 
compatible with RHEL 3", allowing yum-pull to pull down any rhel3 
repositories for centos 3.4 as well.  If anyone knows of compatible 
distributions like those, I can do the work to make yum-pull smarter.
> Also, do you know where to get netatalk for CentOS 4? That's what I'm
> running this on.

Ah, Redhat Enterprise (and therefore whitebox and centos) doesn't 
seem to include it.  My best guess would be to try pulling down and 
installing a fedora core 4, 3 or 2 netatalk.
    If none of those install cleanly, you could recompile the SPRM on 
your system, or simply not install it at all.  The only thing you'll miss 
is the "timeout" program which kills off lftp after a few hours (so the 
script won't hang forever if an ftp server becomes unresponsive). 
yum-pull will recognize that timout isn't installed and just run lftp 
directly.
    Cheers,
    - Bill

---------------------------------------------------------------------------
         "Revolutions do not require corporate support."
(Courtesy of Matthew Wilcox )
--------------------------------------------------------------------------
William Stearns ([e-mail]).  Mason, Buildkernel, freedups, p0f,
rsync-backup, ssh-keyinstall, dns-check, more at:   http://www.stearns.org
--------------------------------------------------------------------------

[William Stearns]

Good evening, David,

On Sat, 11 Feb 2006, David Cary Hart wrote:
> On Sat, 11 Feb 2006 13:55:56 -0500
> James Pifer  opined:
> > > I've put together a script to handle mirroring repositories
> > > locally.  http://www.stearns.org/yum-pull/ has the script and a howto
> > > document on how to set it all up.
> > >    Best of luck!
> >
> > I'm trying to use your yum-pull script and think I have it mostly set
> > up. Trying to do FC4 right now. I will also add CentOS and Suse at some
> > point.
>
> I still think you are better off with the rsync approach. Correct me

I'm a big fan of rsync as well, and yum-pull has used it since it 
was first written.
    For each of the distributions and modules, yum-pull has a list of 
mirrors, some rsync, some ftp, and some http.  It randomly picks one and 
uses rsync for rsync urls and lftp for ftp and http urls.
> if I am wrong but I believe that rsync provides much better
> throughput than yum plus compression. Have you looked at

The files being downloaded are mostly rpms, which are already 
compressed.  Turning on rsync compression won't generally help and may 
occasionally slow down the transfer as the transferred file can get 
slightly larger.  That's why I don't turn on compression with either 
download tool.
    In download situations where the local system might have an older 
file that has some of the same content as the newer file, rsync can speed 
up the download by reusing old blocks.  With rpm repositories, the only 
likely case where that happens is where one had an incomplete download in 
the past.
> http://tqmcube.com/repo.php ?

I have - thanks for taking the time to write it.
    You and I are doing many of the same things!  The major difference 
is that you're providing step by step instructions for people to do this 
themselves, and I'm providing a script that tries to automate those steps 
as much as possible.  I'm glad we've both done the work - people can 
choose which is appropriate for them.
> BTW, extras is now using repoview (which I recommend). You can get a
> look at it here: http://fedoraproject.org/extras/4/i386/repodata/

yum-pull runs this automatically too - see
http://ford.stearns.org/fedora/linux/3/x86_64/updates/ .
    Cheers,
    - Bill

---------------------------------------------------------------------------
         "Nothing in the Constitution compels us to listen to or view any
unwanted communication, whatever its merit....The ancient concept that
`a man's home is his castle' into which `not even the king may enter'
has lost none of it vitality....We therefore categorically reject the
argument that a vendor has a right under the Constitution or otherwise
to send unwanted material into the home of another. If this prohibition
operates to impede the flow of even valid ideas, the answer is that no
one has a right to press even `good' ideas on an unwilling recipient.
That we are often `captives' outside the sanctuary of the home and
subject to objectionable speech and other sound does not mean we must be
captives everywhere....The asserted right of a mailer, we repeat, stops
at the outer boundary of every person's domain."
    -- Chief Justice Burger, U.S. Supreme Court
http://www.euro.cauce.org/en/freespeech.html#rowan
--------------------------------------------------------------------------
William Stearns ([e-mail]).  Mason, Buildkernel, freedups, p0f,
rsync-backup, ssh-keyinstall, dns-check, more at:   http://www.stearns.org
--------------------------------------------------------------------------

[James Pifer]

> "base" is either where some of the package indexes are stored or 
> another name for core.  "updates-released" is the same as "updates" in 
> yum-pull.  "release", I think, may be another name for "core".
>    Nothing to be concerned about.

So can I populate "core" with the RPMs off the FC4 DVD?

Thanks,
James

[William Stearns]

Good evening, James,

On Sat, 11 Feb 2006, James Pifer wrote:
> > "base" is either where some of the package indexes are stored or
> > another name for core.  "updates-released" is the same as "updates" in
> > yum-pull.  "release", I think, may be another name for "core".
> >    Nothing to be concerned about.
>
> So can I populate "core" with the RPMs off the FC4 DVD?

Exactly right!
    Cheers,
    - Bill

---------------------------------------------------------------------------
    If you've been pounding nails with your forehead for years, it may
feel strange the first time somebody hands you a hammer. But that
doesn't mean that you should strap the hammer to a headband just to give
your skull that old familiar jolt.
    -- Wayne Throop, during the ``TCL Wars''
(Courtesy of Steve Dodd )
--------------------------------------------------------------------------
William Stearns ([e-mail]).  Mason, Buildkernel, freedups, p0f,
rsync-backup, ssh-keyinstall, dns-check, more at:   http://www.stearns.org
--------------------------------------------------------------------------

[David Cary Hart]

On Sat, 11 Feb 2006 20:21:22 -0500
James Pifer  opined:
> > "base" is either where some of the package indexes are stored or 
> > another name for core.  "updates-released" is the same as "updates" in 
> > yum-pull.  "release", I think, may be another name for "core".
> >    Nothing to be concerned about.
>
> So can I populate "core" with the RPMs off the FC4 DVD?

Precisely. Then run createrepo.

[Thomas Widhalm]

> I don't use all the distributions supported by the script, so I
> don't always know the compatibility tricks such as "Centos 3.4 is fully
> compatible with RHEL 3", allowing yum-pull to pull down any rhel3
> repositories for centos 3.4 as well.  If anyone knows of compatible
> distributions like those, I can do the work to make yum-pull smarter.

Maybe you could consider http://taolinux.org/wiki/Main_Page when searching for 
compatible Distros.
We use it as a replacement for RHAS on low priority servers and workstations.

Regards,
Thomas

[James Pifer]

When you have your local mirror created how do you deal with gpg keys?
My stock fedora repo files point to a gpgkey on the file system. Should
you turn them off in yum.conf?

In http://tqmcube.com/repo.php it says to have gpgcheck=1 but does not
specify a gpgkey anywhere.

Thanks,
James

[Rahul Sundaram]

James Pifer wrote:
> When you have your local mirror created how do you deal with gpg keys?

By signing those packages with your gpg key and importing the key into 
RPM or turning off the gpg key check if you are sure that you can trust 
those packages in avoiding middle men attacks.

[David Cary Hart]

On Tue, 14 Feb 2006 14:03:07 -0500
James Pifer  opined:
> When you have your local mirror created how do you deal with gpg keys?
> My stock fedora repo files point to a gpgkey on the file system. Should
> you turn them off in yum.conf?
>
> In http://tqmcube.com/repo.php it says to have gpgcheck=1 but does not
> specify a gpgkey anywhere.

The GPG keys are repository agnostic. The keys are in the
rpm database.