rsync size

[Lonnie Cumberland]

Hello All,

Last night I started to RSYNC the entire fedora ftp site out at 
ftp://mirrors.kernel.org/fedora but realized that I am not sure how much 
space it might take.

Could someone please tell me how much space I will need in order to 
mirror the entire distro?

Thanks,
Lonnie

[Sam Varshavchik]

Lonnie Cumberland writes:

>  Hello All,
>  
>  Last night I started to RSYNC the entire fedora ftp site out at 
>  ftp://mirrors.kernel.org/fedora but realized that I am not sure how much 
>  space it might take.
>  
>  Could someone please tell me how much space I will need in order to 
>  mirror the entire distro? 
Not including the SRPMS and updates, you need about 2.5 gigs.

[Mike Ramirez]

On Mon, 2004-09-13 at 15:58, Lonnie Cumberland wrote:
>  Hello All,
>  
>  Last night I started to RSYNC the entire fedora ftp site out at 
>  ftp://mirrors.kernel.org/fedora but realized that I am not sure how much 
>  space it might take.
>  
>  Could someone please tell me how much space I will need in order to 
>  mirror the entire distro?
>  
>  Thanks,
>  Lonnie 
Hi Lonnie,

Total is 1.9GB for the core and 1022MB for the updates. Please see du
output below. 

If you plan on mirroring more than the core and updates.  May I suggest
yam by Dag Wieers?

<sales pitch>

It uses rsync by default to mirror the core, updates, freshrpms, dags,
dries and newrpms repositories.  No configuration need for fc2 needed. 
It create the headers for apt and yum, configure itself for apache. Also
Supports PXE/TFTP remote installs. Check it out at
http://dag.wieers.com/home-made/yam/

Total Disc Space is 5.5GB for all those repos including testing from
kde-redhat  (added for KDE 3.3) and some rpms I have downloaded from
atrpms.

</sales pitch>

du output for /var/yam/fc2-i386 where I store my FC2 rpms.

[root@gmike yam]# du -chs fc2-i386
5.5G    fc2-i386
5.5G    total
[root@gmike yam]# cd fc2-i386
[root@gmike fc2-i386]# du -chs core
1.9G    core
1.9G    total
[root@gmike fc2-i386]# du -chs updates
1022M   updates
1022M   total
[root@gmike fc2-i386]# ls
atrpms  core  dag  dries  freshrpms  kde  newrpms  updates
[root@gmike fc2-i386]#



-- 
Mike Ramirez <mike(a)thexxxhost.com&gt;

[Mike Ramirez]

On Mon, 2004-09-13 at 16:25, Mike Ramirez wrote:
>  On Mon, 2004-09-13 at 15:58, Lonnie Cumberland wrote: 
<snippage>


>  Total Disc Space is 5.5GB for all those repos including testing from
>  kde-redhat  (added for KDE 3.3) and some rpms I have downloaded from
>  atrpms.
>  
>  </sales pitch>
>  
>  du output for /var/yam/fc2-i386 where I store my FC2 rpms. 
<more snipp snipp>

Now I forgot to add that its just RPMS and headers and here is du output
for every folder in /var/yam/fc2-i386

[root@gmike fc2-i386]# du -chs *
111M    atrpms
1.9G    core
895M    dag
281M    dries
302M    freshrpms
316M    kde
689M    newrpms
1022M   updates
5.5G    total
[root@gmike fc2-i386]#
-- 
Mike Ramirez <mike(a)thexxxhost.com&gt;

[Lonnie Cumberland]

Strange.

Seemed like more than that (5.5G) if you included everything:


  Index of ftp://mirrors.kernel.org/fedora/core

------------------------------------------------------------------------
Index of ftp://mirrors.kernel.org/fedora/core

Up to higher level directory
Directory: 1         03/01/2004     12:00:00 AM
Directory: 2         05/14/2004     11:18:00 AM
Directory: development         09/13/2004     12:26:00 PM
Directory: test         07/09/2004     08:14:00 PM
Directory: updates         05/18/2004     01:56:00 PM

especially in the development directory which has many platforms.

I have been reading over the YAM docs but the light bulb has not come on 
yet to really show me how it is any better than simple rsync in a cron 
script.

Thanks,
Lonnie

 
Mike Ramirez wrote:

> On Mon, 2004-09-13 at 16:25, Mike Ramirez wrote:
>   
>
> >On Mon, 2004-09-13 at 15:58, Lonnie Cumberland wrote:
> >    
> >
>
> <snippage>
>
>
>   
>
> >Total Disc Space is 5.5GB for all those repos including testing from
> >kde-redhat  (added for KDE 3.3) and some rpms I have downloaded from
> >atrpms.
> >
> ></sales pitch>
> >
> >du output for /var/yam/fc2-i386 where I store my FC2 rpms.
> >    
> >
>
> <more snipp snipp>
>
> Now I forgot to add that its just RPMS and headers and here is du output
> for every folder in /var/yam/fc2-i386
>
> [root@gmike fc2-i386]# du -chs *
> 111M    atrpms
> 1.9G    core
> 895M    dag
> 281M    dries
> 302M    freshrpms
> 316M    kde
> 689M    newrpms
> 1022M   updates
> 5.5G    total
> [root@gmike fc2-i386]#
>   
>

[Mike Ramirez]

On Mon, 2004-09-13 at 17:06, Lonnie Cumberland wrote:
>  Strange.
>  
>  Seemed like more than that (5.5G) if you included everything:
>  
>  
>    Index of ftp://mirrors.kernel.org/fedora/core
>  
>  ------------------------------------------------------------------------
>  Index of ftp://mirrors.kernel.org/fedora/core
>  
>  Up to higher level directory
>  Directory: 1         03/01/2004     12:00:00 AM
>  Directory: 2         05/14/2004     11:18:00 AM
>  Directory: development         09/13/2004     12:26:00 PM
>  Directory: test         07/09/2004     08:14:00 PM
>  Directory: updates         05/18/2004     01:56:00 PM
>  
>  especially in the development directory which has many platforms.
>  
>  I have been reading over the YAM docs but the light bulb has not come on 
>  yet to really show me how it is any better than simple rsync in a cron 
>  script.
>  
>  Thanks,
>  Lonnie 
Its smaller becuase I didn't included anything more than I need.  I just
have the RPMS for core and updates.  nothing from development or
testing.  I don't need them or play with them.  I'm just sticking to
whats stable. 

The selling point to me on yam is that it creates yum and apt headers
made a mirror of my chosen repos without too much of a headache.  

In minutes (well days 20kb/s down) I had a working mirror to update my
network.  With the 20kb/s down its advantages to dload once, update
many.  

 I configured yum.conf to point to my yam folders and thats it.  I run
yam -uxg to and it updates everything and recreates the headers.  You
can set this in a cron also ;)

Mike Ramirez
-- 
Mike Ramirez <mike(a)thexxxhost.com&gt;

[Lonnie Cumberland]

Thanks,

I'll give it a try so that I can update my own systems from my downloads 
from yam.

Sound good.
Lonnie

Mike Ramirez wrote:

> On Mon, 2004-09-13 at 17:06, Lonnie Cumberland wrote:
>   
>
> >Strange.
> >
> >Seemed like more than that (5.5G) if you included everything:
> >
> >
> >  Index of ftp://mirrors.kernel.org/fedora/core
> >
> >------------------------------------------------------------------------
> >Index of ftp://mirrors.kernel.org/fedora/core
> >
> >Up to higher level directory
> >Directory: 1         03/01/2004     12:00:00 AM
> >Directory: 2         05/14/2004     11:18:00 AM
> >Directory: development         09/13/2004     12:26:00 PM
> >Directory: test         07/09/2004     08:14:00 PM
> >Directory: updates         05/18/2004     01:56:00 PM
> >
> >especially in the development directory which has many platforms.
> >
> >I have been reading over the YAM docs but the light bulb has not come on 
> >yet to really show me how it is any better than simple rsync in a cron 
> >script.
> >
> >Thanks,
> >Lonnie
> >    
> >
>
> Its smaller becuase I didn't included anything more than I need.  I just
> have the RPMS for core and updates.  nothing from development or
> testing.  I don't need them or play with them.  I'm just sticking to
> whats stable. 
>
> The selling point to me on yam is that it creates yum and apt headers
> made a mirror of my chosen repos without too much of a headache.  
>
> In minutes (well days 20kb/s down) I had a working mirror to update my
> network.  With the 20kb/s down its advantages to dload once, update
> many.  
>
>  I configured yum.conf to point to my yam folders and thats it.  I run
> yam -uxg to and it updates everything and recreates the headers.  You
> can set this in a cron also ;)
>
> Mike Ramirez
>   
>