problems with mirroring cron-job

[ariel sabiguero yawelak]

Hello. Some days ago we started getting:

    Could not sync from rsync://mirrors.kernel.org @ERROR: max
    connections (75) reached -- try again later rsync error: error
    starting client-server protocol (code 5) at main.c(1672)
    [Receiver=3.1.3] @ERROR: max connections (75) reached -- try again later


from our tier one mirror. We wrote them but no answer yet.
Last night we got a "slot" to the rsync server but:

    find:
    ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/EFI/BOOT/.~tmp~’:
    Permission denied find:
    ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/EFI/BOOT/fonts/.~tmp~’:
    Permission denied find:
    ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/images/pxeboot/.~tmp~’:
    Permission denied find:
    ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/images/.~tmp~’:
    Permission denied find:
    ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/.~tmp~’:
    Permission denied find:
    ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/isolinux/.~tmp~’:
    Permission denied
    ........
    failed: Permission denied (13) rsync: mkstemp
    "/zp0/mirrors/fedora/epel/testing/7/x86_64/repodata/.repomd.xml.fjVD7X"
    failed: Permission denied (13) rsync error: some files/attrs were
    not transferred (see previous errors) (code 23) at main.c(1674)
    [generator=3.1.3] @ERROR: max connections (75) reached -- try again
    later rsync error: error starting client-server protocol (code 5) at
    main.c(1672) [Receiver=3.1.3] @ERROR: max connections (75) reached
    -- try again later rsync error: error starting client-server
    protocol (code 5) at main.c(1672) [Receiver=3.1.3] rsync failed;
    aborting run. Will not check in or delete anything.


Is it only us or there are others getting these problems with upstream 
servers?
Should we do something?

regards

ariel

[Erinn Looney-Triggs]

It isn't just you. I ran into the same capacity issues with kernel.org,
tried to contact them, no reply. Try another mirror is my only
suggestion. You can also try contacting folks physically closer to your
location, they may let you access their rsync server via alternate ports
or some such.

On 11/24/18 3:41 AM, ariel sabiguero yawelak wrote:
>  Hello. Some days ago we started getting:
>
>      Could not sync from rsync://mirrors.kernel.org @ERROR: max
>      connections (75) reached -- try again later rsync error: error
>      starting client-server protocol (code 5) at main.c(1672)
>      [Receiver=3.1.3] @ERROR: max connections (75) reached -- try again
>      later
>
>
>  from our tier one mirror. We wrote them but no answer yet.
>  Last night we got a "slot" to the rsync server but:
>
>      find:
>      ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/EFI/BOOT/.~tmp~’:
>      Permission denied find:
>     
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/EFI/BOOT/fonts/.~tmp~’:
>      Permission denied find:
>     
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/images/pxeboot/.~tmp~’:
>      Permission denied find:
>      ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/images/.~tmp~’:
>      Permission denied find:
>      ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/.~tmp~’:
>      Permission denied find:
>      ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/isolinux/.~tmp~’:
>      Permission denied
>      ........
>      failed: Permission denied (13) rsync: mkstemp
>      "/zp0/mirrors/fedora/epel/testing/7/x86_64/repodata/.repomd.xml.fjVD7X"
>      failed: Permission denied (13) rsync error: some files/attrs were
>      not transferred (see previous errors) (code 23) at main.c(1674)
>      [generator=3.1.3] @ERROR: max connections (75) reached -- try
>      again later rsync error: error starting client-server protocol
>      (code 5) at main.c(1672) [Receiver=3.1.3] @ERROR: max connections
>      (75) reached -- try again later rsync error: error starting
>      client-server protocol (code 5) at main.c(1672) [Receiver=3.1.3]
>      rsync failed; aborting run. Will not check in or delete anything.
>
>
>  Is it only us or there are others getting these problems with upstream
>  servers?
>  Should we do something?
>
>  regards
>
>  ariel
>
>  _______________________________________________
>  Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
>  To unsubscribe send an email to mirror-admin-leave(a)lists.fedoraproject.org
>  Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]...

[ariel sabiguero yawelak]

Thanks for your answer. Where do you mirror from?

regards


ariel

El 24/11/18 a las 14:21, Erinn Looney-Triggs escribió:
>  It isn't just you. I ran into the same capacity issues with 
>  kernel.org, tried to contact them, no reply. Try another mirror is my 
>  only suggestion. You can also try contacting folks physically closer 
>  to your location, they may let you access their rsync server via 
>  alternate ports or some such.
>
>  On 11/24/18 3:41 AM, ariel sabiguero yawelak wrote:
> >
> > Hello. Some days ago we started getting:
> >
> >     Could not sync from rsync://mirrors.kernel.org @ERROR: max
> >     connections (75) reached -- try again later rsync error: error
> >     starting client-server protocol (code 5) at main.c(1672)
> >     [Receiver=3.1.3] @ERROR: max connections (75) reached -- try
> >     again later
> >
> >
> > from our tier one mirror. We wrote them but no answer yet.
> > Last night we got a "slot" to the rsync server but:
> >
> >     find:
> >     ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/EFI/BOOT/.~tmp~’:
> >     Permission denied find:
> >    
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/EFI/BOOT/fonts/.~tmp~’:
> >     Permission denied find:
> >    
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/images/pxeboot/.~tmp~’:
> >     Permission denied find:
> >     ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/images/.~tmp~’:
> >     Permission denied find:
> >     ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/.~tmp~’:
> >     Permission denied find:
> >     ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/isolinux/.~tmp~’:
> >     Permission denied
> >     ........
> >     failed: Permission denied (13) rsync: mkstemp
> >    
> "/zp0/mirrors/fedora/epel/testing/7/x86_64/repodata/.repomd.xml.fjVD7X"
> >     failed: Permission denied (13) rsync error: some files/attrs were
> >     not transferred (see previous errors) (code 23) at main.c(1674)
> >     [generator=3.1.3] @ERROR: max connections (75) reached -- try
> >     again later rsync error: error starting client-server protocol
> >     (code 5) at main.c(1672) [Receiver=3.1.3] @ERROR: max connections
> >     (75) reached -- try again later rsync error: error starting
> >     client-server protocol (code 5) at main.c(1672) [Receiver=3.1.3]
> >     rsync failed; aborting run. Will not check in or delete anything.
> >
> >
> > Is it only us or there are others getting these problems with 
> > upstream servers?
> > Should we do something?
> >
> > regards
> >
> > ariel
> >
> > _______________________________________________
> > Mirror-admin mailing list --mirror-admin(a)lists.fedoraproject.org
> > To unsubscribe send an email tomirror-admin-leave(a)lists.fedoraproject.org
> > Fedora Code of Conduct:https://getfedora.org/code-of-conduct.html
> > List Guidelines:https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List
> Archives:https://lists.fedoraproject.org/archives/list/mirror-admin@lists...
>
>  _______________________________________________
>  Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
>  To unsubscribe send an email to mirror-admin-leave(a)lists.fedoraproject.org
>  Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]...

[Benjamin Rose]

Hello all,

Everyone please feel encouraged to mirror from:

rsync://mirror.math.princeton.edu/pub/<target>

We are 40-gig connected to the backbone which is connected to the 
Internet via multiple 10-gig connections, and separately is 10-gig 
connected to Internet2. We have network capacity to spare. The machine 
is well-spec'd and can handle far more than its current client load. 
Plus, I'm actually responsive! ;-)

Our upstreams vary, and we are not currently using QFM though looking at 
implementing it at some point soon so we can be tier-1:

  fedora:
     remotesrc: "rsync://dl.fedoraproject.org/fedora-enchilada"
     localdest: "/var/www/html/pub/fedora"
     extracommand: "report_mirror -c 
/etc/mirrormanager-client/report_mirror_fedora.conf"
   fedora-alt:
     remotesrc: "rsync://mirrors.kernel.org/fedora-alt"
     localdest: "/var/www/html/pub/alt"
     extracommand: "report_mirror -c 
/etc/mirrormanager-client/report_mirror_alt.conf"
   fedora-archive:
     remotesrc: "rsync://download.wpi.edu:874/fedora-archive"
     localdest: "/var/www/html/pub/fedora-archive"
     extracommand: "report_mirror -c 
/etc/mirrormanager-client/report_mirror_archive.conf"
   fedora-epel:
     remotesrc: "rsync://mirrors.kernel.org/fedora-epel/"
     localdest: "/var/www/html/pub/epel/"
     extracommand: "report_mirror -c 
/etc/mirrormanager-client/report_mirror_epel.conf"
   fedora-secondary:
     remotesrc: "rsync://mirrors.kernel.org/fedora-secondary"
     localdest: "/var/www/html/pub/fedora-secondary"
     extracommand: "report_mirror -c 
/etc/mirrormanager-client/report_mirror_secondary.conf"

Ben


On 11/26/18 10:16 AM, ariel sabiguero yawelak wrote:
>  Thanks for your answer. Where do you mirror from?
>
>  regards
>
>
>  ariel
>
>  El 24/11/18 a las 14:21, Erinn Looney-Triggs escribió:
> >
> > It isn't just you. I ran into the same capacity issues with 
> > kernel.org, tried to contact them, no reply. Try another mirror is my 
> > only suggestion. You can also try contacting folks physically closer 
> > to your location, they may let you access their rsync server via 
> > alternate ports or some such.
> >
> > On 11/24/18 3:41 AM, ariel sabiguero yawelak wrote:
> >>
> >> Hello. Some days ago we started getting:
> >>
> >>     Could not sync from rsync://mirrors.kernel.org @ERROR: max
> >>     connections (75) reached -- try again later rsync error: error
> >>     starting client-server protocol (code 5) at main.c(1672)
> >>     [Receiver=3.1.3] @ERROR: max connections (75) reached -- try
> >>     again later
> >>
> >>
> >> from our tier one mirror. We wrote them but no answer yet.
> >> Last night we got a "slot" to the rsync server but:
> >>
> >>     find:
> >>    
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/EFI/BOOT/.~tmp~’:
> >>     Permission denied find:
> >>    
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/EFI/BOOT/fonts/.~tmp~’:
> >>     Permission denied find:
> >>    
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/images/pxeboot/.~tmp~’:
> >>     Permission denied find:
> >>    
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/images/.~tmp~’:
> >>     Permission denied find:
> >>     ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/.~tmp~’:
> >>     Permission denied find:
> >>    
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/isolinux/.~tmp~’:
> >>     Permission denied
> >>     ........
> >>     failed: Permission denied (13) rsync: mkstemp
> >>    
> "/zp0/mirrors/fedora/epel/testing/7/x86_64/repodata/.repomd.xml.fjVD7X"
> >>     failed: Permission denied (13) rsync error: some files/attrs
> >>     were not transferred (see previous errors) (code 23) at
> >>     main.c(1674) [generator=3.1.3] @ERROR: max connections (75)
> >>     reached -- try again later rsync error: error starting
> >>     client-server protocol (code 5) at main.c(1672) [Receiver=3.1.3]
> >>     @ERROR: max connections (75) reached -- try again later rsync
> >>     error: error starting client-server protocol (code 5) at
> >>     main.c(1672) [Receiver=3.1.3] rsync failed; aborting run. Will
> >>     not check in or delete anything.
> >>
> >>
> >> Is it only us or there are others getting these problems with 
> >> upstream servers?
> >> Should we do something?
> >>
> >> regards
> >>
> >> ariel
> >>
> >> _______________________________________________
> >> Mirror-admin mailing list --mirror-admin(a)lists.fedoraproject.org
> >> To unsubscribe send an email tomirror-admin-leave(a)lists.fedoraproject.org
> >> Fedora Code of Conduct:https://getfedora.org/code-of-conduct.html
> >> List Guidelines:https://fedoraproject.org/wiki/Mailing_list_guidelines
> >> List
> Archives:https://lists.fedoraproject.org/archives/list/mirror-admin@lists...
> >
> > _______________________________________________
> > Mirror-admin mailing list --mirror-admin(a)lists.fedoraproject.org
> > To unsubscribe send an email tomirror-admin-leave(a)lists.fedoraproject.org
> > Fedora Code of Conduct:https://getfedora.org/code-of-conduct.html
> > List Guidelines:https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List
> Archives:https://lists.fedoraproject.org/archives/list/mirror-admin@lists...
>
>  _______________________________________________
>  Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
>  To unsubscribe send an email to mirror-admin-leave(a)lists.fedoraproject.org
>  Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]...

[Jester 2.0]

Benjamin,
  Does your mirror work with the mirror-manager2 client script?  IIRC, the
requirement is mirroring fedora-enchilada.

Cheers,
 Jon

On Tue, Nov 27, 2018, 2:14 PM Benjamin Rose <benrose(a)math.princeton.edu
wrote:

>  Hello all,
>
>  Everyone please feel encouraged to mirror from:
>
>  rsync://mirror.math.princeton.edu/pub/<target>
>
>  We are 40-gig connected to the backbone which is connected to the Internet
>  via multiple 10-gig connections, and separately is 10-gig connected to
>  Internet2. We have network capacity to spare. The machine is well-spec'd
>  and can handle far more than its current client load. Plus, I'm actually
>  responsive! ;-)
>
>  Our upstreams vary, and we are not currently using QFM though looking at
>  implementing it at some point soon so we can be tier-1:
>
>   fedora:
>      remotesrc: "rsync://dl.fedoraproject.org/fedora-enchilada"
>      localdest: "/var/www/html/pub/fedora"
>      extracommand: "report_mirror -c
>  /etc/mirrormanager-client/report_mirror_fedora.conf"
>    fedora-alt:
>      remotesrc: "rsync://mirrors.kernel.org/fedora-alt"
>      localdest: "/var/www/html/pub/alt"
>      extracommand: "report_mirror -c
>  /etc/mirrormanager-client/report_mirror_alt.conf"
>    fedora-archive:
>      remotesrc: "rsync://download.wpi.edu:874/fedora-archive"
>      localdest: "/var/www/html/pub/fedora-archive"
>      extracommand: "report_mirror -c
>  /etc/mirrormanager-client/report_mirror_archive.conf"
>    fedora-epel:
>      remotesrc: "rsync://mirrors.kernel.org/fedora-epel/"
>      localdest: "/var/www/html/pub/epel/"
>      extracommand: "report_mirror -c
>  /etc/mirrormanager-client/report_mirror_epel.conf"
>    fedora-secondary:
>      remotesrc: "rsync://mirrors.kernel.org/fedora-secondary"
>      localdest: "/var/www/html/pub/fedora-secondary"
>      extracommand: "report_mirror -c
>  /etc/mirrormanager-client/report_mirror_secondary.conf"
>
>  Ben
>
>
>  On 11/26/18 10:16 AM, ariel sabiguero yawelak wrote:
>
>  Thanks for your answer. Where do you mirror from?
>
>  regards
>
>
>  ariel
>  El 24/11/18 a las 14:21, Erinn Looney-Triggs escribió:
>
>  It isn't just you. I ran into the same capacity issues with kernel.org,
>  tried to contact them, no reply. Try another mirror is my only suggestion.
>  You can also try contacting folks physically closer to your location, they
>  may let you access their rsync server via alternate ports or some such.
>  On 11/24/18 3:41 AM, ariel sabiguero yawelak wrote:
>
>  Hello. Some days ago we started getting:
>
>  Could not sync from rsync://mirrors.kernel.org @ERROR: max connections
>  (75) reached -- try again later rsync error: error starting client-server
>  protocol (code 5) at main.c(1672) [Receiver=3.1.3] @ERROR: max connections
>  (75) reached -- try again later
>
>
>  from our tier one mirror. We wrote them but no answer yet.
>  Last night we got a "slot" to the rsync server but:
>
>  find:
>  ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/EFI/BOOT/.~tmp~’:
>  Permission denied find:
>  ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/EFI/BOOT/fonts/.~tmp~’:
>  Permission denied find:
>  ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/images/pxeboot/.~tmp~’:
>  Permission denied find:
>  ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/images/.~tmp~’:
>  Permission denied find:
>  ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/.~tmp~’:
>  Permission denied find:
>  ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/isolinux/.~tmp~’:
>  Permission denied
>  ........
>  failed: Permission denied (13) rsync: mkstemp "
>  */zp0/mirrors/fedora/epel/testing/7/x86_64/repodata/*.repomd.xml.fjVD7X"
>  failed: Permission denied (13) rsync error: some files/attrs were not
>  transferred (see previous errors) (code 23) at main.c(1674)
>  [generator=3.1.3] @ERROR: max connections (75) reached -- try again later
>  rsync error: error starting client-server protocol (code 5) at main.c(1672)
>  [Receiver=3.1.3] @ERROR: max connections (75) reached -- try again later
>  rsync error: error starting client-server protocol (code 5) at main.c(1672)
>  [Receiver=3.1.3] rsync failed; aborting run. Will not check in or delete
>  anything.
>
>
>  Is it only us or there are others getting these problems with upstream
>  servers?
>  Should we do something?
>
>  regards
>
>  ariel
>
>  _______________________________________________
>  Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
>  To unsubscribe send an email to mirror-admin-leave(a)lists.fedoraproject.org
>  Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]...
>
>
>  _______________________________________________
>  Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
>  To unsubscribe send an email to mirror-admin-leave(a)lists.fedoraproject.org
>  Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]...
>
>
>  _______________________________________________
>  Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
>  To unsubscribe send an email to mirror-admin-leave(a)lists.fedoraproject.org
>  Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]...
>
>  _______________________________________________
>  Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
>  To unsubscribe send an email to mirror-admin-leave(a)lists.fedoraproject.org
>  Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
>  https://lists.fedoraproject.org/archives/list/[e-mail]...
>

[Benjamin Rose]

Hello,

[root@mirror ~]# rpm -aq | grep -i mirrormanager
mirrormanager-client-1.4.4-3.sdl7.noarch

As I said, I should be using QFM, but in the meantime, I have all the 
content and should be a stable & reliable upstream for most use cases.

Ben


On 11/27/18 2:28 PM, Jester 2.0 wrote:
>  Benjamin,
>    Does your mirror work with the mirror-manager2 client script?  IIRC, 
>  the requirement is mirroring fedora-enchilada.
>
>  Cheers,
>   Jon
>
>  On Tue, Nov 27, 2018, 2:14 PM Benjamin Rose 
>  <benrose(a)math.princeton.edu <mailto:[e-mail]> wrote:
>
>      Hello all,
>
>      Everyone please feel encouraged to mirror from:
>
>      rsync://mirror.math.princeton.edu/pub/
>      <http://mirror.math.princeton.edu/pub/><target>
>
>      We are 40-gig connected to the backbone which is connected to the
>      Internet via multiple 10-gig connections, and separately is 10-gig
>      connected to Internet2. We have network capacity to spare. The
>      machine is well-spec'd and can handle far more than its current
>      client load. Plus, I'm actually responsive! ;-)
>
>      Our upstreams vary, and we are not currently using QFM though
>      looking at implementing it at some point soon so we can be tier-1:
>
>       fedora:
>          remotesrc: "rsync://dl.fedoraproject.org/fedora-enchilada
>      <http://dl.fedoraproject.org/fedora-enchilada>"
>          localdest: "/var/www/html/pub/fedora"
>          extracommand: "report_mirror -c
>      /etc/mirrormanager-client/report_mirror_fedora.conf"
>        fedora-alt:
>          remotesrc: "rsync://mirrors.kernel.org/fedora-alt
>      <http://mirrors.kernel.org/fedora-alt>"
>          localdest: "/var/www/html/pub/alt"
>          extracommand: "report_mirror -c
>      /etc/mirrormanager-client/report_mirror_alt.conf"
>        fedora-archive:
>          remotesrc: "rsync://download.wpi.edu:874/fedora-archive
>      <http://download.wpi.edu:874/fedora-archive>"
>          localdest: "/var/www/html/pub/fedora-archive"
>          extracommand: "report_mirror -c
>      /etc/mirrormanager-client/report_mirror_archive.conf"
>        fedora-epel:
>          remotesrc: "rsync://mirrors.kernel.org/fedora-epel/
>      <http://mirrors.kernel.org/fedora-epel/>"
>          localdest: "/var/www/html/pub/epel/"
>          extracommand: "report_mirror -c
>      /etc/mirrormanager-client/report_mirror_epel.conf"
>        fedora-secondary:
>          remotesrc: "rsync://mirrors.kernel.org/fedora-secondary
>      <http://mirrors.kernel.org/fedora-secondary>"
>          localdest: "/var/www/html/pub/fedora-secondary"
>          extracommand: "report_mirror -c
>      /etc/mirrormanager-client/report_mirror_secondary.conf"
>
>      Ben
>
>
>      On 11/26/18 10:16 AM, ariel sabiguero yawelak wrote:
> >
> >     Thanks for your answer. Where do you mirror from?
> >
> >     regards
> >
> >
> >     ariel
> >
> >     El 24/11/18 a las 14:21, Erinn Looney-Triggs escribió:
> >>
> >>     It isn't just you. I ran into the same capacity issues with
> >>     kernel.org <http://kernel.org>;, tried to contact them, no reply.
> >>     Try another mirror is my only suggestion. You can also try
> >>     contacting folks physically closer to your location, they may
> >>     let you access their rsync server via alternate ports or some such.
> >>
> >>     On 11/24/18 3:41 AM, ariel sabiguero yawelak wrote:
> >>>
> >>>     Hello. Some days ago we started getting:
> >>>
> >>>         Could not sync from rsync://mirrors.kernel.org
> >>>         <http://mirrors.kernel.org> @ERROR: max connections (75)
> >>>         reached -- try again later rsync error: error starting
> >>>         client-server protocol (code 5) at main.c(1672)
> >>>         [Receiver=3.1.3] @ERROR: max connections (75) reached --
> >>>         try again later
> >>>
> >>>
> >>>     from our tier one mirror. We wrote them but no answer yet.
> >>>     Last night we got a "slot" to the rsync server but:
> >>>
> >>>         find:
> >>>        
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/EFI/BOOT/.~tmp~’:
> >>>         Permission denied find:
> >>>        
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/EFI/BOOT/fonts/.~tmp~’:
> >>>         Permission denied find:
> >>>        
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/images/pxeboot/.~tmp~’:
> >>>         Permission denied find:
> >>>        
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/images/.~tmp~’:
> >>>         Permission denied find:
> >>>        
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/.~tmp~’:
> >>>         Permission denied find:
> >>>        
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/isolinux/.~tmp~’:
> >>>         Permission denied
> >>>         ........
> >>>         failed: Permission denied (13) rsync: mkstemp
> >>>        
> "//zp0/mirrors/fedora/epel/testing/7/x86_64/repodata//.repomd.xml.fjVD7X"
> >>>         failed: Permission denied (13) rsync error: some
> >>>         files/attrs were not transferred (see previous errors)
> >>>         (code 23) at main.c(1674) [generator=3.1.3] @ERROR: max
> >>>         connections (75) reached -- try again later rsync error:
> >>>         error starting client-server protocol (code 5) at
> >>>         main.c(1672) [Receiver=3.1.3] @ERROR: max connections (75)
> >>>         reached -- try again later rsync error: error starting
> >>>         client-server protocol (code 5) at main.c(1672)
> >>>         [Receiver=3.1.3] rsync failed; aborting run. Will not check
> >>>         in or delete anything.
> >>>
> >>>
> >>>     Is it only us or there are others getting these problems with
> >>>     upstream servers?
> >>>     Should we do something?
> >>>
> >>>     regards
> >>>
> >>>     ariel
> >>>
> >>>     _______________________________________________
> >>>     Mirror-admin mailing list --mirror-admin(a)lists.fedoraproject.org 
> <mailto:[e-mail]>
> >>>     To unsubscribe send an email tomirror-admin-leave(a)lists.fedoraproject.org
>  <mailto:[e-mail]>
> >>>     Fedora Code of Conduct:https://getfedora.org/code-of-conduct.html
> >>>     List Guidelines:https://fedoraproject.org/wiki/Mailing_list_guidelines
> >>>     List
> Archives:https://lists.fedoraproject.org/archives/list/mirror-admin@lists...
> >>
> >>     _______________________________________________
> >>     Mirror-admin mailing list --mirror-admin(a)lists.fedoraproject.org 
> <mailto:[e-mail]>
> >>     To unsubscribe send an email tomirror-admin-leave(a)lists.fedoraproject.org 
> <mailto:[e-mail]>
> >>     Fedora Code of Conduct:https://getfedora.org/code-of-conduct.html
> >>     List Guidelines:https://fedoraproject.org/wiki/Mailing_list_guidelines
> >>     List
> Archives:https://lists.fedoraproject.org/archives/list/mirror-admin@lists...
> >
> >     _______________________________________________
> >     Mirror-admin mailing list --mirror-admin(a)lists.fedoraproject.org 
> <mailto:[e-mail]>
> >     To unsubscribe send an email tomirror-admin-leave(a)lists.fedoraproject.org 
> <mailto:[e-mail]>
> >     Fedora Code of Conduct:https://getfedora.org/code-of-conduct.html
> >     List Guidelines:https://fedoraproject.org/wiki/Mailing_list_guidelines
> >     List
> Archives:https://lists.fedoraproject.org/archives/list/mirror-admin@lists...
>      _______________________________________________
>      Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
>      <mailto:[e-mail]>
>      To unsubscribe send an email to
>      mirror-admin-leave(a)lists.fedoraproject.org
>      <mailto:[e-mail]>
>      Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>      List Guidelines:
>      https://fedoraproject.org/wiki/Mailing_list_guidelines
>      List Archives:
>      https://lists.fedoraproject.org/archives/list/[e-mail]...
>
>
>  _______________________________________________
>  Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
>  To unsubscribe send an email to mirror-admin-leave(a)lists.fedoraproject.org
>  Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]...

[Jester 2.0]

Ben,
  This is what I was referring to with being compatible with
mirror-manager2 client.  In order for the mirror-manager2 client to use
your mirror as a source, it has to have "fedora-buffet" as a dierctory(?).
I am not sure what is required on the server side to be compatible.

Mirror starting: Fri Dec  7 16:23:10 UTC 2018
> > Log: Run start: cfg ./quick-fedora-mirror.conf, tmp
/array/opt/mirror-manager/tmp/quick-mirror.gcurnJwrPV
============================================================
> > Log: Remote file list download start 
Downloading file
lists
> > Calling /usr/bin/rsync --timeout=600 -aSH -f R .~tmp~ --stats
--delay-updates --out-format=@ %i %10l  %n%L --no-motd
--files-from=filelist-transferlist --no-dirs --relative --compress rsync://
mirror.math.princeton.edu/pub/fedora-buffet/ .
> > Log: calling /usr/bin/rsync --timeout=600 -aSH -f R .~tmp~
> --stats 
--delay-updates --out-format=@ %i %10l  %n%L --no-motd
--files-from=filelist-transferlist --no-dirs --relative --compress rsync://
mirror.math.princeton.edu/pub/fedora-buffet/ .
rsync: change_dir "/fedora-buffet/" (in pub) failed: No such file or
directory (2)
rsync error: errors selecting input/output files, dirs (code 3) at
flist.c(2118) [sender=3.1.2]
> > Log: ERR: rsync returned 3, which was not expected. 
rsync
returned 3, which was not expected.
rsync: change_dir "/fedora-buffet/" (in pub) failed: No such file or
directory (2)
rsync error: errors selecting input/output files, dirs (code 3) at
flist.c(2118) [sender=3.1.2]
rsync finished with nonzero exit status.
Could not retrieve file lists.
> > Log: ERR: Aborting due to rsync failure while retrieving file
> lists 
=========================
Mirror finished: Fri Dec  7 16:23:11 UTC 2018 (1)
> > Log: Run end; exiting 1. 

I am currently using rsync://pubmirror.math.uh.edu as a source. Perhaps the
structure there will help.

If you aren't interested in supporting this, I completely understand.

Cheers,
 Jon

On Thu, Nov 29, 2018 at 11:24 AM Benjamin Rose <benrose(a)math.princeton.edu&gt;
wrote:

>  Hello,
>
>  [root@mirror ~]# rpm -aq | grep -i mirrormanager
>  mirrormanager-client-1.4.4-3.sdl7.noarch
>
>  As I said, I should be using QFM, but in the meantime, I have all the
>  content and should be a stable & reliable upstream for most use cases.
>
>  Ben
>
>
>  On 11/27/18 2:28 PM, Jester 2.0 wrote:
>
>  Benjamin,
>    Does your mirror work with the mirror-manager2 client script?  IIRC, the
>  requirement is mirroring fedora-enchilada.
>
>  Cheers,
>   Jon
>
>  On Tue, Nov 27, 2018, 2:14 PM Benjamin Rose <benrose(a)math.princeton.edu
>  wrote:
>
> > Hello all,
> >
> > Everyone please feel encouraged to mirror from:
> >
> > rsync://mirror.math.princeton.edu/pub/<target>
> >
> > We are 40-gig connected to the backbone which is connected to the
> > Internet via multiple 10-gig connections, and separately is 10-gig
> > connected to Internet2. We have network capacity to spare. The machine is
> > well-spec'd and can handle far more than its current client load. Plus, I'm
> > actually responsive! ;-)
> >
> > Our upstreams vary, and we are not currently using QFM though looking at
> > implementing it at some point soon so we can be tier-1:
> >
> >  fedora:
> >     remotesrc: "rsync://dl.fedoraproject.org/fedora-enchilada"
> >     localdest: "/var/www/html/pub/fedora"
> >     extracommand: "report_mirror -c
> > /etc/mirrormanager-client/report_mirror_fedora.conf"
> >   fedora-alt:
> >     remotesrc: "rsync://mirrors.kernel.org/fedora-alt"
> >     localdest: "/var/www/html/pub/alt"
> >     extracommand: "report_mirror -c
> > /etc/mirrormanager-client/report_mirror_alt.conf"
> >   fedora-archive:
> >     remotesrc: "rsync://download.wpi.edu:874/fedora-archive"
> >     localdest: "/var/www/html/pub/fedora-archive"
> >     extracommand: "report_mirror -c
> > /etc/mirrormanager-client/report_mirror_archive.conf"
> >   fedora-epel:
> >     remotesrc: "rsync://mirrors.kernel.org/fedora-epel/"
> >     localdest: "/var/www/html/pub/epel/"
> >     extracommand: "report_mirror -c
> > /etc/mirrormanager-client/report_mirror_epel.conf"
> >   fedora-secondary:
> >     remotesrc: "rsync://mirrors.kernel.org/fedora-secondary"
> >     localdest: "/var/www/html/pub/fedora-secondary"
> >     extracommand: "report_mirror -c
> > /etc/mirrormanager-client/report_mirror_secondary.conf"
> >
> > Ben
> >
> >
> > On 11/26/18 10:16 AM, ariel sabiguero yawelak wrote:
> >
> > Thanks for your answer. Where do you mirror from?
> >
> > regards
> >
> >
> > ariel
> > El 24/11/18 a las 14:21, Erinn Looney-Triggs escribió:
> >
> > It isn't just you. I ran into the same capacity issues with kernel.org,
> > tried to contact them, no reply. Try another mirror is my only suggestion.
> > You can also try contacting folks physically closer to your location, they
> > may let you access their rsync server via alternate ports or some such.
> > On 11/24/18 3:41 AM, ariel sabiguero yawelak wrote:
> >
> > Hello. Some days ago we started getting:
> >
> > Could not sync from rsync://mirrors.kernel.org @ERROR: max connections
> > (75) reached -- try again later rsync error: error starting client-server
> > protocol (code 5) at main.c(1672) [Receiver=3.1.3] @ERROR: max connections
> > (75) reached -- try again later
> >
> >
> > from our tier one mirror. We wrote them but no answer yet.
> > Last night we got a "slot" to the rsync server but:
> >
> > find:
> > ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/EFI/BOOT/.~tmp~’:
> > Permission denied find:
> >
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/EFI/BOOT/fonts/.~tmp~’:
> > Permission denied find:
> >
> ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/images/pxeboot/.~tmp~’:
> > Permission denied find:
> > ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/images/.~tmp~’:
> > Permission denied find:
> > ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/.~tmp~’:
> > Permission denied find:
> > ‘fedora/linux/development/rawhide/AtomicWorkstation/x86_64/os/isolinux/.~tmp~’:
> > Permission denied
> > ........
> > failed: Permission denied (13) rsync: mkstemp "
> > */zp0/mirrors/fedora/epel/testing/7/x86_64/repodata/*.repomd.xml.fjVD7X"
> > failed: Permission denied (13) rsync error: some files/attrs were not
> > transferred (see previous errors) (code 23) at main.c(1674)
> > [generator=3.1.3] @ERROR: max connections (75) reached -- try again later
> > rsync error: error starting client-server protocol (code 5) at main.c(1672)
> > [Receiver=3.1.3] @ERROR: max connections (75) reached -- try again later
> > rsync error: error starting client-server protocol (code 5) at main.c(1672)
> > [Receiver=3.1.3] rsync failed; aborting run. Will not check in or delete
> > anything.
> >
> >
> > Is it only us or there are others getting these problems with upstream
> > servers?
> > Should we do something?
> >
> > regards
> >
> > ariel
> >
> > _______________________________________________
> > Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
> > To unsubscribe send an email to mirror-admin-leave(a)lists.fedoraproject.org
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]...
> >
> >
> > _______________________________________________
> > Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
> > To unsubscribe send an email to mirror-admin-leave(a)lists.fedoraproject.org
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]...
> >
> >
> > _______________________________________________
> > Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
> > To unsubscribe send an email to mirror-admin-leave(a)lists.fedoraproject.org
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]...
> >
> > _______________________________________________
> > Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
> > To unsubscribe send an email to
> > mirror-admin-leave(a)lists.fedoraproject.org
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives:
> > https://lists.fedoraproject.org/archives/list/[e-mail]...
> >
>
>  _______________________________________________
>  Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
>  To unsubscribe send an email to mirror-admin-leave(a)lists.fedoraproject.org
>  Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]...
>
>  _______________________________________________
>  Mirror-admin mailing list -- mirror-admin(a)lists.fedoraproject.org
>  To unsubscribe send an email to mirror-admin-leave(a)lists.fedoraproject.org
>  Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
>  https://lists.fedoraproject.org/archives/list/[e-mail]...
>