Help with out of date mirror

[Justin Deffenbaugh]

Hello, I'm running the Fedora mirror here at NCSU
<http://packages.oit.ncsu.edu/fedora/>;. I noticed that we never picked up
Fedora 31 and I'm trying to figure out why. My scripts are running without
error, they say everything is up to date. I've gotten the latest version of
quick-fedora-mirror
<https://pagure.io/quick-fedora-mirror/blob/master/f/quick-fedora-mirror>;,
but it still see the same behavior.

It appears to download the file list and find no changes. I've checked, the
file list it downloads is different than the one under /fedora locally.
I've also removed the last run timestamp files created by the script.
Behavior remains the same. How can I force it to reassess what files are on
the local mirror? Is there something else I'm missing?

Here's the output I'm getting:

[mirror_u@packages bin]$ ./quick-fedora-mirror

Mirror starting: Tue Nov 12 14:23:21 EST 2019
> > Log: Run start: cfg ./quick-fedora-mirror.conf, tmp
/tmp/quick-mirror.xVySJpItXC
============================================================
> > Log: Remote file list download start 
Downloading file
lists
> > Calling /usr/bin/rsync --timeout=600 -raSH -f R .~tmp~ --stats
--delete-before --delay-updates --out-format=@ %i  %n%L -v -v
--files-from=filelist-transferlist --no-dirs --relative -
-compress rsync://dl.fedoraproject.org/fedora-buffet/ .
> > Log: calling /usr/bin/rsync --timeout=600 -raSH -f R .~tmp~
> --stats 
--delete-before --delay-updates --out-format=@ %i  %n%L -v -v
--files-from=filelist-transferlist --no-dirs --relat
ive --compress rsync://dl.fedoraproject.org/fedora-buffet/ .
opening tcp connection to dl.fedoraproject.org port 873
sending daemon args: --server --sender -vvlHogDtprRSze.LsfxC --timeout=600
--files-from=- --from0 . fedora-buffet/  (8 args)
----------------------------
Fedora Master Mirror Servers
----------------------------

If you are using bare rsync to sync content, please stop and
take a look at https://pagure.io/quick-fedora-mirror.

See http://fedoraproject.org/wiki/Infrastructure/Mirroring for
further instructions.
----------------------------

You have connected to dl03.fedoraproject.org

receiving file list ... done
delta-transmission enabled
@ .d..tp.....  epel/
@ >f..t......  epel/fullfiletimelist-epel
@ .d..tp.....  fedora/
@ >f..t......  fedora/fullfiletimelist-fedora

rsync[56967] (receiver) heap statistics:
  arena:         393216   (bytes from sbrk)
  ordblks:            3   (chunks not in use)
  smblks:             1
  hblks:              2   (chunks from mmap)
  hblkhd:        532480   (bytes from mmap)
  allmem:        925696   (bytes from sbrk + mmap)
  usmblks:            0
  fsmblks:           64
  uordblks:      255792   (bytes used)
  fordblks:      137424   (bytes free)
  keepcost:      131408   (bytes in releasable chunk)

rsync[56963] (generator) heap statistics:
  arena:         282624   (bytes from sbrk)
  ordblks:            3   (chunks not in use)
  smblks:             1
  hblks:              2   (chunks from mmap)
  hblkhd:        532480   (bytes from mmap)
  allmem:        815104   (bytes from sbrk + mmap)
  usmblks:            0
  fsmblks:           64
  uordblks:      150144   (bytes used)
  fordblks:      132480   (bytes free)
  keepcost:      130496   (bytes in releasable chunk)

Number of files: 4 (reg: 2, dir: 2)
Number of created files: 0
Number of deleted files: 0
Number of regular files transferred: 2
Total file size: 253,928,046 bytes
Total transferred file size: 253,928,046 bytes
Literal data: 0 bytes
Matched data: 253,928,046 bytes
File list size: 154
File list generation time: 0.095 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 132,268
Total bytes received: 268

sent 132,268 bytes  received 268 bytes  24,097.45 bytes/sec
total size is 253,928,046  speedup is 1,915.92
> > Log: rsync call completed succesfully with return 0
> > Log: File list download: 268B received, 23.53KB/s
> > Log: Remote file list download: end
> > Log: Processing start
> > Log: No change in file list for fedora-enchilada 
No change in file list
checksum. Skipping fedora-enchilada.
> > Log: No change in file list for fedora-epel 
No change in
file list checksum. Skipping fedora-epel.
> > Log: No changes to synchronize 
No changed files.
=========================
Mirror finished: Tue Nov 12 14:23:28 EST 2019 (0)
> > Log: Run end; exiting 0.

[Jason L Tibbitts III]

> >>>> "JD" == Justin Deffenbaugh
> <jwdeffen(a)ncsu.edu&gt; writes: 
JD> How can I force it to reassess what files are on the local mirror?

Run with -a, which will disable the optimization that skips processing
if the downloaded file list is identical to what you already have.

There are situations where you could get an updated file list without
the content, though generally that would require a full disk, a failed
disk or a system crash at just the wrong time.  It's also possible that
the file list was not updated after the bit flip, which I believe could
cause this situation, though it certainly seems correct to me now.

In any case, running with -a/--alwayscheck should cause it to directly
compare the file list content to the local content and transfer
everything that is missing.  But any change to the file list (which for
the "fedora" module would include an updates push) would also accomplish
the same thing, so it does confuse me that you would still be seeing any
issue like this.  It would be good to check the log (or journal, if you
have that enabled) to see at what points in the past it has detected a
change to the file list and what was downloaded at that time.

 - J<

[Justin Deffenbaugh]

Thanks for the tip there, the -a found a directory path that had somehow
changed ownership. Fixed that and I'm running a new sync as we speak. Looks
like things are going to go through.

Justin

On Tue, Nov 12, 2019 at 3:49 PM Jason L Tibbitts III <tibbs(a)math.uh.edu&gt;
wrote:

>  >>>>> "JD" == Justin Deffenbaugh
> <jwdeffen(a)ncsu.edu&gt; writes:
>
>  JD> How can I force it to reassess what files are on the local mirror?
>
>  Run with -a, which will disable the optimization that skips processing
>  if the downloaded file list is identical to what you already have.
>
>  There are situations where you could get an updated file list without
>  the content, though generally that would require a full disk, a failed
>  disk or a system crash at just the wrong time.  It's also possible that
>  the file list was not updated after the bit flip, which I believe could
>  cause this situation, though it certainly seems correct to me now.
>
>  In any case, running with -a/--alwayscheck should cause it to directly
>  compare the file list content to the local content and transfer
>  everything that is missing.  But any change to the file list (which for
>  the "fedora" module would include an updates push) would also accomplish
>  the same thing, so it does confuse me that you would still be seeing any
>  issue like this.  It would be good to check the log (or journal, if you
>  have that enabled) to see at what points in the past it has detected a
>  change to the file list and what was downloaded at that time.
>
>   - J<
>