rsync and compression question

[ToddAndMargo]

Hi All,

Looking over

https://stackoverflow.com/questions/43624832/rsync-compression-and-how-it-wo...

I am not sure what I am reading.

What I would like to do with rsync is as follows:

I would like to have a master directory on a local
drive that is uncompressed.

I want to do a one way sync to a backup flash drive
to update any changed files.

The job will go off in the middle of the night,
so speed is not an issue.

Now the fun part: I would like the files on the
backup flash drive to be compressed.  Do I lose
my file comparison feature?

Can I do this?

Many thanks,
-T

[Matti Pulkkinen]

to, 2021-06-10 kello 14:52 -0700, ToddAndMargo via users kirjoitti:
> Now the fun part: I would like the files on the
> backup flash drive to be compressed.  Do I lose
> my file comparison feature?
>
> Can I do this?

I don't think rsync can peer into compressed archives for file
comparison, and a quick search in the manual didn't yield anything for
such a purpose with the search terms that I came up with. One other
option would be to put btrfs on the flash drive, and then enable
compression on the filesystem.

[George N. White III]

On Thu, 10 Jun 2021 at 19:48, Matti Pulkkinen  wrote:
> to, 2021-06-10 kello 14:52 -0700, ToddAndMargo via users kirjoitti:
> > Now the fun part: I would like the files on the
> > backup flash drive to be compressed.  Do I lose
> > my file comparison feature?
> >
> > Can I do this?
>
> I don't think rsync can peer into compressed archives for file
> comparison, and a quick search in the manual didn't yield anything for
> such a purpose with the search terms that I came up with. One other
> option would be to put btrfs on the flash drive, and then enable
> compression on the filesystem.

I concur, and can add that btrfs compression on flash is generally
much faster than uncompressed for a linux system, but not for
other use cases such as internally compressed netcdf4 files.
> --
> Terveisin / Regards,
> Matti Pulkkinen
>
> users mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct:
> https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]
> Do not reply to spam on the list, report it:
> https://pagure.io/fedora-infrastructure

[Samuel Sieb]

On 2021-06-10 2:52 p.m., ToddAndMargo via users wrote:
> Looking over
>
> https://stackoverflow.com/questions/43624832/rsync-compression-and-how-it-wo...
>
> I am not sure what I am reading.

This has nothing to do with storage or file compression.  That's talking 
about how rsync does data compression on what it sends over the network 
to compensate for lower bandwidth links.

[ToddAndMargo]

On 6/10/21 4:50 PM, Samuel Sieb wrote:
> On 2021-06-10 2:52 p.m., ToddAndMargo via users wrote:
> > Looking over
> >
> > https://stackoverflow.com/questions/43624832/rsync-compression-and-how-it-wo...
> >
> > I am not sure what I am reading.
>
> This has nothing to do with storage or file compression.  That's talking 
> about how rsync does data compression on what it sends over the network 
> to compensate for lower bandwidth links.

That what I thought, but I was hoping I was wrong