On Tue, Apr 17, 2018 at 4:20 PM, Jonathan Dieter <jdieter@gmail.com> wrote:
On Tue, 2018-04-17 at 09:08 +0200, Michal Novotny wrote:
> Hello Jonathan,
> On Mon, Apr 16, 2018 at 2:47 PM, Jonathan Dieter <jdieter@gmail.com>
> wrote:
> > It's been a number of weeks since my last update, so I thought I'd
> > let
> > everyone know where things are at.
> >
> > I've spent most of these last few weeks reworking zchunk's API to
> > make
> > it easier to use and more in line with what other compression tools
> > use, and I'm mostly happy with it now.  Writing a simple zchunk
> > file
> > can be done in a few lines of code, while reading one is also
> > simple.
> > I've also added zchunk support to createrepo_c (see
> > https://github.com/jdieter/createrepo_c), but I haven't yet created
> > a
> > pull request because I'm not sure if my current implementation is
> > the
> > best method.  My current effort only zchunks primary.xml,
> > filelists.xml
> > and other.xml and doesn't change the sort order.
> Once it is in createrepo_c, we could try employing it in Fedora COPR.

Ok, done.  This copr currently has zchunk and createrepo_c in it.  I
did have to disable the python tests for createrepo_c which means I
probably wouldn't use the python bindings with this release.


To enable zchunk creation, run createrepo_c --zck.  I've created
dictionaries that are appropriate for Fedora's metadata at
https://www.jdieter.net/downloads/zchunk-dicts, and they can be used
with --zck-primary-dict, --zck-filelists-dict and --zck-other-dict.

To make zchunk downloads efficient, the same dictionary must be used
each time metadata is generated.  Dictionaries aren't mandatory, but
they greatly reduce the size of the compressed metadata.

Alright, I will deploy it on staging. But we will need to get it into Fedora's
DistGit first to be able to use it on COPR production instance afterwards...
Anyway, looking forward to start experimenting with it.

Thank you!

infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-leave@lists.fedoraproject.org