[PATCH] build-functions: Generate OSTree static deltas for rawhide

[Dennis Gilmore]

On Wednesday, May 13, 2015 09:10:23 PM Colin Walters wrote:
> Adam Miller pointed out that OSTree downloads are slow.  We've been
> working on "static deltas" for a while now, and they're ready for some
> real world testing.
> 
> For more information, see:
> 
>  - https://mail.gnome.org/archives/ostree-list/2015-March/msg00005.html
>  - https://bugzilla.gnome.org/show_bug.cgi?id=721799
> 
> This is a *basic* implementation - a more sophisticated script is
> necessary to generate "spanning deltas" across multiple revisions.
> 
> The deltas make more sense for releases that are slower than daily -
> for example, there's discussion of doing 2 week stable Fedora Atomic
> Host updates.
> 
> In that model, it'd be much saner to generate deltas from say the last
> update, and possibly the update before it.
> 
> For "rolling" repositories, the audience is far smaller, and that's
> exactly what the incrementalism of the default OSTree archive-z2
> repository is designed for.
> 
> The delta size is going to vary based on the input.  Some numbers are
> in the bugzilla.  For reference, a static delta based on the the
> latest rawhide commit to the previous is 5MB.
> ---
>  scripts/build-functions.sh | 6 ++++++
>  1 file changed, 6 insertions(+)
> 
> diff --git a/scripts/build-functions.sh b/scripts/build-functions.sh
> index 49f6252..2a3bcd5 100644
> --- a/scripts/build-functions.sh
> +++ b/scripts/build-functions.sh
> @@ -146,6 +146,12 @@ $MOCK -r $MOCKCONFIG --uniqueext=$DATE --shell "if [ !
> -d $ATOMICREPO ]; then os $MOCK -r $MOCKCONFIG --uniqueext=$DATE --shell
> "git clone https://git.fedorahosted.org/git/fedora-atomic.git $ATOMIC &&
> pushd $ATOMIC && git log -n 1 --pretty='%h: %ci - %s' && git checkout
> ${GIT_BRANCH}" $MOCK -r $MOCKCONFIG --uniqueext=$DATE --shell "cd $ATOMIC
> && sed -i -e
> 's|mirrorlist=.*$|baseurl=http://kojipkgs.fedoraproject.org/mash/${DIST}/x8
> 6_64/os/|g' fedora*repo" $MOCK -r $MOCKCONFIG --uniqueext=$DATE --shell
> "rpm-ostree compose tree --repo=$ATOMICREPO
> $ATOMIC/fedora-atomic-docker-host.json >$logdir/atomic" +if [ "$BRANCHED" =
> "rawhide"]; then
> +    # We're only generatic static deltas for rawhide.
> +    REF="fedora-atomic/$BRANCHED/x86_64/docker-host"
> +    $MOCK -r $MOCKCONFIG --uniqueext=$DATE --shell "ostree
> --repo=$ATOMICREPO rev-parse ${REF} && ostree --repo=$ATOMICREPO
> static-delta generate ${REF}" +    # TODO: GPG sign it
> +fi
>  log "finished atomic tree creation"
>  }
Other than F22 is nearly out the door, any reason we should not do this for 
branched also?

Dennis
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 819 bytes
Desc: This is a digitally signed message part.
URL: <http://lists.fedoraproject.org/pipermail/rel-eng/attachments/20150514/95c8ae84/attachment.sig>