Docker images included in the compose and what that means for Pungi

[Adam Miller]

Hello all,
    Currently there is a ticket filed in Taiga[0] that is lacking in
details mostly because I'm not entirely sure what all we need in there
so I wanted to start that discussion here.

The motivation behind this is that we're moving towards a future where
we are shipping content that is in the format of a Docker Layered
Image and I can imagine that we will want to include these as
installable artifacts at compose time for certain things such as
Atomic Host. An example of why we'd want that is so that on a fresh
install from the ISO image there can be a set of services and/or
applications installed without them needing to be pre-baked into the
ostree. This would hopefully allow for more flexibility with the
services and applications to be lifecycled independently of the
operating system.

There's definitely a lot of details to sort out through the entire
stack, but the concept of bringing Layered Images into the fold as
compose artifacts is something I wanted to start discussing among the
group to find out if it is needed and if so, if it's most
appropriately handled by pungi or potentially some other tool.

Thank you,
-AdamM

[0] https://taiga.fedorainfracloud.org/project/acarter-fedora-docker-atomic-t...

[Lubomír Sedlář]

Hello,
there is already support in Pungi to build Docker images either using
image-build [0] in Koji or in OSBS [1] (although Pungi talks to it
through Koji as well).

[0] https://docs.pagure.org/pungi/configuration.html#image-build-settin
gs
[1] https://docs.pagure.org/pungi/configuration.html#osbs-settings

These features are aimed at creating base images, but I think it should
not be particularly difficult to adapt the OSBS calling code to build
layered images as well.

I do see a couple potential issues though:
 * rel-eng would need to maintain the configuration for which images to
build and from what sources – it would add extra work for them
 * building more images in compose is going to slow it down
 * if the image is meant to be buildable even outside of compose, we
would need to prevent NVR clashes

Cheers,
Lubomír Sedlář

Adam Miller píše v St 31. 08. 2016 v 15:56 -0500:
> Hello all,
>     Currently there is a ticket filed in Taiga[0] that is lacking in
> details mostly because I'm not entirely sure what all we need in
> there
> so I wanted to start that discussion here.
> 
> The motivation behind this is that we're moving towards a future
> where
> we are shipping content that is in the format of a Docker Layered
> Image and I can imagine that we will want to include these as
> installable artifacts at compose time for certain things such as
> Atomic Host. An example of why we'd want that is so that on a fresh
> install from the ISO image there can be a set of services and/or
> applications installed without them needing to be pre-baked into the
> ostree. This would hopefully allow for more flexibility with the
> services and applications to be lifecycled independently of the
> operating system.
> 
> There's definitely a lot of details to sort out through the entire
> stack, but the concept of bringing Layered Images into the fold as
> compose artifacts is something I wanted to start discussing among the
> group to find out if it is needed and if so, if it's most
> appropriately handled by pungi or potentially some other tool.
> 
> Thank you,
> -AdamM
> 
> [0] https://taiga.fedorainfracloud.org/project/acarter-fedora-docker-
> atomic-tooling/us/656
> _______________________________________________
> rel-eng mailing list
> rel-eng(a)lists.fedoraproject.org
> https://lists.fedoraproject.org/admin/lists/[e-mail]
> ct.org

[Adam Miller]

On Tue, Sep 13, 2016 at 1:32 AM, Lubomír Sedlář
<lubomir.sedlar(a)gmail.com&gt; wrote:
>  Hello,
>  there is already support in Pungi to build Docker images either using
>  image-build [0] in Koji or in OSBS [1] (although Pungi talks to it
>  through Koji as well).
>
>  [0] https://docs.pagure.org/pungi/configuration.html#image-build-settin
>  gs
>  [1] https://docs.pagure.org/pungi/configuration.html#osbs-settings
>
>  These features are aimed at creating base images, but I think it should
>  not be particularly difficult to adapt the OSBS calling code to build
>  layered images as well.
>
>  I do see a couple potential issues though:
>   * rel-eng would need to maintain the configuration for which images to
>  build and from what sources – it would add extra work for them
>   * building more images in compose is going to slow it down
>   * if the image is meant to be buildable even outside of compose, we
>  would need to prevent NVR clashes 
Ah ok, this is great news. I'll just archive this card since it's not
really needed and if/when we decide we want docker content as part of
the compose we can decide how best to handle that for our use case.

Thanks,
-AdamM

>
> Cheers,
> Lubomír Sedlář
>
> Adam Miller píše v St 31. 08. 2016 v 15:56 -0500:
>> Hello all,
>>     Currently there is a ticket filed in Taiga[0] that is lacking in
>> details mostly because I'm not entirely sure what all we need in
>> there
>> so I wanted to start that discussion here.
>>
>> The motivation behind this is that we're moving towards a future
>> where
>> we are shipping content that is in the format of a Docker Layered
>> Image and I can imagine that we will want to include these as
>> installable artifacts at compose time for certain things such as
>> Atomic Host. An example of why we'd want that is so that on a fresh
>> install from the ISO image there can be a set of services and/or
>> applications installed without them needing to be pre-baked into the
>> ostree. This would hopefully allow for more flexibility with the
>> services and applications to be lifecycled independently of the
>> operating system.
>>
>> There's definitely a lot of details to sort out through the entire
>> stack, but the concept of bringing Layered Images into the fold as
>> compose artifacts is something I wanted to start discussing among the
>> group to find out if it is needed and if so, if it's most
>> appropriately handled by pungi or potentially some other tool.
>>
>> Thank you,
>> -AdamM
>>
>> [0] https://taiga.fedorainfracloud.org/project/acarter-fedora-docker-
>> atomic-tooling/us/656
>> _______________________________________________
>> rel-eng mailing list
>> rel-eng(a)lists.fedoraproject.org
>> https://lists.fedoraproject.org/admin/lists/[e-mail]
>> ct.org
> _______________________________________________
> rel-eng mailing list
> rel-eng(a)lists.fedoraproject.org
> https://lists.fedoraproject.org/admin/lists/[e-mail]