docker version in CoreOS and Fedora CoreOS

[Axel Heindrichs]

Hi there, 

We are following CoreOS CL with great interest, as we are running all our k8s clusters on
CoreOS (both VMware and bare metal). However we decided against CoreOS for one specialised
Data Science bare metal cluster, based on blades with GPUs, as CoreOS still ships with
docker 18.06.3. NVIDIA GPUs are natively supported as devices in the Docker runtime as
from version 19.03.
Is there a plan to move to a higher version of docker in CoreOS? 19.03 or at least 18.09?
What is the plan for Fedora CoreOS in this respect?
Is it possible to replace/upgrade the version of docker in CoreOS ourselves?
I would be really grateful for an answer.
Kind regards
Axel

[Dusty Mabe]

On 12/12/19 9:30 AM, Axel Heindrichs wrote:
>  Hi there, 
Hi Axel,

>  
>  We are following CoreOS CL with great interest, as we are running all our k8s clusters on
> CoreOS (both VMware and bare metal). However we decided against CoreOS for one specialised
> Data Science bare metal cluster, based on blades with GPUs, as CoreOS still ships with
> docker 18.06.3. NVIDIA GPUs are natively supported as devices in the Docker runtime as
> from version 19.03.
>  Is there a plan to move to a higher version of docker in CoreOS? 19.03 or at least 18.09?
I don't know what the plans are for new docker versions in Container Linux.

>  What is the plan for Fedora CoreOS in this respect? 
Right now we have moby-engine (docker) 18.09 in Fedora CoreOS. It will probably be
the next major fedora release (~April 2020) before that gets bumped higher.

>  Is it possible to replace/upgrade the version of docker in CoreOS
> ourselves? 
I don't know about Container Linux. For Fedora CoreOS you *could* package layer
a different version rpm on top, but it might make Operating System updates less
reliable.

> I would be really grateful for an answer.
> Kind regards
> Axel

[Nick Stielau]

Thanks Dusty.

What's the latest on including Podman in Fedora CoreOS?

Axel, have you looked into podman at all?  It is a drop-in replacement for
docker in most cases, and should be flexible enough to do what you what,
but we might need to ask on podman mailing list for anything specifics.

-Nick

On Thu, Dec 12, 2019 at 8:24 AM Dusty Mabe <dusty(a)dustymabe.com&gt; wrote:

>  On 12/12/19 9:30 AM, Axel Heindrichs wrote:
>  > Hi there,
>
>  Hi Axel,
>
>  >
>  > We are following CoreOS CL with great interest, as we are running all
>  our k8s clusters on CoreOS (both VMware and bare metal). However we decided
>  against CoreOS for one specialised Data Science bare metal cluster, based
>  on blades with GPUs, as CoreOS still ships with docker 18.06.3. NVIDIA GPUs
>  are natively supported as devices in the Docker runtime as from version
>  19.03.
>  > Is there a plan to move to a higher version of docker in CoreOS? 19.03
>  or at least 18.09?
>
>  I don't know what the plans are for new docker versions in Container Linux.
>
>  > What is the plan for Fedora CoreOS in this respect?
>
>  Right now we have moby-engine (docker) 18.09 in Fedora CoreOS. It will
>  probably be
>  the next major fedora release (~April 2020) before that gets bumped higher.
>
>  > Is it possible to replace/upgrade the version of docker in CoreOS
>  ourselves?
>
>  I don't know about Container Linux. For Fedora CoreOS you *could* package
>  layer
>  a different version rpm on top, but it might make Operating System updates
>  less
>  reliable.
>
>  > I would be really grateful for an answer.
>  > Kind regards
>  > Axel
>  _______________________________________________
>  CoreOS mailing list -- coreos(a)lists.fedoraproject.org
>  To unsubscribe send an email to coreos-leave(a)lists.fedoraproject.org
>  Fedora Code of Conduct:
>  https://docs.fedoraproject.org/en-US/project/code-of-conduct/
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
>  https://lists.fedoraproject.org/archives/list/[e-mail]
>  

-- 
-----
Nick Stielau
He/Him/His
SFO, OpenShift

[Dusty Mabe]

On 12/12/19 11:50 AM, Nick Stielau wrote:
>  Thanks Dusty.
>  
>  What's the latest on including Podman in Fedora CoreOS? 
podman is in Fedora CoreOS and is a replacement for the docker CLI.

>  
>  Axel, have you looked into podman at all?  It is a drop-in replacement for docker in most
> cases, and should be flexible enough to do what you what, but we might need to ask on
> podman mailing list for anything specifics. 

Since Axel is running kubernetes he'll most likely want to consider
the GPU support in CRI-O (alternative K8s runtime), rather than podman
as an alternative to docker. We might have some CRI-O experts that
could weigh in on the GPU support there.

> 
> -Nick
> 
> On Thu, Dec 12, 2019 at 8:24 AM Dusty Mabe <dusty(a)dustymabe.com
<mailto:[e-mail]>> wrote:
> 
> 
> 
>     On 12/12/19 9:30 AM, Axel Heindrichs wrote:
>     > Hi there,
> 
>     Hi Axel,
> 
>     >
>     > We are following CoreOS CL with great interest, as we are running all our
k8s clusters on CoreOS (both VMware and bare metal). However we decided against CoreOS for
one specialised Data Science bare metal cluster, based on blades with GPUs, as CoreOS
still ships with docker 18.06.3. NVIDIA GPUs are natively supported as devices in the
Docker runtime as from version 19.03.
>     > Is there a plan to move to a higher version of docker in CoreOS? 19.03 or at
least 18.09?
> 
>     I don't know what the plans are for new docker versions in Container Linux.
> 
>     > What is the plan for Fedora CoreOS in this respect?
> 
>     Right now we have moby-engine (docker) 18.09 in Fedora CoreOS. It will probably
be
>     the next major fedora release (~April 2020) before that gets bumped higher.
> 
>     > Is it possible to replace/upgrade the version of docker in CoreOS
ourselves?
> 
>     I don't know about Container Linux. For Fedora CoreOS you *could* package
layer
>     a different version rpm on top, but it might make Operating System updates less
>     reliable.
> 
>     > I would be really grateful for an answer.
>     > Kind regards
>     > Axel
>     _______________________________________________
>     CoreOS mailing list -- coreos(a)lists.fedoraproject.org
<mailto:[e-mail]>
>     To unsubscribe send an email to coreos-leave(a)lists.fedoraproject.org
<mailto:[e-mail]>
>     Fedora Code of Conduct:
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
>     List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>     List Archives:
https://lists.fedoraproject.org/archives/list/[e-mail]
> 
> 
> 
> -- 
> -----
> Nick Stielau
> He/Him/His
> SFO, OpenShift
> 
> _______________________________________________
> CoreOS mailing list -- coreos(a)lists.fedoraproject.org
> To unsubscribe send an email to coreos-leave(a)lists.fedoraproject.org
> Fedora Code of Conduct:
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
https://lists.fedoraproject.org/archives/list/[e-mail]
>

[Zvonko Kaiser]

If you want to use GPUs with CoreOS and Docker 18.06.3 you need to use the following:
https://github.com/NVIDIA/nvidia-container-runtime, which installs a custom runtime and a
prestart hook that is called by this runtime to enable GPUs in the container. 

I wouldn't call the GPU support that comes with  Docker 19.03 , "native",
the only thing that this Docker version is doing is calling the nvidia-prestart-hook
without the need to install the custom runtime. It is a hardcoded call of the prestart
hook in containerd.

If you use GPUs with Fedora CoreOS, you only need to install the nvidia-prestart-hook, the
Docker version that comes with Fedora can natively execute any prestart hooks (all OCI
hooks are supported). Fedora or RHELs version of Docker use runC as the runtime.

[Axel Heindrichs]

thanks a lot to you all for your quick replies