Hello,
we got to a point when we have Travis CI tests pass both with FreeIPA
containers under docker, and under podman:
https://travis-ci.org/freeipa/freeipa-container/branches
I'm now trying to decide which setup we should run in CI going
forward.
Each test takes about 30 minutes and while we run 8 of them lately,
at least two more are turned off (rawhide due to
https://bugzilla.redhat.com/show_bug.cgi?id=1747901 and read-write
Fedora 30 due to https://bugzilla.redhat.com/show_bug.cgi?id=1755643)
and we will want to add CentOS 8 to the mix once the base container
images are out. So we are close to a dozen of tests. We run
internal + external CA at least for one stable Fedora release, and
I like to keep the read-write setup in the mix if possible, as it
allows us to find new stuff that should go to persistent storage
with docker diff (which would obviously not work on read-only container).
Multiplying that by two, testing both docker and podman, does not
seem practical.
We could save some time by running tests/run-master-and-replica.sh
first and only running tests/run-partial-tests.sh when the first one
fails. On the other hand, we currently do not run cross version
upgrades in CI, we just force the upgrade code path but with the
same image. So if we added that, we'd increase the needed runtime
again.
Docker seems dead on Fedoras as the moby-engine's maintenance stopped
in the middle of July:
https://bugzilla.redhat.com/buglist.cgi?classification=Fedora&component=mob…
On the other hand, judging by the issues that we've seen reported,
people run the FreeIPA server containers on other OSes and there
dockers in various versions are still more common than podman.
We could save on the running time by moving some of the tests
to other CI like CircleCI but I like having overview of all CI tests
on one place, and another CI system would break that. On the other
hand, for ARM we will likely need to add Shippable to the mix anyway.
I'd appreciate your opinions and suggestions about testing the
FreeIPA container upstream going forward.
--
Jan Pazdziora
Senior Principal Software Engineer, Security Engineering, Red Hat
URL: https://github.com/freeipa/freeipa/pull/3760
Author: netoarmando
Title: #3760: [ipa-4-8] prci: increase timeout for jobs that required AD
Action: opened
PR body:
"""
Vagrant retries to provision hosts if something happens, it was introduced
in PR-CI after https://github.com/freeipa/freeipa-pr-ci/commit/380c8b8c78a1ce277b7c1a327bd….
This takes time, some jobs are killed during test execution, so this
increases the time-out parameter from 1 hour and 20 minutes to 2 hours.
Signed-off-by: Armando Neto <abiagion(a)redhat.com>
"""
To pull the PR as Git branch:
git remote add ghfreeipa https://github.com/freeipa/freeipa
git fetch ghfreeipa pull/3760/head:pr3760
git checkout pr3760
URL: https://github.com/freeipa/freeipa/pull/3759
Author: netoarmando
Title: #3759: prci: increase timeout for jobs that required AD
Action: opened
PR body:
"""
Vagrant retries to provision hosts if something happens, it was introduced
in PR-CI after https://github.com/freeipa/freeipa-pr-ci/commit/380c8b8c78a1ce277b7c1a327bd….
This takes time, some jobs are killed during test execution, so this
increases the time-out parameter from 1 hour and 20 minutes to 2 hours.
Signed-off-by: Armando Neto <abiagion(a)redhat.com>
"""
To pull the PR as Git branch:
git remote add ghfreeipa https://github.com/freeipa/freeipa
git fetch ghfreeipa pull/3759/head:pr3759
git checkout pr3759
URL: https://github.com/freeipa/freeipa/pull/3761
Author: netoarmando
Title: #3761: [ipa-4-7] prci: increase timeout for jobs that required AD
Action: opened
PR body:
"""
Vagrant retries to provision hosts if something happens, it was introduced
in PR-CI after https://github.com/freeipa/freeipa-pr-ci/commit/380c8b8c78a1ce277b7c1a327bd….
This takes time, some jobs are killed during test execution, so this
increases the time-out parameter from 1 hour to 2 hours.
Signed-off-by: Armando Neto <abiagion(a)redhat.com>
"""
To pull the PR as Git branch:
git remote add ghfreeipa https://github.com/freeipa/freeipa
git fetch ghfreeipa pull/3761/head:pr3761
git checkout pr3761
URL: https://github.com/freeipa/freeipa/pull/3755
Author: rcritten
Title: #3755: [Backport][ipa-4-8] ipatests: File ownership and permission for dirsrv log instance after restore
Action: opened
PR body:
"""
This PR was opened automatically because PR #3732 was pushed to master and backport to ipa-4-8 is required.
"""
To pull the PR as Git branch:
git remote add ghfreeipa https://github.com/freeipa/freeipa
git fetch ghfreeipa pull/3755/head:pr3755
git checkout pr3755
URL: https://github.com/freeipa/freeipa/pull/3754
Author: Tiboris
Title: #3754: [Backport][ipa-4-6] ipatests: fix test_replica_promotion.py::TestHiddenReplicaPromotion
Action: opened
PR body:
"""
This PR was opened automatically because PR #3742 was pushed to master and backport to ipa-4-6 is required.
"""
To pull the PR as Git branch:
git remote add ghfreeipa https://github.com/freeipa/freeipa
git fetch ghfreeipa pull/3754/head:pr3754
git checkout pr3754
URL: https://github.com/freeipa/freeipa/pull/3753
Author: Tiboris
Title: #3753: [Backport][ipa-4-7] ipatests: fix test_replica_promotion.py::TestHiddenReplicaPromotion
Action: opened
PR body:
"""
This PR was opened automatically because PR #3742 was pushed to master and backport to ipa-4-7 is required.
"""
To pull the PR as Git branch:
git remote add ghfreeipa https://github.com/freeipa/freeipa
git fetch ghfreeipa pull/3753/head:pr3753
git checkout pr3753
URL: https://github.com/freeipa/freeipa/pull/3752
Author: Tiboris
Title: #3752: [Backport][ipa-4-8] ipatests: fix test_replica_promotion.py::TestHiddenReplicaPromotion
Action: opened
PR body:
"""
This PR was opened automatically because PR #3742 was pushed to master and backport to ipa-4-8 is required.
"""
To pull the PR as Git branch:
git remote add ghfreeipa https://github.com/freeipa/freeipa
git fetch ghfreeipa pull/3752/head:pr3752
git checkout pr3752