Fedora Zuul had been integrated with Testing Farm and TMT

[Miroslav Vadkerti]

Dear all,

Today we are gladly announcing that the Zuul CI system for Fedora, which is
running checks for pull requests against src.fedoraproject.org, will also
run Test Management Tool (tmt) based tests via the new `rpm-tmt-test`
check, if they are available. The test environment is the same as with
Fedora CI, as both CI systems use our Testing Farm service as the backend.

For more information about:

* Fedora Zuul: https://fedoraproject.org/w/index.php?title=Zuul-based-ci
* Test Management Tool (tmt): https://docs.fedoraproject.org/en-US/ci/tmt/

This change is opening up doors for the same functionality for the
up-coming CentOS Stream CI, once there are available images for CI, we will
enable the same check also there.

We would like to especially thank Guy Inger (Testing Farm), Fabien Boucher
(Zuul) and Tristan De Cacqueray (Zuul) for contributing to this change.

Best regards,
/M

-- 
Miroslav Vadkerti :: Senior Principal QE :: Testing Farm
IRC mvadkert #fedora-ci

[Miro Hrončok]

On 21. 07. 21 15:04, Miroslav Vadkerti wrote:
>  Dear all,
>  
>  Today we are gladly announcing that the Zuul CI system for Fedora, which is 
>  running checks for pull requests against src.fedoraproject.org 
>  <http://src.fedoraproject.org>;, will also run Test Management Tool (tmt) based 
>  tests via the new `rpm-tmt-test` check, if they are available. The test 
>  environment is the same as with Fedora CI, as both CI systems use our Testing 
>  Farm service as the backend. 
Hello Miro,
I see rpm-tmt-test FAILUREs for packages without TMT tests.

E.g.:

https://src.fedoraproject.org/rpms/pypy/pull-request/19
https://src.fedoraproject.org/rpms/pypy3/pull-request/24
https://src.fedoraproject.org/rpms/pyproject-rpm-macros/pull-request/189

-- 
Miro Hrončok
-- 
Phone: [phone]
IRC: mhroncok

[Miroslav Vadkerti]

Hi Miro,

yeah, this slipped through with the initial review. Was a Zuul
misconfiguration:

https://pagure.io/fedora-zuul-jobs-config/pull-request/129#

Fabien fixed this 3 hours ago.

It should be better on `recheck`.

Trying now ...

Best regards,
/M

On Thu, Jul 22, 2021 at 12:49 AM Miro Hrončok <mhroncok(a)redhat.com&gt; wrote:

>  On 21. 07. 21 15:04, Miroslav Vadkerti wrote:
>  > Dear all,
>  >
>  > Today we are gladly announcing that the Zuul CI system for Fedora, which
>  is
>  > running checks for pull requests against src.fedoraproject.org
>  > <http://src.fedoraproject.org>;, will also run Test Management Tool
>  (tmt) based
>  > tests via the new `rpm-tmt-test` check, if they are available. The test
>  > environment is the same as with Fedora CI, as both CI systems use our
>  Testing
>  > Farm service as the backend.
>
>  Hello Miro,
>  I see rpm-tmt-test FAILUREs for packages without TMT tests.
>
>  E.g.:
>
>  https://src.fedoraproject.org/rpms/pypy/pull-request/19
>  https://src.fedoraproject.org/rpms/pypy3/pull-request/24
>  https://src.fedoraproject.org/rpms/pyproject-rpm-macros/pull-request/189
>
>  --
>  Miro Hrončok
>  --
>  Phone: [phone]
>  IRC: mhroncok
>
>  
-- 
Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / BaseOS QE / OSCI
IRC mvadkert #tft #baseosci #osci :: GPG 0x7B5B2E95
TPB-C 2C215 :: Mobile [phone]
Red Hat Czech s.r.o, Purkyňova 115, 612 00, Brno, CR

[Miro Hrončok]

On 22. 07. 21 1:02, Miroslav Vadkerti wrote:
>  Hi Miro,
>  
>  yeah, this slipped through with the initial review. Was a Zuul misconfiguration:
>  
>  https://pagure.io/fedora-zuul-jobs-config/pull-request/129# 
>  <https://pagure.io/fedora-zuul-jobs-config/pull-request/129#>
>  
>  Fabien fixed this 3 hours ago.
>  
>  It should be better on `recheck`.
>  
>  Trying now ... 
Awesome, thanks for a fast reply!

-- 
Miro Hrončok
-- 
Phone: [phone]
IRC: mhroncok

[Miroslav Vadkerti]

FTR verified, when TMT is not around, it is now skipped:

https://fedora.softwarefactory-project.io/zuul/status/change/189,a906cee4...

On Thu, Jul 22, 2021 at 1:04 AM Miro Hrončok <mhroncok(a)redhat.com&gt; wrote:

>  On 22. 07. 21 1:02, Miroslav Vadkerti wrote:
>  > Hi Miro,
>  >
>  > yeah, this slipped through with the initial review. Was a Zuul
>  misconfiguration:
>  >
>  > https://pagure.io/fedora-zuul-jobs-config/pull-request/129#
>  > <https://pagure.io/fedora-zuul-jobs-config/pull-request/129#>
>  >
>  > Fabien fixed this 3 hours ago.
>  >
>  > It should be better on `recheck`.
>  >
>  > Trying now ...
>
>  Awesome, thanks for a fast reply!
>  
glad to help :)

Best regards,
/M


>  --
>  Miro Hrončok
>  --
>  Phone: [phone]
>  IRC: mhroncok
>
>  
-- 
Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / BaseOS QE / OSCI
IRC mvadkert #tft #baseosci #osci :: GPG 0x7B5B2E95
TPB-C 2C215 :: Mobile [phone]
Red Hat Czech s.r.o, Purkyňova 115, 612 00, Brno, CR

[Colin Walters]

On Wed, Jul 21, 2021, at 9:04 AM, Miroslav Vadkerti wrote:
>  Dear all,
>  
>  Today we are gladly announcing that the Zuul CI system for Fedora,  
Congrats!

>  which is running checks for pull requests against 
>  src.fedoraproject.org, will also run Test Management Tool (tmt) based 
>  tests via the new `rpm-tmt-test` check, if they are available. The test 
>  environment is the same as with Fedora CI, as both CI systems use our 
>  Testing Farm service as the backend.
>  
>  For more information about:
>  
>  * Fedora Zuul: https://fedoraproject.org/w/index.php?title=Zuul-based-ci
>  * Test Management Tool (tmt): https://docs.fedoraproject.org/en-US/ci/tmt/ 
I skimmed the docs and it's possible I'm missing it, but do you have
some links to recent nontrivial projects that are using this?  
The tmt docs show me how to run e.g. `bash --version` which isn't
very compelling.  I am particularly interested in things that reuse upstream CI tests.

(If Fedora used a unified git repo, I could easily just grep it, but...)

[Miro Hrončok]

On 27. 07. 21 20:37, Colin Walters wrote:
>  (If Fedora used a unified git repo, I could easily just grep it,
> but...) 
Here you go, it is 12 GB:

https://src.fedoraproject.org/repo/git-seed-latest.tar.xz

-- 
Miro Hrončok
-- 
Phone: [phone]
IRC: mhroncok