- CI [ARCHIVED] - Fedora mailing-lists

[release] Testing Farm 2025-06.1
by Jan Havlin 18 Jul '25

18 Jul '25

Testing Farm release 2025-06.1 <https://docs.testing-farm.io/Testing%20Farm/0.1/releases/2025-06.1.html> was deployed on 2025-07-15 🎉. <https://docs.testing-farm.io/Testing%20Farm/0.1/releases/2025-06.1.html#_up…>🚀 Upgrades tmt <https://tmt.readthedocs.org> was updated to 1.52 <https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-52>. Testing Farm CLI <https://docs.testing-farm.io/Testing%20Farm/0.1/cli.html> tool was updated to v0.0.25 <https://gitlab.com/testing-farm/cli/-/releases/v0.0.25>, please update your installation. Artemis <https://gitlab.com/testing-farm/artemis/> was updated to v0.0.77 <https://gitlab.com/testing-farm/artemis/-/releases/v0.0.77> on both ranches. Released and upgraded standard-test-roles to 4.13. (TFT-3483 <https://issues.redhat.com/browse/TFT-3483>) <https://docs.testing-farm.io/Testing%20Farm/0.1/releases/2025-06.1.html#_br…>💔 Breaking changes The RHEL CI now defaults to setting TMT_SCRIPTS_DIR to /var/lib/tmt/scripts. This is required for package mode to image mode conversion to work in gating tests for testing Image Mode RHEL. Please note that means if your tests reference rhts-* or tmt-* scripts using an absolute path, they might fail. Please rely on $PATH when using these scripts. <https://docs.testing-farm.io/Testing%20Farm/0.1/releases/2025-06.1.html#_hi…>🎯 Highlights Kickstart installation in AWS is live for RHEL8+. If the requests use kickstart field, they will be mostly served by AWS. If you require beaker to be used, force the beaker Testing Farm pool in your requests. (TFT-2135 <https://issues.redhat.com/browse/TFT-2135>) First version of Image Mode testing in RHEL CI and Fedora CI is available using the package mode to image mode conversion. See our sanity test <https://gitlab.com/testing-farm/tests/-/blob/main/testing-farm/bootc-instal…> for an example for Fedora. Testing Farm is now supporting installing all supported artifacts in Image Mode. Note that there are no repositories with artifacts added to the system. This Image Mode testing is not yet supported in RHEL CI. IBM cloud s390x is now enabled for RHEL-8, RHEL-9 and RHEL-10 composes by default. <https://docs.testing-farm.io/Testing%20Farm/0.1/releases/2025-06.1.html#_im…>🚀 Improvements Added support for running tests with kickstart with other pools than just Beaker. (TFT-2135 <https://issues.redhat.com/browse/TFT-2135>) Added support for soft/hard reboot command in tmt artemis plugin. (TFT-2997 <https://issues.redhat.com/browse/TFT-2997>) Implemented SIGUSR2 pipeline timeout handling in gluetool. (TFT-3451 <https://issues.redhat.com/browse/TFT-3451>) Added support to link to a particular test suite or test case in Oculus. ( TFT-2757 <https://issues.redhat.com/browse/TFT-2757>) Enabled RHEL-10.1 gating in BaseOS CI and Testing Farm. (TFT-3100 <https://issues.redhat.com/browse/TFT-3100>) Introduced a new tmt package manager which performs 'install' via Containerfile. (TFT-3177 <https://issues.redhat.com/browse/TFT-3177>) Set TMT_SCRIPTS_DIR by default in RHEL CI pipelines. (TFT-3494 <https://issues.redhat.com/browse/TFT-3494>) Added support for CPU flags and CPU stepping to testing-farm CLI. (TFT-2588 <https://issues.redhat.com/browse/TFT-2588>) Added link to tmt web service from Oculus to each test suite and test case. (TFT-2853 <https://issues.redhat.com/browse/TFT-2853>) Started importing updates-nightly composes more often. (TFT-3016 <https://issues.redhat.com/browse/TFT-3016>) Added support for pagination in API for requests endpoint. (TFT-3143 <https://issues.redhat.com/browse/TFT-3143>) Deployed tmt web in production in public. (TFT-3206 <https://issues.redhat.com/browse/TFT-3206>) Added test contact information to results.xml. (TFT-2579 <https://issues.redhat.com/browse/TFT-2579>) Added printing of reservation time from the reserved machine. (TFT-2592 <https://issues.redhat.com/browse/TFT-2592>) Set up proper CI for the Tekton pipeline. (TFT-2900 <https://issues.redhat.com/browse/TFT-2900>) Added parameters for all testing-farm CLI options. (TFT-3005 <https://issues.redhat.com/browse/TFT-3005>) <https://docs.testing-farm.io/Testing%20Farm/0.1/releases/2025-06.1.html#_do…>📃 Documentation Added documentation for Konflux CI integration <https://gitlab.com/testing-farm/integrations-konflux/-/blob/main/README.adoc>. (TFT-3006 <https://issues.redhat.com/browse/TFT-3006>) Updated the Konflux docs to point to TF repo. (TFT-2902 <https://issues.redhat.com/browse/TFT-2902>) <https://docs.testing-farm.io/Testing%20Farm/0.1/releases/2025-06.1.html#_bu…>🐞 Bugfixes Disabled package guest setup for bootc image mode. (TFT-3028 <https://issues.redhat.com/browse/TFT-3028>) Fixed failure of installing requested artifacts being silently ignored. ( TFT-3046 <https://issues.redhat.com/browse/TFT-3046>) Fixed request being still in 'progress' but testing has been finished. ( TFT-3073 <https://issues.redhat.com/browse/TFT-3073>) Fixed missing extend-reservation and return2testingfarm in image-mode. ( TFT-3089 <https://issues.redhat.com/browse/TFT-3089>) Fixed bare-metal Beaker system request not being honored. (TFT-3182 <https://issues.redhat.com/browse/TFT-3182>) Fixed archived job with lacking many expected artifacts. (TFT-3217 <https://issues.redhat.com/browse/TFT-3217>) Fixed changing request from state 'canceled' to 'error'. (TFT-3292 <https://issues.redhat.com/browse/TFT-3292>) Fixed install prepare step without exclude causing all other excludes to be ignored. (TFT-3360 <https://issues.redhat.com/browse/TFT-3360>) Fixed hostname contain . (dot) in AWS machine. (TFT-2805 <https://issues.redhat.com/browse/TFT-2805>) Make Testing Farm API user delete endpoint also delete all its tokens. ( TFT-3128 <https://issues.redhat.com/browse/TFT-3128>) Fixed reserved system being released after a tmt-reboot from tmt -h connect session. (TFT-3199 <https://issues.redhat.com/browse/TFT-3199>) When reading .testing-farm.yaml file, search through all secrets instead of exiting on first mismatch. (TFT-3238 <https://issues.redhat.com/browse/TFT-3238>) Fixed TFT tag repository using incorrect RHEL release. (TFT-3409 <https://issues.redhat.com/browse/TFT-3409>) Fixed testsuite.guest elements missing in multihost results.xml. (TFT-3464 <https://issues.redhat.com/browse/TFT-3464>) Fixed installation modules not creating artifacts repository before installing. (TFT-2535 <https://issues.redhat.com/browse/TFT-2535>) Fixed kickstart option not escaping newlines correctly in testing-farm CLI. (TFT-3340 <https://issues.redhat.com/browse/TFT-3340>) <https://docs.testing-farm.io/Testing%20Farm/0.1/releases/2025-06.1.html#_pa…>📦️ Packages List of important packages bundled in the worker image. ❯ podman run --entrypoint rpm quay.io/testing-farm/worker-public:2025-06.1 -q fmf tmt standard-test-roles ansible-core podman beakerlib | sort | uniq ansible-core-2.16.14-2.fc41.noarch beakerlib-1.31.4-1.fc41.noarch fmf-1.7.0-1.fc41.noarch podman-5.5.2-1.fc41.x86_64 standard-test-roles-4.13-1.fc41.noarch tmt-1.53.0.dev1+gc660edbb-1.20250714210017883114.pr3879.1.gc660edbb.fc41.noarch (note: hot-patched tmt-1.52 with a regression) <https://docs.testing-farm.io/Testing%20Farm/0.1/releases/2025-06.1.html#_st…>🔎 Stats Testing Farm is on track to surpass 1.8M requests per year <https://stats.testing-farm.io/d/dpYooDIVk/testing-farm-all-time-stats> \o/. The average error rate for Testing Farm was approximately 3.54% <http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?orgId=1&refresh=1m&…> On behalf of Testing Farm Team Jan Havlin

1 0

[release] Testing Farm 2025-01.8
by Miroslav Vadkerti 28 May '25

28 May '25

Testing Farm release 2025-01.8 <https://docs.testing-farm.io/Testing%20Farm/0.1/releases/2025-01.8.html> was deployed on 2025-05-28. *💔 Breaking Changes* To reboot a reserved machine via Testing Farm, use the `reboot` command now. Due to changes in the reservation test, the `tmt-reboot` command no longer works. The `motd` of the reserved machine was updated to reflect the correct command. (testing-farm/tests!62 <https://gitlab.com/testing-farm/tests/-/merge_requests/62>) *🚀 Upgrades* tmt <https://tmt.readthedocs.org> was updated to 1.49 <https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-49-0> from 1.47. *🐞 Bugfixes* The results-junit.xml file now contains only the test output in the <system-out> XML element. Previously, the contents of all test case log files, including binary blobs, were included in certain cases. ( testing-farm/gluetool-modules!945 <https://gitlab.com/testing-farm/gluetool-modules/-/merge_requests/945/diffs…> ) *📦️ Packages* List of important packages bundled in the worker image. ❯ podman run --entrypoint rpm quay.io/testing-farm/worker-public:2025-01.8 -q fmf tmt standard-test-roles ansible-core podman beakerlib | sort | uniq ansible-core-2.16.14-1.fc41.noarch beakerlib-1.31.4-1.fc41.noarch fmf-1.7.0-1.fc41.noarch podman-5.5.0-1.fc41.x86_64 standard-test-roles-4.12-1.fc41.noarch tmt-1.49.0-1.fc41.noarch On behalf of the Testing Farm Team, /M -- 🧑‍🔧 Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / Linux QE 🎩 Red Hat Slack :: mvadkert :: #testing-farm #tmt 📱 Fedora Matrix :: mvadkert :: #Fedora CI 🌍️ Remote Czech Republic :: Red Hat Czech s.r.o

1 0

[release] Testing Farm 2025-01.7
by Miroslav Vadkerti 21 May '25

21 May '25

Testing Farm release 2025-01.7 <https://docs.testing-farm.io/Testing%20Farm/0.1/releases/2025-01.7.html> was deployed on 2025-05-20. *💔 Breaking changes* This release is introducing hard memory limits on our worker containers, possibly affecting some requests. In case you hit the problem, you should discover that easily from the request error. The request error will link you to our error TFE-1 <https://docs.testing-farm.io/Testing%20Farm/0.1/errors.html#TFE-1[> for information how to deal with the problem. *🐞 Bugfixes* Testing Farm workers are now correctly enforcing a memory limit for worker containers, greatly improving stability of all requests and mitigating requests to get stuck in `running` state. This can be breaking for some of the tests, see the 'Breaking changes' section for details. (TFT-3333 <https://issues.redhat.com/browse/TFT-3333> TFT-3334 <https://issues.redhat.com/browse/TFT-3334> TFT-3338 <https://issues.redhat.com/browse/TFT-3338> TFT-1762 <https://issues.redhat.com/browse/TFT-1762>) Testing Farm now uses by default non-spot instances in AWS. Due to the elevated usage of dedicated Testing Farm instances <https://docs.testing-farm.io/Testing%20Farm/0.1/test-request.html#_dedicate…>, the spot instances are terminated more frequently, causing random test failures. Until we are able to handle this problem gracefully, i.e. by automatically restarting the affected requests, we decided to move the testing to non-spot instances. This will affect the cost of testing, but we do not expect the change to have large impact. We will be monitoring the situation going forward. (TFT-3371 <https://issues.redhat.com/browse/TFT-3371>) A bug in upstream dramatiq <https://github.com/Bogdanp/dramatiq/pull/707> was found and patch in Artemis provisioner, greatly improving the stability of provisioning and mitigate outages. (TFT-3331 <https://issues.redhat.com/browse/TFT-3331>) The `pool` field under the provision step in tmt plans is now honored in the single-host pipelines. (TFT-3368 <https://issues.redhat.com/browse/TFT-3368>) *📦️ Packages* List of important packages bundled in the worker image. ❯ podman run --entrypoint rpm quay.io/testing-farm/worker-public:2025-01.7 -q fmf tmt standard-test-roles ansible-core podman beakerlib | sort | uniq tmt-1.47.0-1.fc40.noarch ansible-core-2.16.14-1.fc40.noarch beakerlib-1.31.4-1.fc40.noarch fmf-1.7.0-1.fc40.noarch podman-5.4.2-1.fc40.x86_64 standard-test-roles-4.11-3.fc40.noarch tmt-1.47.0-1.fc40.noarch On behalf of the Testing Farm Team, /M -- 🧑‍🔧 Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / Linux QE 🎩 Red Hat Slack :: mvadkert :: #testing-farm #tmt 📱 Fedora Matrix :: mvadkert :: #Fedora CI 🌍️ Remote Czech Republic :: Red Hat Czech s.r.o

1 0

[release] Testing Farm 2025-01.6
by Miroslav Vadkerti 30 Apr '25

30 Apr '25

Hi, Testing Farm release 2025-01.6 <https://docs.testing-farm.io/Testing%20Farm/0.1/releases/2025-01.6.html> was deployed on 2025-04-30. *🚀 Upgrades* tmt <https://tmt.readthedocs.org> was updated to 1.47 <https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-47-0>. This update introduces a native package installation method for Image Mode, where tmt creates derived images for each prepare step based on the booted image, and reboots the system into the new configuration after each prepare step. This should gradually improve installation issues of test dependencies in Image Mode. *🐞 Bugfixes* Fix an issue in archiving causing unnecessary archivation of the same artifacts after testing, significantly prolonging the archivation time and delaying the requests from reaching the `complete` state. (TFT-3299 <https://issues.redhat.com/browse/TFT-3299>). Improve memory usage by limiting the output of tests in `results-junit-xml` to 10MiB. For very large requests, this issue was impacting the stability of Testing Farm, causing the worker nodes to go OOM, which affected the stability of other jobs that got stuck in the `running` state. (TFT-3175 <https://issues.redhat.com/browse/TFT-3175>) Mitigate an issue during request cancellation that caused provisioned resources to not be cleaned up properly. (TFT-3300 <https://issues.redhat.com/browse/TFT-3300>) The pipeline timeout is now correctly honored by our provisioner, making it possible to wait for scarce resources for days. Previously, provisioning could fail earlier than the pipeline timeout setting. (TFT-3042 <https://issues.redhat.com/browse/TFT-3042>) *📦️ Packages* List of important packages bundled in the worker image. ❯ podman run --entrypoint rpm quay.io/testing-farm/worker-public:2025-01.6 -q fmf tmt standard-test-roles ansible-core podman beakerlib | sort | uniq ansible-core-2.16.14-1.fc40.noarch beakerlib-1.31.4-1.fc40.noarch fmf-1.7.0-1.fc40.noarch podman-5.4.2-1.fc40.x86_64 standard-test-roles-4.11-3.fc40.noarch tmt-1.47.0-1.fc40.noarch 📊*️ Stats* Testing Farm is projected to reach 1.8 million test requests <https://stats.testing-farm.io/d/dpYooDIVk/testing-farm-all-time-stats?orgId…> this year. On the behalf of Testing Farm Team, /M -- 🧑‍🔧 Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / Linux QE 🎩 Red Hat Slack :: mvadkert :: #testing-farm #tmt 📱 Fedora Matrix :: mvadkert :: #Fedora CI 🌍️ Remote Czech Republic :: Red Hat Czech s.r.o

1 0

[release] Testing Farm 2025-01.3
by Miroslav Vadkerti 14 Mar '25

14 Mar '25

Hi, Testing Farm release 2025-01.3 <https://docs.testing-farm.io/Testing%20Farm/0.1/releases/2025-01.3.html> was deployed on 2025-03-14 🎉. *🚀 Upgrades* tmt <https://tmt.readthedocs.org/> was updated to 1.44 <https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-44>. fmf <https://fmf.readthedocs.org/> was updated to 1.7.0 <https://fmf.readthedocs.io/en/stable/releases.html#fmf-1-7-0>. *🐞 Bugfixes* Fix issue with requests being stuck in progress. (TFT-2564 <https://issues.redhat.com/browse/TFT-2564>). *📦️ Packages* List of important packages bundled in the worker image. ❯ podman run --entrypoint rpm quay.io/testing-farm/worker-public:2025-01.3 -q fmf tmt standard-test-roles ansible-core podman beakerlib | sort | uniq ansible-core-2.16.14-1.fc40.noarch beakerlib-1.31.4-1.fc40.noarch fmf-1.7.0-1.fc40.noarch podman-5.4.0-1.fc40.x86_64 standard-test-roles-4.11-3.fc40.noarch tmt-1.44.0-1.fc40.noarch On the behalf of Testing Farm Team, /M -- 🧑‍🔧 Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / Linux QE 🎩 Red Hat Slack :: mvadkert :: #testing-farm #tmt 📱 Fedora Matrix :: mvadkert :: #Fedora CI 🌍️ Remote Czech Republic :: Red Hat Czech s.r.o

1 0

[release] Testing Farm 2025-01.2
by Jan Havlin 27 Feb '25

27 Feb '25

Testing Farm release 2025-01.1 was deployed on 2025-02-05 and release 2025-01.2 on 2025-02-27 🎉. See release notes for both versions. 🚀 Upgrades Testing Farm CLI <https://docs.testing-farm.io/Testing%20Farm/0.1/cli.html> tool was updated to v0.0.23 <https://gitlab.com/testing-farm/cli/-/releases/v0.0.23>, please update your installation. Artemis <https://gitlab.com/testing-farm/artemis/> was updated to v0.0.74 <https://gitlab.com/testing-farm/artemis/-/releases/v0.0.74> on both ranches. tmt <https://tmt.readthedocs.org> was updated to 1.43 <https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-43>. 🎯 Highlights Added support for RHEL Image Mode images in Testing Farm (AWS, Openstack) ( TFT-2787 <https://issues.redhat.com/browse/TFT-2787>). See documentation <https://docs.testing-farm.io/Testing%20Farm/0.1/rfd/rfd5-testing-image-mode…> for list of supported composes. Implemented first version of RFD2 - Testing Farm Repository Configuration <https://docs.testing-farm.io/Testing%20Farm/0.1/rfd/rfd2-testing-farm-repo-…> (TFT-2472 <https://issues.redhat.com/browse/TFT-2472>) with first version including secrets support. See documentation <https://docs.testing-farm.io/Testing%20Farm/0.1/test-request.html#secrets-i…> on how to use it. The testing-farm CLI is now packaged and available in copr repositories @testing-farm/stable <https://copr.fedorainfracloud.org/coprs/g/testing-farm/stable/package/testi…> and @testing-farm/latest <https://copr.fedorainfracloud.org/coprs/g/testing-farm/latest/package/testi…> (TFT-2801 <https://issues.redhat.com/browse/TFT-2801>). Added support for system reservation after testing (TFT-2291 <https://issues.redhat.com/browse/TFT-2291>). 🚀 Improvements Added tmt subresults to TF’s results.xml (TFT-2841 <https://issues.redhat.com/browse/TFT-2841>). Onboarded RHEL-10.0 image mode to Testing Farm (TFT-3092 <https://issues.redhat.com/browse/TFT-3092>). Onboarded Fedora-42 (TFT-3121 <https://issues.redhat.com/browse/TFT-3121>). Add list of files uploaded to by the test as links on results.xml (TFT-2645 <https://issues.redhat.com/browse/TFT-2645>). Extend CLI option --redhat-brew-build so it can also consume NVR (TFT-2880 <https://issues.redhat.com/browse/TFT-2880>). Add "whoami" query on the API (TFT-2537 <https://issues.redhat.com/browse/TFT-2537>). Add Artemis driver for Power infra (ppc64) (TFT-2876 <https://issues.redhat.com/browse/TFT-2876>). Add support for expanding phases in oculus (TFT-2930 <https://issues.redhat.com/browse/TFT-2930>). Skipped test suite should be visible in results.xml and oculus (TFT-2869 <https://issues.redhat.com/browse/TFT-2869>). Display result of each check and subresult in oculus (oculus!78 <https://gitlab.com/testing-farm/oculus/-/merge_requests/78>). Worker image option is now narrowed down to specific images (TFT-2976 <https://issues.redhat.com/browse/TFT-2976>). 📃 Documentation Added example how to easily enable sos-report in the finish step (docs!169 <https://gitlab.com/testing-farm/docs/root/-/merge_requests/169>). 🐞 Bugfixes Fix CentOS 10 images having Fedora 40 repository (TFT-2564 <https://issues.redhat.com/browse/TFT-2564>). Fix inconsistent test result between API request and artifacts web page ( TFT-2660 <https://issues.redhat.com/browse/TFT-2660>). Add repository normalization to present consistent naming and content ( TFT-2763 <https://issues.redhat.com/browse/TFT-2763>). Fix guest event log is gone from artifacts (TFT-2874 <https://issues.redhat.com/browse/TFT-2874>). Fix parallel archiving stopping working (TFT-2917 <https://issues.redhat.com/browse/TFT-2917>). Fix incorrect error: Ansible playbook execution (TFT-2439 <https://issues.redhat.com/browse/TFT-2439>). Fix missing test results not triggering error (TFT-3021 <https://issues.redhat.com/browse/TFT-3021>). Fix stuck threads in worker (TFT-3086 <https://issues.redhat.com/browse/TFT-3086>). Fix submitting a request without test.sti or test.fmf causing API outage ( TFT-3102 <https://issues.redhat.com/browse/TFT-3102>). Fix testing-farm restart not honoring tmt path (TFT-2719 <https://issues.redhat.com/browse/TFT-2719>). Fix compose building of some rhel-8 and rhel-9 images (TFT-3009 <https://issues.redhat.com/browse/TFT-3009>). Fix rendering skipped checks in oculus (TFT-3103 <https://issues.redhat.com/browse/TFT-3103>). Fix rendering notes as a list in oculus (oculus!75 <https://gitlab.com/testing-farm/oculus/-/merge_requests/75>). Fix rendering empty subresults in oculus (oculus!78 <https://gitlab.com/testing-farm/oculus/-/merge_requests/78>). 📦️ Packages List of important packages bundled in the worker image. ❯ podman run --entrypoint rpm quay.io/testing-farm/worker-public:2025-01.2 -q fmf tmt standard-test-roles ansible-core podman beakerlib | sort | uniq ansible-core-2.16.14-1.fc40.noarch beakerlib-1.31.4-1.fc40.noarch fmf-1.6.1-1.fc40.noarch podman-5.3.1-1.fc40.x86_64 standard-test-roles-4.11-3.fc40.noarch tmt-1.43.0-1.fc40.noarch 🔎 Stats Testing Farm is on track to surpass 1.8M requests per year <https://stats.testing-farm.io/d/dpYooDIVk/testing-farm-all-time-stats> \o/. The average error rate for Testing Farm was approximately 4.06% <http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?orgId=1&refresh=1m&…> .

1 0

[release] Testing Farm 2024-10.7
by Miroslav Vadkerti 21 Jan '25

21 Jan '25

Hi, Testing Farm release 2024-10.7 was deployed on 2025-01-21 🎉. *🚀 Upgrades* tmt <https://tmt.readthedocs.org/> was updated to 1.41 <https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-41>. fmf <https://fmf.readthedocs.org/> was updated to 1.6.1 <https://fmf.readthedocs.io/en/stable/releases.html#fmf-1-6-1>. *🐞 Bugfixes* Fix issue causing requests to stuck in running state and outdated logs. ( TFT-3086 <https://issues.redhat.com/browse/TFT-3086>) *📦️ Packages* List of important packages bundled in the worker image. ❯ podman run --entrypoint rpm quay.io/testing-farm/worker-public:2024-10.7 -q fmf tmt standard-test-roles ansible-core podman beakerlib | sort | uniq ansible-core-2.16.14-1.fc40.noarch beakerlib-1.31.3-1.fc40.noarch fmf-1.6.1-1.fc40.noarch podman-5.3.1-1.fc40.x86_64 standard-test-roles-4.11-3.fc40.noarch tmt-1.41.0-1.fc40.noarch On the behalf of the Testing Farm Team, /M -- 🧑‍🔧 Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / Linux QE 🎩 Red Hat Slack :: mvadkert :: #testing-farm #tmt 📱 Fedora Matrix :: mvadkert :: #Fedora CI 🌍️ Remote Czech Republic :: Red Hat Czech s.r.o

1 0

[release] Testing Farm 2024-10.6
by Miroslav Vadkerti 09 Jan '25

09 Jan '25

Hi, Testing Farm release 2024-10.6 was deployed on 2025-01-09 🎉. *🚀 Upgrades* tmt <https://tmt.readthedocs.org/> was updated to 1.40 <https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-40>. *📦️ Packages* List of important packages bundled in the worker image. ❯ podman run --entrypoint rpm quay.io/testing-farm/worker-public:2024-10.6 -q fmf tmt standard-test-roles ansible-core podman beakerlib | sort | uniq ansible-core-2.16.12-1.fc40.noarch beakerlib-1.31.3-1.fc40.noarch fmf-1.5.0-1.fc40.noarch podman-5.3.1-1.fc40.x86_64 standard-test-roles-4.11-3.fc40.noarch tmt-1.40.0-1.fc40.noarch On the behalf of the Testing Farm Team, /M -- 🧑‍🔧 Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / Linux QE 🎩 Red Hat Slack :: mvadkert :: #testing-farm #tmt 📱 Fedora Matrix :: mvadkert :: #Fedora CI 🌍️ Remote Czech Republic :: Red Hat Czech s.r.o

1 0

[release] Testing Farm 2024-10.5
by Miroslav Vadkerti 19 Dec '24

19 Dec '24

Hi, Testing Farm release 2024-10.5 was deployed on 2024-12-17 🎉. *💔 Breaking Changes* The result.xunit field was removed from the API. Please use result.xunit_url and download the xUnit output instead. The Testing Farm CLI v0.0.21 has changed parsing of key=value options, which can break in certain cases. See the documentation </testing-farm/docs/root/-/blob/76b2ee79bed589660d86805e35e7fc5d01218bd2/cli.adoc#multiple-kv> for more details. Tests defined directly under the discover step using the shell method are now sorted alphabetically. If you rely on specific order in which tests are executed, use explicitly the order attribute as a workaround. This change will be fixed in the next release. <#user-content-upgrades>🚀 Upgrades Testing Farm CLI </testing-farm/docs/root/-/blob/76b2ee79bed589660d86805e35e7fc5d01218bd2/cli.adoc> tool updated to v0.0.22 <https://gitlab.com/testing-farm/cli/-/releases/v0.0.22>, please update your installation. Artemis <https://gitlab.com/testing-farm/artemis/> was updated to v0.0.72 <https://gitlab.com/testing-farm/artemis/-/releases/v0.0.72> on both ranches. tmt <https://tmt.readthedocs.org> was updated to 1.39 <https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-39>, see also release notes for 1.36 <https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-36>, 1.37 <https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-36> and 1.38 <https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-38>. fmf <https://fmf.readthedocs.org> was updated to 1.5 <https://fmf.readthedocs.io/en/stable/releases.html#fmf-1-5-0>. 🎯 Highlights Testing Farm onboarding to Red Hat ranch is now self service using Red Hat Employee SSO. See the onboarding documentation </testing-farm/docs/root/-/blob/76b2ee79bed589660d86805e35e7fc5d01218bd2/onboarding.adoc> for more information. Preliminary support for Image Mode for RHEL-9.6.0, Fedora-40 and CentOS-Stream 9 is available. Read more about the support and possible use cases in our RFD5 </testing-farm/docs/root/-/blob/76b2ee79bed589660d86805e35e7fc5d01218bd2/rfd/rfd5-testing-image-mode.adoc>. Reservations in Public ranch do not require an ssh proxy anymore and you can directly connect to the provisioned machines and access all the ports. (TFT-2678 <https://issues.redhat.com/browse/TFT-2678>) Support for dedicated (non-spot) AWS instances was added in Red Hat ranch. This can help with stability of long-running tests and prevents pre-mature test machine termination by AWS. See official documentation for details how to enable this for your requests </testing-farm/docs/root/76b2ee79bed589660d86805e35e7fc5d01218bd2/test-request.adoc#_tags>. *🚀 Improvements* The TMT_SSH_* options can now be set by the requests in the environments[].tmt.environment field.This can help to workaround unstable network conditions for certain Beaker labs. (TFT-2936 <https://issues.redhat.com/browse/TFT-2936>) For plans the tmt running log is shown during execution. (TFT-2845 <https://issues.redhat.com/browse/TFT-2845>) The tmt plans workdir is exposed during tests execution. (TFT-2740 <https://issues.redhat.com/browse/TFT-2740>) The poweruser role was introduced, making it possible to cancel any job on Testing Farm. Improves the experience for teams using automation accounts. (TFT-2706 <https://issues.redhat.com/browse/TFT-2706>) *🐞 Bugfixes* Bug causing failed jobs reported as passed in some corner cases was fixed. (TFT-2847 <https://issues.redhat.com/browse/TFT-2847>) Fix the long-term problem with archiving, causing occasionally incomplete logs. (TFT-2750 <https://issues.redhat.com/browse/TFT-2750>) Fix "Artemis API call failed: Condition 'api_call' failed to pass within given time" occasional error. (TFT-2734 <https://issues.redhat.com/browse/TFT-2734>) Fixed a problem when very long secrets would not be hidden in the logs. (TFT-2698 <https://issues.redhat.com/browse/TFT-2698>) Fix a problem when the hiding of secrets in logs was currupting yaml files. (TFT-2487 <https://issues.redhat.com/browse/TFT-2487>) <#user-content-%EF%B8%8F-packages>📦️ Packages List of important packages bundled in the worker image. ❯ podman run --entrypoint rpm quay.io/testing-farm/worker-public:2024-10.5 -q fmf tmt standard-test-roles ansible-core podman beakerlib | sort | uniqansible-core-2.16.12-1.fc40.noarchbeakerlib-1.31.3-1.fc40.noarchfmf-1.5.0-1.fc40.noarchpodman-5.3.1-1.fc40.x86_64standard-test-roles-4.11-3.fc40.noarchtmt-1.39.0-1.fc40.noarch 🔎 Stats Testing Farm is on track to surpass 1.33M requests per year <https://stats.testing-farm.io/d/dpYooDIVk/testing-farm-all-time-stats> \o/. The average error rate for Testing Farm was approximately 3.10% <http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?orgId=1&refresh=1m&…>. On the behalf of the Testing Farm Team, /M

1 0

Interesting case about conflicts - update that bumps library soname and provides new compat package for old soname
by Adam Williamson 24 Sep '24

24 Sep '24

Hey folks! This seems like an interesting case that could benefit from more input, so I figured I'd highlight it for the list. I got interested in the rpmdeplint failures for the new llvm update - https://bodhi.fedoraproject.org/updates/FEDORA-2024-e9a5fdd899 - so I started poking. rpmdeplint reports these failures: clang18-18.1.7-5.fc42.x86_64 provides /usr/bin/clang++-18 which is also provided by clang-18.1.8-3.fc41.i686 compiler-rt18-18.1.7-3.fc42.x86_64 provides /usr/lib/clang/18/lib/x86_64-redhat-linux-gnu/clang_rt.crtbegin.o which is also provided by compiler-rt-18.1.8-2.fc41.x86_64 compiler-rt18-18.1.7-3.fc42.x86_64 provides /usr/lib/clang/18/lib/x86_64-redhat-linux-gnu/clang_rt.crtend.o which is also provided by compiler-rt-18.1.8-2.fc41.x86_64 compiler-rt18-18.1.7-3.fc42.x86_64 provides /usr/lib/clang/18/lib/x86_64-redhat-linux-gnu/libclang_rt.asan-preinit.a which is also provided by compiler-rt-18.1.8-2.fc41.x86_64 compiler-rt18-18.1.7-3.fc42.x86_64 provides /usr/lib/clang/18/lib/x86_64-redhat-linux-gnu/libclang_rt.asan.a which is also provided by compiler-rt-18.1.8-2.fc41.x86_64 compiler-rt18-18.1.7-3.fc42.x86_64 provides /usr/lib/clang/18/lib/x86_64-redhat-linux-gnu/libclang_rt.asan.so which is also provided by compiler-rt-18.1.8-2.fc41.x86_64 ... [there are lots more similar compiler-rt ones, cut for space] libomp-19.1.0-1.fc42.x86_64 provides /usr/lib64/libarcher.so which is also provided by libomp18-18.1.7-3.fc41.x86_64 libomp-19.1.0-1.fc42.x86_64 provides /usr/lib64/libomp.so which is also provided by libomp18-18.1.7-3.fc41.x86_64 libomp-19.1.0-1.fc42.x86_64 provides /usr/lib64/libompd.so which is also provided by libomp18-18.1.7-3.fc41.x86_64 now in all cases there, the "also provided by" package is the *current* stable package, and the update contains a newer build of that package which would not conflict. So there's a clang-19 build, a compiler-rt-19 build, and a libomp18 build in the update, all of which do not conflict. So at first I thought "obviously this behavior of rpmdeplint is wrong! It should not check for conflicts with packages that the update-under- test would replace". I wrote a PR for that...and it failed tests: https://github.com/fedora-ci/rpmdeplint/pull/21 the test it failed refers to https://bugzilla.redhat.com/show_bug.cgi?id=1502458 , which made me rethink whether this behavior of rpmdeplint is actually *wrong*. That bug specifically *wanted* rpmdeplint to catch a conflict with a package that the update would replace. It talks about a real-world case where vim-minimal and vim-common have some files in common. Now, say you have vim-minimal-1.0 on your system, but in the updates repo, there's a vim- 2.0 build with different versions of those files. If you tried to install something that depended on vim-common (but did not cause vim- minimal to be updated), it would fail, because vim-common-2.0 and vim- minimal-1.0 from your installed system would conflict. The reporter argued that rpmdeplint should've caught this and forced vim-common to add an explicit conflicts with different versions of vim-minimal, which seems kinda reasonable, honestly. So that made me rethink whether the issue here is in the update or in rpmdeplint's behavior. True, if you have an 18 version of clang and also something that needs clang 18 installed and you just did `dnf update`, there would be no conflict: dnf would update to clang-19 and install clang18, and everything would be fine. But if you had an 18 version of clang installed and you tried to do something that, for some reason, caused clang18 to be pulled in but did *not* cause clang to be updated (maybe `dnf install clang18-devel` ?), you would hit a conflict. So, arguably, the error here is in the package: clang18 should explicitly conflict with clang < 19, compiler-rt18 should explicitly conflict with compiler-rt < 19, libomp should explicitly conflict with libomp18 < 18.1.7-4 . (currently compiler-rt18 has an explicit conflicts with 'compiler-rt = 18', but that definitely seems wrong; I don't think that could ever be satisfied.) What do folks think about this? Do you think the error is in the package, or in rpmdeplint's analysis? If the former, should we update the packaging guidelines to specifically cover this case (if they don't already)? If the latter, how do we change rpmdeplint's behavior, considering the request in 1502458 ? Thanks for any thoughts! -- Adam Williamson (he/him/his) Fedora QA Fedora Chat: @adamwill:fedora.im | Mastodon: @adamw@fosstodon.org https://www.happyassassin.net

3 4

2025

2024

2023

2022

2021

2020

2019

2018

2017

CI [ARCHIVED]