Hi,
Testing Farm release 2024-10.5 was deployed on 2024-12-17 🎉.
*💔 Breaking Changes*
The result.xunit field was removed from the API.
Please use result.xunit_url and download the xUnit output instead.
The Testing Farm CLI v0.0.21 has changed parsing of key=value options,
which can break in certain cases.
See the documentation
</testing-farm/docs/root/-/blob/76b2ee79bed589660d86805e35e7fc5d01218bd2/cli.adoc#multiple-kv>
for more details.
Tests defined directly under the discover step using the shell method
are now sorted alphabetically.
If you rely on specific order in which tests are executed, use
explicitly the order attribute as a workaround.
This change will be fixed in the next release.
<#user-content-upgrades>🚀 Upgrades
Testing Farm CLI
</testing-farm/docs/root/-/blob/76b2ee79bed589660d86805e35e7fc5d01218bd2/cli.adoc>
tool updated to v0.0.22
<https://gitlab.com/testing-farm/cli/-/releases/v0.0.22>, please
update your installation.
Artemis <https://gitlab.com/testing-farm/artemis/> was updated to
v0.0.72 <https://gitlab.com/testing-farm/artemis/-/releases/v0.0.72>
on both ranches.
tmt <https://tmt.readthedocs.org> was updated to 1.39
<https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-39>, see
also release notes for 1.36
<https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-36>, 1.37
<https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-36> and 1.38
<https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-38>.
fmf <https://fmf.readthedocs.org> was updated to 1.5
<https://fmf.readthedocs.io/en/stable/releases.html#fmf-1-5-0>.
🎯 Highlights
Testing Farm onboarding to Red Hat ranch is now self service using Red
Hat Employee SSO.
See the onboarding documentation
</testing-farm/docs/root/-/blob/76b2ee79bed589660d86805e35e7fc5d01218bd2/onboarding.adoc>
for more information.
Preliminary support for Image Mode for RHEL-9.6.0, Fedora-40 and
CentOS-Stream 9 is available.
Read more about the support and possible use cases in our RFD5
</testing-farm/docs/root/-/blob/76b2ee79bed589660d86805e35e7fc5d01218bd2/rfd/rfd5-testing-image-mode.adoc>.
Reservations in Public ranch do not require an ssh proxy anymore and
you can directly connect to the provisioned machines and access all
the ports. (TFT-2678 <https://issues.redhat.com/browse/TFT-2678>)
Support for dedicated (non-spot) AWS instances was added in Red Hat ranch.
This can help with stability of long-running tests and prevents
pre-mature test machine termination by AWS.
See official documentation for details how to enable this for your
requests </testing-farm/docs/root/76b2ee79bed589660d86805e35e7fc5d01218bd2/test-request.adoc#_tags>.
*🚀 Improvements*
The TMT_SSH_* options can now be set by the requests in the
environments[].tmt.environment field.This can help to workaround
unstable network conditions for certain Beaker labs. (TFT-2936
<https://issues.redhat.com/browse/TFT-2936>)
For plans the tmt running log is shown during execution. (TFT-2845
<https://issues.redhat.com/browse/TFT-2845>)
The tmt plans workdir is exposed during tests execution. (TFT-2740
<https://issues.redhat.com/browse/TFT-2740>)
The poweruser role was introduced, making it possible to cancel any
job on Testing Farm.
Improves the experience for teams using automation accounts. (TFT-2706
<https://issues.redhat.com/browse/TFT-2706>)
*🐞 Bugfixes*
Bug causing failed jobs reported as passed in some corner cases was
fixed. (TFT-2847 <https://issues.redhat.com/browse/TFT-2847>)
Fix the long-term problem with archiving, causing occasionally
incomplete logs. (TFT-2750
<https://issues.redhat.com/browse/TFT-2750>)
Fix "Artemis API call failed: Condition 'api_call' failed to pass
within given time" occasional error. (TFT-2734
<https://issues.redhat.com/browse/TFT-2734>)
Fixed a problem when very long secrets would not be hidden in the
logs. (TFT-2698 <https://issues.redhat.com/browse/TFT-2698>)
Fix a problem when the hiding of secrets in logs was currupting yaml
files. (TFT-2487 <https://issues.redhat.com/browse/TFT-2487>)
<#user-content-%EF%B8%8F-packages>📦️ Packages
List of important packages bundled in the worker image.
❯ podman run --entrypoint rpm
quay.io/testing-farm/worker-public:2024-10.5 -q fmf tmt
standard-test-roles ansible-core podman beakerlib | sort |
uniqansible-core-2.16.12-1.fc40.noarchbeakerlib-1.31.3-1.fc40.noarchfmf-1.5.0-1.fc40.noarchpodman-5.3.1-1.fc40.x86_64standard-test-roles-4.11-3.fc40.noarchtmt-1.39.0-1.fc40.noarch
🔎 Stats
Testing Farm is on track to surpass 1.33M requests per year
<https://stats.testing-farm.io/d/dpYooDIVk/testing-farm-all-time-stats> \o/.
The average error rate for Testing Farm was approximately 3.10%
<http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?orgId=1&refresh=1m&…>.
On the behalf of the Testing Farm Team, /M