Hi all,
The testcase in question is the base service manipulation test [0]. This testcase is a Final-milestone test for x86_64, ARM, and cloud in the validation test matrix [1][2][3]. It is also an optional testcase for non-release-blocking spins [4][5].
In many of the testing scenarios that this testcase is used, the tester is logged into and testing the machine remotely via ssh. As the testcase stands now, the default service that is listed to test with is sshd. Since this test requires the tester to continually enable/disable/start/stop the sshd service, doing so on a machine that is remotely logged into will cause problems with ssh and could leave the tester stuck out of their system. In many cases where the tester does not have access to the hardware to login physically, this requires spinning up a new image to test remotely (thinking particularly of AWS), and can be quite a hassle.
Currently, there is a note listed at the beginning of the testcase that warns the tester of these adverse effects, should the testcase be followed explicitly on a system being used remotely [6]. It suggests using a different, non-critical service to test the functionality, such as chronyd.
I would like to propose that we change the default service that this testcase lists to use in the examples to something less critical to a tester who is logged in remotely over ssh. I propose we change the service to chronyd, but am open to other suggestions. As it stands, I don't see a reason to use ssh over another service, especially if using ssh can introduce some problems. The only reason I could possibly see as to why ssh was used in the first place was that it's enabled on all spins of Fedora, but I'm not certain of that. If someone wants to inform me as to why ssh was originally used, please do.
This would make it easier to find a service to test with for those logged into systems remotely while also keeping the test uniform across all arches and spins of Fedora, as the same service could be used across all platforms.
It has been suggested to create a separate testcase specifically for systems that are tested via remote logins, but if there is no reason to continue using ssh in this testcase, I think it would be a good idea to change it and keep just one testcase for all in this instance.
Comments, questions, concerns: welcome!
Geoff Marr IRC: coremodule
[0] https://fedoraproject.org/wiki/QA:Testcase_base_service_manipulation [1] https://fedoraproject.org/wiki/Template:Base_test_matrix#Release-blocking_en... [2] https://fedoraproject.org/wiki/Template:Base_test_matrix#Release-blocking_en... [3] https://fedoraproject.org/wiki/Template:Cloud_test_matrix [4] https://fedoraproject.org/wiki/Template:Base_test_matrix#Non-blocking_enviro... [5] https://fedoraproject.org/wiki/Template:Base_test_matrix#Non-blocking_enviro... [6] https://fedoraproject.org/wiki/QA:Testcase_base_service_manipulation#How_to_...