F18 Criterions/Testcases interconnection

[Josef Skladanka]

Hi,

I started to connect criterions to testcases for the F18 testing. So far, the Alpha is done (the messy page with criterions & links to testcases can be found here <https://fedoraproject.org/wiki/User:Jskladan/Sandbox:F18_Criteria_Testcases_Alpha>), and it looks all right. Some problems I've come around:

--------------------------

10. The installer must be able to install each of the release blocking desktops, as well as the minimal package set, with each supported installation method
    - We have testcase for the minimal install https://fedoraproject.org/wiki/QA:Testcase_Package_Sets_Minimal_Package_Install but IMHO no testcases for the desktops

13. The installer must allow the user to select which of the disks connected to the system will be affected by the installation process. Disks not selected as installation targets must not be affected by the installation process in any way
    - IMHO the same testcases as #12 (partitioning related), but none of them requires, that disks not selected must not be affected.

19. When booting a system installed without a graphical environment, or when using a correct configuration setting to cause an installed system to boot in non-graphical mode, the system should boot to a state where it is possible to log in through at least one of the default virtual consoles
    - Maybe we'd like to add some specific testcase like https://fedoraproject.org/wiki/QA:Testcase_base_startup seems to be for graphical startup

22. The default desktop background must be different from that of the two previous stable releases
    - IMHO no testcase coveres this (we have testcases that require 'proper' artwork for beta/final though)

23. Any component which prominently identifies a Fedora release version number, code name or phase (Alpha, Beta, Final) must do so correctly
    - Same as #22 IMHO

25. It must be possible to trigger a system shutdown using standard console commands, and the system must shut down in such a way that storage volumes (e.g. simple partitions, LVs and PVs, RAID arrays) are taken offline safely and the system's BIOS or EFI is correctly requested to power down the system
    - IMHO there is no testcase covering this criterion

--------------------------

Of couse, I could have missed something, so feel free to point me to the respective testcases. In the mean time, I'm going to get my hands dirty with Beta and Final criterion pairing.

J.