QA:Testcase Memtest86

[Kamil Paral]

I want to discuss the QA:Testcase Memtest86 [1] from our F14 installation
matrix.

The test case is a little weird to me and took me quite some time to 
understand what to test and when to report outcome.

> How to test:
>   1.  Boot the installer using any available means

We don't want to boot the installer (anaconda), just show the main
boot menu (grub).

>   2. At the bootloader prompt, select the option labeled Memory Test
>   3. Make some changes to the configurations and other settings 

> Expected Results:
>   1.  Memory test works successfully

Meaning the program works or there are not RAM failures? The latter is
hardware issue. Let's rephrase that.

>   2. Test report is shown once a test is completed.

The test is never completed, it runs infinitely over and over again.
It takes quite some time too.
Also, no report is ever shown, just statistics are continuously updated
in the lower part of the screen.
Very confusing.

>   3. The configurations are able to be set and changed. 

Yep, but according to what you set, you may wait ages until some
test passes at least once.


I think this test case is needlessly overcomplicated. We just need
to test that Memory Test available on installation media "just works",
right? So what about something like:

How to test:
   1. Insert installation media and display its boot prompt
   2. Select option Memory Test
   3. Have the test running for a few moments

Expected results:
   1. Memory test runs a tests your memory, it seems to work correctly.
   2. You can use configuration to change test settings, e.g. select just
      one single test out of the test set to be tested.


Sounds better?


[1] https://fedoraproject.org/wiki/QA:Testcase_Memtest86