QA:Testcase Memtest86

[James Laska]

On Wed, 2010-08-11 at 06:27 -0400, Kamil Paral wrote:
> I want to discuss the QA:Testcase Memtest86 [1] from our F14 installation
> matrix.
> 
> The test case is a little weird to me and took me quite some time to 
> understand what to test and when to report outcome.
> 
> > How to test:
> >   1.  Boot the installer using any available means
> 
> We don't want to boot the installer (anaconda), just show the main
> boot menu (grub).
> 
> >   2. At the bootloader prompt, select the option labeled Memory Test
> >   3. Make some changes to the configurations and other settings 
> 
> > Expected Results:
> >   1.  Memory test works successfully
> 
> Meaning the program works or there are not RAM failures? The latter is
> hardware issue. Let's rephrase that.
> 
> >   2. Test report is shown once a test is completed.
> 
> The test is never completed, it runs infinitely over and over again.
> It takes quite some time too.
> Also, no report is ever shown, just statistics are continuously updated
> in the lower part of the screen.
> Very confusing.
> 
> >   3. The configurations are able to be set and changed. 
> 
> Yep, but according to what you set, you may wait ages until some
> test passes at least once.
> 
> 
> I think this test case is needlessly overcomplicated. We just need
> to test that Memory Test available on installation media "just works",
> right? So what about something like:
> 
> How to test:
>    1. Insert installation media and display its boot prompt
>    2. Select option Memory Test
>    3. Have the test running for a few moments
> 
> Expected results:
>    1. Memory test runs a tests your memory, it seems to work correctly.
>    2. You can use configuration to change test settings, e.g. select just
>       one single test out of the test set to be tested.
> 
> 
> Sounds better?

+1 ... we don't want to actually test the systems memory ... just that
the menu option is available and, as you say, "seems to work correctly."

Thanks,
James
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 198 bytes
Desc: This is a digitally signed message part
Url : http://lists.fedoraproject.org/pipermail/test/attachments/20100811/0c5ee586/attachment.bin