QA:Testcase Memtest86

[He Rui]

Hi Kamil,

On Wed, 2010-08-11 at 06:27 -0400, Kamil Paral wrote:
> I want to discuss the QA:Testcase Memtest86 [1] from our F14 installation
> matrix.
> 
> The test case is a little weird to me and took me quite some time to 
> understand what to test and when to report outcome.
> 
> > How to test:
> >   1.  Boot the installer using any available means
> 
> We don't want to boot the installer (anaconda), just show the main
> boot menu (grub).

Ah, right.

> >   2. At the bootloader prompt, select the option labeled Memory Test
> >   3. Make some changes to the configurations and other settings 
> 
> > Expected Results:
> >   1.  Memory test works successfully
> 
> Meaning the program works or there are not RAM failures? The latter is
> hardware issue. Let's rephrase that.
> 
> >   2. Test report is shown once a test is completed.
> 
> The test is never completed, it runs infinitely over and over again.
> It takes quite some time too.
> Also, no report is ever shown, just statistics are continuously updated
> in the lower part of the screen.
> Very confusing.

If a test cycle is completed(From test#1 to test#8, About 5 mins for
512M memory), A test result will be shown at the bottom:

************ Pass Complete, no errors, press ESC to exit ************ 

I haven't met the failure status, but a relative result is supposed to
be provided after one cycle is finished as well. 

> 
> >   3. The configurations are able to be set and changed. 
> 
> Yep, but according to what you set, you may wait ages until some
> test passes at least once.

This is meant to test the configurations and make sure they are
functional.

> 
> I think this test case is needlessly overcomplicated. We just need
> to test that Memory Test available on installation media "just works",
> right? So what about something like:
> 
> How to test:
>    1. Insert installation media and display its boot prompt
>    2. Select option Memory Test
>    3. Have the test running for a few moments

'A few moments' should be more accurate, at least test#1 - test#8 is
finished.  

> 
> Expected results:
>    1. Memory test runs a tests your memory, it seems to work correctly.
>    2. You can use configuration to change test settings, e.g. select just
>       one single test out of the test set to be tested.
> 
> 
> Sounds better?

Also add this one to verify the test result:

3. Test Report(Or test result) is shown once a test cycle(test#1-test#8)
is done. 



Thanks,
Hurry

-- 
Contacts

Hurry
FAS Name: Rhe 
Timezone: UTC+8
TEL: 86-010-62608141
IRC nick: rhe #fedora-qa #fedora-zh