[Fedora QA] #84: Define install matrix baseline

[Fedora QA]

#84: Define install matrix baseline
---------------------------+------------------------------------------------
 Reporter:  jlaska         |       Owner:           
     Type:  enhancement    |      Status:  new      
 Priority:  major          |   Milestone:  Fedora 14
Component:  Wiki           |     Version:           
 Keywords:  retrospective  |  
---------------------------+------------------------------------------------
 = problem =

  * We almost didn't find [http://bugzilla.redhat.com/578633 RHBZ#578633 -
 Unable to enter passphrase to unlock encrypted disk partitions]
  * When re-using test results from a previous test run, it's possible to
 include results for tests that should be re-tested.  This would be bad.

 = analysis =

  * F-13 Beta candidate#3 didn't include the correct version of
 ''plymouth''  (see RHBZ #578633).
  * Since it was Beta#3 and not much was supposed to change from Beta#2,
 some test results from the previous Beta#2 candidate were carried forward.
  * Thankfully, QA found the problem before release while running the
 QA:Testcase_Anaconda_autopart_(encrypted)_install test.

 = enhancement recommendation =

  * Establish better guidelines about which test results can be carried
 forward from one candidate to the next (this isn't easy). Or perhaps,
 establish a subset of tests that all respins must undergo.
  * Perhaps link to, or document at
 http://fedoraproject.org/wiki/QA:Installation_validation_testing

-- 
Ticket URL: <https://fedorahosted.org/fedora-qa/ticket/84>
Fedora QA <http://fedorahosted.org/fedora-qa>
Fedora Quality Assurance