[Fedora QA] #84: Define install matrix baseline

[Fedora QA]

#84: Define install matrix baseline
--------------------------+-------------------------------------------------
  Reporter:  jlaska       |       Owner:               
      Type:  enhancement  |      Status:  new          
  Priority:  major        |   Milestone:  Fedora 14    
 Component:  Wiki         |     Version:               
Resolution:               |    Keywords:  retrospective
--------------------------+-------------------------------------------------
Comment (by rhe):

 This was the scariest part for me in F13 validation tests.:o I often
 hesitated whether some certain test results should be moved or not. Here
 are some draft thoughts from me:

  * 1. Release-eng(or the anaconda group) tells the detailed changes in
 anaconda and packages (related to install and reboot such as plymouth. We
 can also diff package changes) between versions. Only results from
 unchanged tests can be moved.

  * 2. Pass results in previous version can be moved, but once they failed
 in pre-previous(or before) version in this candidate, they can't be moved.

  * 3. At least keep one test in each test area to be tested without moving
 result.

  * 4. Tests grouped by five media can not moved.(Should they?)

  * 5. Some "particular" cases like shrink, encrypted and ...(?) should not
 be moved.

 These are just some thoughts on my mind now. Feel free to correct and add.
 And I think this part should be added in
 [https://fedoraproject.org/wiki/QA/SOP_Release_Validation_Test_Event
 SOP_Release_Validation_Test_Event]

-- 
Ticket URL: <https://fedorahosted.org/fedora-qa/ticket/84#comment:1>
Fedora QA <http://fedorahosted.org/fedora-qa>
Fedora Quality Assurance