[Fedora QA] #72: Proposal for reducing test permutations

[Fedora QA]

#72: Proposal for reducing test permutations
--------------------------+-------------------------------------------------
  Reporter:  rhe          |       Owner:  rhe      
      Type:  enhancement  |      Status:  new      
  Priority:  major        |   Milestone:  Fedora 14
 Component:  Test Review  |     Version:           
Resolution:               |    Keywords:           
--------------------------+-------------------------------------------------
Comment (by jlaska):

 Replying to [comment:6 adamwill]:

 > "Reason: In F14, the tests would be grouped according to install media,
 and default package install is included in each media installation. So I'd
 like to remove minimal install, since default one has already covered it."
 >
 > I don't quite understand this. We test the minimal install functionality
 to make sure it works. Sure, all the same packages are in the default
 install, but that's not the same as saying the minimal installation
 function works as intended. Am I misreading you?

 Hurry: I think we'll need to keep the minimal install test around for
 Fedora 14.  However, I don't think we need to run this test for *every*
 usage scenario.  Can both the default package set, and the minimal package
 set tests be moved into the general variations list?  I don't think these
 need to be tested against each boot+install method.

 Additionally, I've updated the
 [https://fedoraproject.org/wiki/QA/TestCases/PackageSetsMinimalPackageInstall
 minimal install package set test] to ensure the system is able to access
 the network and install yum updates.

 > "Reason: I think the other partitioning tests and
 QA/TestCases/BootMethodsKVM(Install on a new created kvm) have somehow
 covered this test. "

 I'd really like to also remove 'QA/TestCases/BootMethodsKVM' and it's XEN
 counterpart, or at least rename them to something more appropriate.
 Perhaps a set of storage device tests that confirm the detection and use
 of virt storage and network devices?

-- 
Ticket URL: <https://fedorahosted.org/fedora-qa/ticket/72#comment:7>
Fedora QA <http://fedorahosted.org/fedora-qa>
Fedora Quality Assurance