[Fedora QA] #72: Proposal for reducing test permutations

[Fedora QA]

#72: Proposal for reducing test permutations
--------------------------+-------------------------------------------------
  Reporter:  rhe          |       Owner:  rhe      
      Type:  enhancement  |      Status:  new      
  Priority:  major        |   Milestone:  Fedora 14
 Component:  Test Review  |     Version:           
Resolution:               |    Keywords:           
--------------------------+-------------------------------------------------
Comment (by adamwill):

 "Reason: In real world, users upgrade directly to the release after the
 next should be very few"

 This is not actually the case. Quite a lot of people run alternate
 releases, because that's the longest possible refresh cycle allowed by our
 maintenance policies. People who don't want to go through the hassle of
 doing a distro upgrade every six months run alternate releases, so they
 only have to do it every twelve months.

 "and no release criteria is defined on this"

 Indeed this is true, but I believe this test exists because we recognize
 that, in practice, people do run alternate releases so we should at least
 know about and be able to document any issues with this.

 "Reason: In F14, the tests would be grouped according to install media,
 and default package install is included in each media installation. So I'd
 like to remove minimal install, since default one has already covered it."

 I don't quite understand this. We test the minimal install functionality
 to make sure it works. Sure, all the same packages are in the default
 install, but that's not the same as saying the minimal installation
 function works as intended. Am I misreading you?

 "Reason: How many people will install using ext2 filesystem?! "

 Agreed, this one is outdated now. (Some people use ext2 on SSDs because
 they think journalling will kill the hardware, but such people are wrong.
 :>)

 "Reason: I think the other partitioning tests and
 QA/TestCases/BootMethodsKVM(Install on a new created kvm) have somehow
 covered this test. "

 This seems reasonable.

-- 
Ticket URL: <https://fedorahosted.org/fedora-qa/ticket/72#comment:6>
Fedora QA <http://fedorahosted.org/fedora-qa>
Fedora Quality Assurance