How to calculate priority for missing tests or %check

[Aleksandar Kurtakov]

----- Original Message -----
> From: "Alexander Todorov" <atodorov at redhat.com>
> To: "For testing and quality assurance of Fedora releases" <test at lists.fedoraproject.org>
> Sent: Tuesday, February 25, 2014 12:54:42 PM
> Subject: How to calculate priority for missing tests or %check
> 
> Hi guys,
> I've started working to identify packages with missing upstream test suites
> or
> not running the tests in %check. Having a list of hundreds of packages now I
> need to prioritize them somehow. This will help in later steps when spec
> files
> need to be fixed or somebody wants to start working with upstream on writing
> a
> test suite.
> 
> My idea is to take all bugs against Fedora in the last few years (or
> releases).
> Packages with bigger number of bugs receive higher priority than those with
> less. Then based on this prioritize.
> 
> 
> How long should the time frame be?  I'm thinking 3 to 5 years.
> 
> 
> Where low/medium/high priority boundaries are ? (could be 30%, 60%, 90% for
> example).
> 
> 
> Do you have other ideas how to calculate priority of these items?

My starting point would be from dependency POV. Packages with more dependencies (repoquery is your friend) can break more things if broken thus deserve more testing.

Alexander Kurtakov
Red Hat Eclipse team

> 
> 
> Thanks,
> Alex
> --
> test mailing list
> test at lists.fedoraproject.org
> To unsubscribe:
> https://admin.fedoraproject.org/mailman/listinfo/test