F-14 ON_QA release blockers in need of testing

[Jesse Keating]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 10/19/2010 07:29 AM, Sandro "red" Mathys wrote:
>> List of ON_QA bugs - http://bit.ly/dx4ehO
> 
> [16:17:55] <red_alert> many of those ON_QA bugs have been VERIFIED
> before bodhi changed it back [to ON_QA]...do we need to re-test those?
> 
> 
> [16:19:47] <jlaska> red_alert: I think that's a really good discussion
> for the list.  kparal mentioned that earlier, let's discuss it there so
> others can benefit as well
> 
> #####
> 
> I've often seen people setting the status back to VERIFIED in such a
> case but I'm not exactly sure if that's the best possible behavior.
> 
> So, does it make sense to re-test fixes because the newly pushed version
> might have broken things again or do we generally assume that fixes
> included in older versions are still working in newer versions?
> 
> IMHO it doesn't make sense to re-test again. There'll always be newer
> versions and we can't always re-test every bug with every new version.
> 
> +1 for just setting back to VERIFIED again
> 
> -- red
> 

I think it depends on why bodhi made the change.

I've seen some situations where an update has been proposed, and testers
have grabbed it before it ever hit updates-testing.  They verified the
fix and set the bug accordingly.  Then when bodhi pushes the update to
updates-testing, it sets the status to ON_QA.

In other scenarios, a build might have been already in updates-testing,
then it gets verified by a tester and marks it as such in the bug.  Then
the developer might edit the update, perhaps changing the text or adding
a bug which has caused the update to get re-pushed to updates-testing
and the bug status reset to ON_QA.

Other times the edit includes new version(s) of the package(s) and
re-pushing to updates-testing and thus a reset of status to ON_QA.

- -- 
Jesse Keating
Fedora -- Freedom² is a feature!
identi.ca: http://identi.ca/jkeating
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org/

iEYEARECAAYFAky90fUACgkQ4v2HLvE71NXotgCfRSl/MemS1v/AO2ladb2rGtQW
V9gAn3uF6ZacMJct1KN/y7qzZLFdqJjO
=hWf4
-----END PGP SIGNATURE-----