Proposal: AutoQA Infrastructure Upgrade

[Tim Flink]

On Fri, 26 Jul 2013 12:23:33 -0600
Tim Flink <tflink at redhat.com> wrote:

> After looking at the jobstats on autoqa-stg over the last day or so
> since I changed all of the clients to be fc18, I'm happy enough with
> the completion rates to suggest that we upgrade production autoqa and
> get rid of our fc17 clients.

I suppose that actually including those numbers might help. They do
include a bunch of fc19 runs that were before I switched all of the
clients over to fc18

raw data:
http://tflink.fedorapeople.org/autoqa/jobstats/20130726_jobstats-stg.txt

summary data:
http://tflink.fedorapeople.org/autoqa/jobstats/20130726_jobstats-stg_summary.txt

running stats on 20130726_jobstats-stg.txt
Global Stats
============
1715 Jobs
  -  1042   fc18
  -  672   fc19

Crashes
-------
271 Crashes
  -  61   fc18
  -  210   fc19

Passes
-------
1443 Passes
  -  981   fc18
  -  462   fc19

Test Specific Stats
===================

depcheck
   266 runs ( 136 GOOD, 130 ERROR )
    -  136 fc18 runs ( 136 GOOD, 0 ERROR )
    -  130 fc19 runs ( 0 GOOD, 130 ERROR )

repoclosure
   214 runs ( 214 GOOD, 0 ERROR )
    -  98 fc18 runs ( 98 GOOD, 0 ERROR )
    -  116 fc19 runs ( 116 GOOD, 0 ERROR )

rpmguard
   488 runs ( 488 GOOD, 0 ERROR )
    -  346 fc18 runs ( 346 GOOD, 0 ERROR )
    -  142 fc19 runs ( 142 GOOD, 0 ERROR )

rpmlint
   485 runs ( 485 GOOD, 0 ERROR )
    -  346 fc18 runs ( 346 GOOD, 0 ERROR )
    -  139 fc19 runs ( 139 GOOD, 0 ERROR )

upgradepath
   48 runs ( 48 GOOD, 0 ERROR )
    -  18 fc18 runs ( 18 GOOD, 0 ERROR )
    -  30 fc19 runs ( 30 GOOD, 0 ERROR )

conflicts
   213 runs ( 72 GOOD, 141 ERROR )
    -  98 fc18 runs ( 37 GOOD, 61 ERROR )
    -  115 fc19 runs ( 35 GOOD, 80 ERROR )
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 490 bytes
Desc: not available
URL: <http://lists.fedoraproject.org/pipermail/qa-devel/attachments/20130726/b3f3f20e/attachment.sig>