third-party tests *now* ?
There is this discussion in test list [1] where Steve Grubb posted some security testing
scripts. He asked these scripts to be included in AutoQA and executed regularly. I would
like to discuss it with the whole team because I believe we don't have a clear idea
what our current stance is.
I'd like to propose that we currently don't accept any third-party tests. It is
tempting and I'd love to have more tests inside AutoQA. But we don't have the
manpower to maintain them. Every single extra test case drains power from implementing the
AutoQA infrastructure. We already have some test cases we (I) don't understand. And it
would get worse.
I believe we need to implement proper AutoQA infrastructure and then allow people to run
and maintain their tests, without our babysitting. Different approach will consume our
resources.
What do you think?
PS: If you believe some of the tests should be included now, I expect a volunteer to step
up and take care of the integration work. Don't be shy :)
[1] http://lists.fedoraproject.org/pipermail/test/2011-August/101624.html