After the QA meeting earlier today, Kamil, Josef, Adam, John and I had
a short discussion about where we're trying to go with AutoQA beyond
what is already planned for 0.8. This was informal and very last minute
but I wanted to send out a summary of what we discussed.
The two major topics that we discussed were:
- ResultsDB
- "Third Party" Tests (ie tests not maintined by us)
ResultsDB sounds like it is progressing nicely. Josef will be deploying
it to staging in the near future and if all goes well, we'll discuss
any timeline for using ResultsDB in production.
Support for "third party" tests is a bit messier and quite a bit
farther out. The high level things that we would need in order to
support those tests well are:
* automatic fetching of the tests
* disposable machines
* stable API
* resultsdb support for third-party tests
Unfortunately, most of those tasks are non-trivial and while ideas have
been floated for how to accomplish them, there are no concrete
proposals.
With the pending F17 test cycle that will probably consume
most of our available human resources, it's not likely that any
significant progress can/will be made until F17 is released.
Tim
Show replies by date