F17 PM Test day late :) recap

[Adam Williamson]

On Tue, 2012-07-31 at 09:30 -0400, Jaroslav Skarvada wrote:

> During the event it proved that managing dozens of attendants become
> pain with the current test day infrastructure. For newcomers it was
> hard to understand how to fill results into wiki (or the concept of
> the wiki itself). It was even harder for remotees. Several times we
> received plain text reports and we had to transfer them into wiki
> ourself. In rush hours there were so many conflicting edits in the
> wiki that we had to utilize one people who worked only as a wiki
> corrector. I cannot imagine how to handle e.g. double number of
> participants with the current system. I think that some more robust
> and intuitive system is needed to attract/handle more participants.
> If designed the right way it could also simplify evaluation of results
> and could give answers to various queries like "what HW worked on
> which version of Fedora".
> 
> So again many thanks to all attendees and supporters and hope to see
> you during F18 PM test day :)

Thanks for the recap and the process feedback!

Yeah, the wiki system certainly has limitations. The problem is that any
replacement is likely to be significantly more complex on the
infrastructure side and also for Test Day organizers than simply using
the Wiki, so it's something of a trade-off; we've never found any kind
of 'drop-in' system that does exactly what we want. At least as far as
we've found so far, any replacement would make it somewhat more
difficult to organize a Test Day.

I've run X Test Weeks for several releases which can get upwards of 100
responses sometimes, and the Wiki has mostly held out to that.

Still, I agree it's not an optimal system, and if anyone has any
suggestions for alternatives we'd be glad to have them.
-- 
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Twitter: AdamW_Fedora | identi.ca: adamwfedora
http://www.happyassassin.net