[Test-Announce] Call for reviewing TCMS use cases and comparison!
greenfeld at laptop.org
Thu Jan 20 10:54:58 UTC 2011
Unfortunately while I am familiar with a few test case management systems, I
have not been involved with the Fedora project long enough to know its
workflows. And a quick search online is not turning up much about Nitrate,
with its changelog implying it was first made open source software in
I might be able to provide some general comments though if I knew more about
the product. So for those of us unfamiliar with the history of Nitrate,
could you please answer the following:
1. What is the history of Nitrate and the Fedora Project? What does the
Fedora project expect to gain from using it?
2. Is a sample play/sandbox test instance with more-or-less full access
3. How does Nitrate compare to other open & closed sourced TCMS
solutions? Why was it written as opposed to using an existing solution, and
what are its straights & weaknesses?
4. Is test case & test plan import and export (to XML, etc.) support
available? If so is this compatible with any other TCMS's import/export
5. Are nested test plan and/or test case hierarchies supported?
6. Can multiple projects share test cases, and even reference older
versions of test cases if they are lagging behind the current rawhide/Fedora
release? Will Spins be able to make their own (simultaneously running) test
7. How long will historical test case results be made available?
8. Is there any plan to tie this into Bodhi and other tools to detect
updated packages that may imply test cases need re-running and/or updating?
9. Is this going to be available as a Fedorahosted service like Trac is?
If so will all the instances be able to share test cases?
10. Is there any concern that changing test tracking systems may
encourage/discourage existing testers to participate?
Some of this information may be useful to post on the Trac main page and/or
in the Fedora wiki.
Thanks in advance for your time.
On Tue, Jan 18, 2011 at 6:36 AM, He Rui <rhe at redhat.com> wrote:
> Wiki workflow/use cases are reorganized and grouped by general and main
> test events(runs) use cases. The general cases cover the basic uses of
> wiki, and the events cases covers the detailed certain steps for
> organizing the events.
> Please review it:
> Meanwhile, Wiki and Nitrate comparison is also listed and grouped by
> above use cases. I've listed as many features as I can think out for
> comparison. Please have a look and see if any features are missed. You
> can review it by the use case you're familiar with if reviewing all of
> them is tough, but be aware that features compared in former use cases
> are not listed in later cases again to avoid overlaps:
> Ticket#152 is currently set up for tracking this event. Feel free to
> add comments or discuss it here.
> Note: the feedback deadline is Jan 21, the end of this week. After that
> date, I'll move forward to the next phase.
> Waiting for your feedback!
>  https://fedorahosted.org/fedora-qa/ticket/152
> FAS Name: Rhe
> Timezone: UTC+8
> TEL: 86-010-62608141
> IRC nick: rhe #fedora-qa #fedora-zh
> test-announce mailing list
> test-announce at lists.fedoraproject.org
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the test