[Test-Announce] Call for reviewing TCMS use cases and comparison!

Samuel Greenfeld greenfeld at laptop.org
Thu Jan 20 10:54:58 UTC 2011


Unfortunately while I am familiar with a few test case management systems, I
have not been involved with the Fedora project long enough to know its
workflows.  And a quick search online is not turning up much about Nitrate,
with its changelog[1] implying it was first made open source software in
July 2010.

I might be able to provide some general comments though if I knew more about
the product.  So for those of us unfamiliar with the history of Nitrate,
could you please answer the following:


   1. What is the history of Nitrate and the Fedora Project?  What does the
   Fedora project expect to gain from using it?

   2. Is a sample play/sandbox test instance with more-or-less full access
   available online?

   3. How does Nitrate compare to other open & closed sourced TCMS
   solutions?  Why was it written as opposed to using an existing solution, and
   what are its straights & weaknesses?

   4. Is test case & test plan import and export (to XML, etc.) support
   available?  If so is this compatible with any other TCMS's import/export
   system?

   5. Are nested test plan and/or test case hierarchies supported?

   6. Can multiple projects share test cases, and even reference older
   versions of test cases if they are lagging behind the current rawhide/Fedora
   release?  Will Spins be able to make their own (simultaneously running) test
   plans?

   7. How long will historical test case results be made available?

   8. Is there any plan to tie this into Bodhi and other tools to detect
   updated packages that may imply test cases need re-running and/or updating?

   9. Is this going to be available as a Fedorahosted service like Trac is?
   If so will all the instances be able to share test cases?

   10. Is there any concern that changing test tracking systems may
   encourage/discourage existing testers to participate?


Some of this information may be useful to post on the Trac main page and/or
in the Fedora wiki.

Thanks in advance for your time.

---
SJG

[1] https://fedorahosted.org/nitrate/browser/trunk/nitrate/docs/ChangeLog



On Tue, Jan 18, 2011 at 6:36 AM, He Rui <rhe at redhat.com> wrote:

> Greetings!
>
> Wiki workflow/use cases are reorganized and grouped by general and main
> test events(runs) use cases. The general cases cover the basic uses of
> wiki, and the events cases covers the detailed certain steps for
> organizing the events.
>
> Please review it:
>
> https://fedoraproject.org/wiki/Rhe/tcms_use_cases
>
>
> Meanwhile, Wiki and Nitrate comparison is also listed and grouped by
> above use cases. I've listed as many features as I can think out for
> comparison. Please have a look and see if any features are missed. You
> can review it by the use case you're familiar with if reviewing all of
> them is tough, but be aware that features compared in former use cases
> are not listed in later cases again to avoid overlaps:
>
> https://fedoraproject.org/wiki/Rhe/tcms_Comparison
>
>
> Ticket#152[1] is currently set up for tracking this event. Feel free to
> add comments or discuss it here.
>
> Note: the feedback deadline is Jan 21, the end of this week. After that
> date, I'll move forward to the next phase.
>
> Waiting for your feedback!
>
> Cheers,
> Hurry
>
> [1] https://fedorahosted.org/fedora-qa/ticket/152
>
> --
> Contacts
>
> Hurry
> FAS Name: Rhe
> Timezone: UTC+8
> TEL: 86-010-62608141
> IRC nick: rhe #fedora-qa #fedora-zh
>
> _______________________________________________
> test-announce mailing list
> test-announce at lists.fedoraproject.org
> https://admin.fedoraproject.org/mailman/listinfo/test-announce
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.fedoraproject.org/pipermail/test/attachments/20110120/c33348b8/attachment.html 


More information about the test mailing list