From Fedora Project Wiki
(Add some items and use table format) |
|||
Line 4: | Line 4: | ||
This proposal analyses our current mediawiki-based system workflow and use cases, list the pro's and con's and compare them with nitrate system. The purpose is to find out what features we Must-Have and Nice-to-have in future TCMS, aka nitrate, and nitrate should be customized bases on these requirements. | This proposal analyses our current mediawiki-based system workflow and use cases, list the pro's and con's and compare them with nitrate system. The purpose is to find out what features we Must-Have and Nice-to-have in future TCMS, aka nitrate, and nitrate should be customized bases on these requirements. | ||
== | == wiki-based TCMS VS Nitrate System == | ||
=== General Manual Test Use | |||
{| class="wikitable sortable" | |||
|- | |||
! width="50%"| Wiki !! width="50%"| Nitrate | |||
|- | |||
! colspan="2"| Use cases | |||
|- | |||
| | |||
General Manual Test Use case: | |||
For each release: | For each release: | ||
Line 22: | Line 30: | ||
* Execute tests and provide test results | * Execute tests and provide test results | ||
* Summarize the report manually | * Summarize the report manually | ||
| | |||
Manual testing Use Case: | |||
# QE Project/Team Lead assigns feature to be tested | # QE Project/Team Lead assigns feature to be tested | ||
Line 60: | Line 39: | ||
# Test Run report available for viewing | # Test Run report available for viewing | ||
Writing a Test Plan Use Case: | |||
# QE Project/Team Lead assigns feature to be tested | # QE Project/Team Lead assigns feature to be tested | ||
Line 69: | Line 48: | ||
## Add existing Test Case | ## Add existing Test Case | ||
## QA Executes Test Run | ## QA Executes Test Run | ||
|- | |||
= | ! colspan="2"| {{result|pass|Pros}} | ||
|- | |||
| <!-- Pros for wiki--> | |||
* Easy to edit/modify | |||
* Support anonymous feedback | |||
* Integrated with FAS | |||
* Supports a decent API for extracting content and useful for metrics gathering | |||
* History roll back, easy recovery | |||
* Multi-testers contribute one case | |||
* Low barriers to entry | |||
* Flexibility | |||
* User can apply for different permission | |||
* Pages with different name space have diff permission. | |||
* Different name spaces and categories to organize pages. | |||
* Templates designed to fit for different instance. | |||
<!-- Details: | |||
* Only one result page for current installation/desktop validation event.--> | |||
| <!-- Pros for Nitrate--> | |||
* Tree view showing the current plan, and its parents and children using a tree style layout. It provides the ability to edit both parent and child plans. . | * Tree view showing the current plan, and its parents and children using a tree style layout. It provides the ability to edit both parent and child plans. . | ||
* Email Notification in workflow. | * Email Notification in workflow. | ||
Line 80: | Line 75: | ||
* Different status of a Test Run for tracking | * Different status of a Test Run for tracking | ||
* More than one tag for a test case | * More than one tag for a test case | ||
|- | |||
= | ! colspan="2"| {{result|fail|Cons}} | ||
|- | |||
| <!-- Cons for wiki --> | |||
* Results tracking | |||
* Results querying | |||
* Data statistics | |||
* Simple appearance | |||
* Syntax editing without forms | |||
* Cases without a category existed | |||
* Cases have no 'review' phase | |||
| <!-- Cons for Nitrate --> | |||
* Users without authentication (Guests) are granted read only permission to Test Cases and Test Plans | * Users without authentication (Guests) are granted read only permission to Test Cases and Test Plans | ||
* multi-testers contribute to one case not supported? | * multi-testers contribute to one case not supported? | ||
* no history roll back | * no history roll back | ||
* permissions for users are not well grouped | * permissions for users are not well grouped | ||
|- | |||
|} | |||
== Must-Have and Nice-to-Have == | == Must-Have and Nice-to-Have == |
Latest revision as of 10:06, 16 December 2010
Overview
This proposal analyses our current mediawiki-based system workflow and use cases, list the pro's and con's and compare them with nitrate system. The purpose is to find out what features we Must-Have and Nice-to-have in future TCMS, aka nitrate, and nitrate should be customized bases on these requirements.
wiki-based TCMS VS Nitrate System
Wiki | Nitrate |
---|---|
Use cases | |
General Manual Test Use case: For each release:
Then for each build:
|
Manual testing Use Case:
Writing a Test Plan Use Case:
|
Pros
| |
|
|
Cons
| |
|
|
Must-Have and Nice-to-Have
<<TBD>>
Migration work
<<TBD>>