From Fedora Project Wiki

(added draft note)
No edit summary
Line 1: Line 1:
{{draft}}
{{draft}}


This page objectively compares feature sets of Wiki and Nitrate systems in relation to the [[Rhe/tcms_use_cases|important workflows]]. Instead of displaying a long feature lists, it is divided into groups by use cases. Click ''[show]'' button on each item to view the detailed comparison. To avoid overlaps, features compared in former use cases are not listed in later cases again.
This page objectively compares feature sets of Wiki and Nitrate systems in relation to the [[Tcms_use_cases|important workflows]]. Instead of displaying a long feature lists, it is divided into groups by use cases. To avoid overlaps, features compared in former use cases are not listed in later cases again.


== Key Section ==
== Key Section ==
Line 31: Line 31:
{| class="wikitable collapsible"  border="1" width="85%"
{| class="wikitable collapsible"  border="1" width="85%"
|-  
|-  
! colspan=3 style="background-color: darkgrey;"|Creating A Common Page
! colspan=3 style="background-color: darkgrey;"|Creating A Generic Page
|-  
|-  
! width="20%"|Feature !! width="30%"|fedoraproject.org/wiki !! width="35%"|nitrate  
! width="20%"|Feature !! width="30%"|fedoraproject.org/wiki !! width="35%"|nitrate  
Line 51: Line 51:
|style="background-color:lightgreen;"| {{result|pass}} by cloning or changing the summary(name) of case/plan/run  
|style="background-color:lightgreen;"| {{result|pass}} by cloning or changing the summary(name) of case/plan/run  
|-
|-
| style="color:purple"|Templates creation/use
| Templates creation/use
|style="background-color:lightgreen;"| {{result|pass}} such as [[Special:MostLinkedTemplates]]
|style="background-color:lightgreen;"| {{result|pass}} such as [[Special:MostLinkedTemplates]]
|style="background-color:tomato;"| {{result|fail}}  
|style="background-color:tomato;"| {{result|fail}}  
|-
|-
| style="color:purple"|Editting preview
| Editting preview
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:tomato;"| {{result|fail}}  
|style="background-color:tomato;"| {{result|fail}}  
|-
|-
| style="color:purple"|Supports data entry using a form
| Supports data entry using a form
|style="background-color:tomato;"| {{result|fail}} wiki syntax
|style="background-color:tomato;"| {{result|fail}} wiki syntax
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|-
|-
| style="color:purple"|Talk page
| style="color:purple"|Discussion page
|style="background-color:lightgreen;"| {{result|pass}} Talk page
|style="background-color:tomato;"| {{result|fail}} Can only add comments in test cases
|-
| style="color:red"|History rollback(Undo changes)
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:tomato;"| {{result|warn}} Can only add comments in test cases
|style="background-color:tomato;"| {{result|fail}}  
|-
|-
| style="color:red"|History rollback
| style="color:red"|History comparison
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:tomato;"| {{result|fail}} Only offer change logs
|style="background-color:tomato;"| {{result|fail}}  
|-
|-
| style="color:red"|Changes comparison
| History logs
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:tomato;"| {{result|warn}} Only offer change logs
|style="background-color:lightgreen;"| {{result|pass}} Only offer change logs and text version history of plan and case
|-
| Categories creation
|style="background-color:lightgreen;"| {{result|pass}} manually add new category
|style="background-color:tomato;"| {{result|warn}} cases categories can be added by Admin
|-
| Adding pages to categories
|style="background-color:lightgreen;"| {{result|pass}} manually add category
|style="background-color:tomato;"| {{result|warn}} Only cases have categories
|-
|-
| Subpage using
| Subpage using
Line 100: Line 96:
| width="35%" style="background-color:lightgreen;"| {{result|pass}}change the summary
| width="35%" style="background-color:lightgreen;"| {{result|pass}}change the summary
|-
|-
| Test case template
| Test case format template
|style="background-color:lightgreen;"| {{result|pass}} [[Template:QA/Test_Case]]
|style="background-color:lightgreen;"| {{result|pass}} [[Template:QA/Test_Case]]
|style="background-color:lightgreen;"| {{result|pass}} Defined
|style="background-color:lightgreen;"| {{result|pass}} Defined
Line 106: Line 102:
| Linking files/packages/images
| Linking files/packages/images
|style="background-color:lightgreen;"| {{result|pass}} Upload somewhere and link to it
|style="background-color:lightgreen;"| {{result|pass}} Upload somewhere and link to it
|style="background-color:lightgreen;"| {{result|pass}} Test cases/plans support attachments
|style="background-color:lightgreen;"| {{result|pass}} Test cases/plans support attachments or link to wiki
|-
|-
| Case draft status
| Case draft status
|style="background-color:tomato;"| {{result|fail}} manually add draft category/note
|style="background-color:lightgreen;"| {{result|warn}} manually add draft category/note
|style="background-color:lightgreen;"| {{result|pass}} Set as PROPOSED or NEED_UPDATE
|style="background-color:lightgreen;"| {{result|pass}} Set as PROPOSED or NEED_UPDATE
|-
|-
Line 119: Line 115:
|style="background-color:lightgreen;"| {{result|pass}} manually add to category
|style="background-color:lightgreen;"| {{result|pass}} manually add to category
|style="background-color:lightgreen;"| {{result|pass}} add category or use tag or add to plan to group cases
|style="background-color:lightgreen;"| {{result|pass}} add category or use tag or add to plan to group cases
|-
| style="color:red"|Categories creation permission
|style="background-color:lightgreen;"| {{result|pass}} user can create it with certain permission
|style="background-color:tomato;"| {{result|warn}} cases categories can only be added by Admin
|-
|-
| style="color:red"|Description part in test case
| style="color:red"|Description part in test case
Line 130: Line 130:
| Test case re-use (write once, link anywhere)
| Test case re-use (write once, link anywhere)
|style="background-color:lightgreen;"| {{result|pass}} search from Category and link to it
|style="background-color:lightgreen;"| {{result|pass}} search from Category and link to it
|style="background-color:lightgreen;"| {{result|pass}} clone from other plans
|style="background-color:lightgreen;"| {{result|pass}} test runs re-use from a plan, plans clone from other plans
|-
|-
| The time historical test case results be available
| style="color:purple"|The time historical test case results be available
|style="background-color:lightgreen;"| {{result|pass}} all history?
|style="background-color:lightgreen;"| {{result|pass}} all history?
|style="background-color:yellow;"| {{result|unknown}} unknown
|style="background-color:yellow;"| {{result|unknown}} unknown
|-
|-
| Referencing to versioned history
| style="color:purple"|Re-use old versioned test case
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}} by linking to its history
|style="background-color:tomato;"| {{result|fail}} can view text history and version
|style="background-color:tomato;"| {{result|fail}} can view text history and version only
|-
|-
|}
|}
Line 150: Line 150:
|-
|-
| Linking test cases
| Linking test cases
|style="background-color:lightgreen;"| {{result|pass}} linking to cases section on test result template page
|style="background-color:lightgreen;"| {{result|pass}} link to cases section on test result template page
|style="background-color:lightgreen;"| {{result|pass}} clone from other plans
|style="background-color:lightgreen;"| {{result|pass}} clone from other plans/create new tests
|-
|-
| style="color:purple"|Plan draft status
| style="color:purple"|Plan draft status
|style="background-color:tomato;"| {{result|fail}} manually add draft category/note
|style="background-color:lightgreen;"| {{result|warn}} manually add draft category/note
|style="background-color:tomato;"| {{result|fail}} Set as non-active?
|style="background-color:tomato;"| {{result|fail}} Set as non-active?
|-
|-
| style="color:purple"|Plan review status
| style="color:purple"|Plan review status
|style="background-color:tomato;"| {{result|fail}} manually add reviewer and review time
|style="background-color:lightgreen;"| {{result|warn}} manually add reviewer and review time
|style="background-color:tomato;"| {{result|fail}} Set as active
|style="background-color:tomato;"| {{result|fail}} Set as active?
|-
|-
| Categorizing plans
| Categorizing plans
Line 168: Line 168:
{| class="wikitable collapsible"  border="1" width="85%"
{| class="wikitable collapsible"  border="1" width="85%"
|-
|-
! colspan=3 style="background-color: darkgrey;"| Creating A Test Result Page Template  
! colspan=3 style="background-color: darkgrey;"| Creating A Test Result Page(Test Run) Template  
|-
|-
| width="20%"| Result Page Template
| width="20%" |Result Page(Test Run) Template
| width="30%" style="background-color:lightgreen;"| {{result|pass}}  
| width="30%" style="background-color:lightgreen;"| {{result|pass}}  
| width="35%" style="background-color:tomato;"| {{result|fail}} doesn't support result page template creation. Test run(result page) can be cloned from previous run with modifications.
| width="35%" style="background-color:tomato;"| {{result|fail}} doesn't support template creation. Test run(result page) can be cloned from previous run with modifications.
|-
|-
| Sortable table
| Sortable table
Line 182: Line 182:
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|-
|-
| style="color:purple"|Group cases (by media)
| style="color:red"|Group cases (by media)
|style="background-color:lightgreen;"| {{result|pass}}flexible wiki design
|style="background-color:lightgreen;"| {{result|pass}}flexible wiki design
|style="background-color:tomato;"| {{result|fail}}  
|style="background-color:tomato;"| {{result|fail}} diff test runs;sorting;diff tags
|-
|-
|}
|}
{| class="wikitable collapsible"  border="1" width="85%"
{| class="wikitable collapsible"  border="1" width="85%"
|-
|-
! colspan=3 style="background-color: darkgrey;"|Creating A Test Result Page
! colspan=3 style="background-color: darkgrey;"|Creating A Test Result Page(Test Run)
|-
|-
|width="20%" style="color:purple"|Test result page creation
|width="20%" |Test result page(Test run) creation
|width="30%" style="background-color:lightgreen;"| {{result|pass}}  
|width="30%" style="background-color:lightgreen;"| {{result|pass}}  
|width="35%" style="background-color:lightgreen;"| {{result|warn}} Create from plans
|width="35%" style="background-color:lightgreen;"| {{result|warn}} Create from plans
|-
|-
| style="color:red"|Contents in test result page
| style="color:red"|documents in test result page
|style="background-color:lightgreen;"| {{result|pass}} flexible wiki markup design
|style="background-color:lightgreen;"| {{result|pass}} flexible wiki markup design
|style="background-color:tomato;"| {{result|warn}} write in 'Notes' field without any syntax except cases
|style="background-color:tomato;"| {{result|warn}} write in 'Notes' field without any syntax  
|-
|-
| style="color:red"|Moving test results
| style="color:red"|Moving test results
Line 234: Line 234:
| style="color:red"|Multiple contributions for each case
| style="color:red"|Multiple contributions for each case
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:tomato;"| {{result|fail}} only display the last modified one
|style="background-color:tomato;"| {{result|fail}} only display the last modified one and logs
|-
|-
| *Signatures using
| *Signatures using
Line 258: Line 258:
! colspan=3 style="background-color: darkgrey;"|Uploading Files
! colspan=3 style="background-color: darkgrey;"|Uploading Files
|-
|-
|width="20%" | Upload files/packages/images
|width="20%" style="color:purple"|Upload files/packages/images
|width="30%" style="background-color:lightgreen;"| {{result|pass}} upload somewhere and link to it
|width="30%" style="background-color:lightgreen;"| {{result|pass}} upload somewhere and link to it
|width="35%" style="background-color:lightgreen;"| {{result|warn}} test cases/plans support attachments(test run doesn't)
|width="35%" style="background-color:lightgreen;"| {{result|warn}} test cases/plans support attachments, test runs don't
|-
|-
| style="color:purple"|Upload updates.img/repo to certain server
|style="color:purple"|Upload updates.img/repo to certain server
|style="background-color:lightgreen;"| {{result|pass}} fedorapeople server
|style="background-color:lightgreen;"| {{result|pass}} fedorapeople server
|style="background-color:tomato;"| {{result|fail}} link to wiki.
|style="background-color:tomato;"| {{result|fail}} link to wiki.
Line 273: Line 273:
|width="20%" | Result summary/report generation
|width="20%" | Result summary/report generation
|width="30%" style="background-color:tomato;"| {{result|fail}} run curl command
|width="30%" style="background-color:tomato;"| {{result|fail}} run curl command
|width="35%" style="background-color:lightgreen;"| {{result|pass}} automatic
|width="35%" style="background-color:lightgreen;"| {{result|pass}} automaticly
|-
|-
|}
|}
Line 292: Line 292:
|style="background-color:tomato;"| {{result|fail}}
|style="background-color:tomato;"| {{result|fail}}
|-
|-
| Integration with [https://admin.fedoraproject.org/accounts/ FAS]
| style="color:red"|Feature extension
|style="background-color:lightgreen;"| {{result|pass}}
|style="background-color:lightgreen;"| {{result|pass}} Plugins
|style="background-color:yellow;"| {{result|unknown}}
|style="background-color:yellow;"| {{result|unknown}} Add-ons?
|-
| Feature extension
|style="background-color:lightgreen;"| {{result|pass}} Add plugin
|style="background-color:yellow;"| {{result|unknown}} Add plugin?
|-
|-
| style="color:red"|Page protection
| style="color:red"|Page protection
Line 304: Line 300:
|style="background-color:yellow;"| {{result|unknown}}  
|style="background-color:yellow;"| {{result|unknown}}  
|-
|-
| Case/plan deletion
| Case/plan/run deletion
|style="background-color:lightgreen;"| {{result|pass}} by Admin
|style="background-color:lightgreen;"| {{result|pass}} by Admin
|style="background-color:lightgreen;"| {{result|pass}} Set as DISABLED. Test run can be deleted.
|style="background-color:lightgreen;"| {{result|pass}} Set as DISABLED. Test run can be deleted.
|-
|-
| Licensing
| Licensing
|style="background-color:green;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:green;"| {{result|pass}}
|style="background-color:lightgreen;"| {{result|pass}}
|-
|-
| License the content
| style="color:red"|License the content
|style="background-color:green;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:yellow;"| {{result|unknown}} should match wiki
|style="background-color:yellow;"| {{result|unknown}} should match wiki
|-
|-
| Integration between update tools (bodhi/f-e-k) and our test infrastructure.
| Integration with [https://admin.fedoraproject.org/accounts/ FAS]
|style="background-color:green;"| {{result|pass}} investigating
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:yellow;"| {{result|unknown}}
|style="background-color:yellow;"| {{result|unknown}}
|-
|-
| Upstream project community
| style="color:purple"|Integration between update tools (bodhi/f-e-k) and our test infrastructure.
|style="background-color:green;"| {{result|pass}} upstream wiki list
|style="background-color:lightgreen;"| {{result|pass}} investigating
|style="background-color:green;"| {{result|pass}} upstream nitrate list
|style="background-color:yellow;"| {{result|unknown}}
|-
| style="color:red"|Upstream project community
|style="background-color:lightgreen;"| {{result|pass}} upstream wiki list
|style="background-color:lightgreen;"| {{result|pass}} upstream nitrate list
|-
|-
|}
|}
Line 329: Line 329:
! colspan=3 style="background-color: darkgrey;"|Test Days
! colspan=3 style="background-color: darkgrey;"|Test Days
|-
|-
|width="20%" | Test day main/intro page
|width="20%" style="color:red"|Test day main/intro page
|width="30%" style="background-color:lightgreen;"| {{result|pass}}  
|width="30%" style="background-color:lightgreen;"| {{result|pass}}  
|width="35%" style="background-color:tomato;"| {{result|fail}} link to wiki.
|width="35%" style="background-color:tomato;"| {{result|fail}} link to wiki?
|-
|-
| Test day SOP guide page
|style="color:red"|Test day SOP guide page
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:tomato;"| {{result|fail}}link to wiki.
|style="background-color:tomato;"| {{result|fail}}link to wiki?
|-
|-
| Test day/event result template page
|Test day/event result template page
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:tomato;"| {{result|fail}} Clone from previous test run.
|style="background-color:tomato;"| {{result|fail}} Clone from previous test run
|-
|-
| Test day schedule
|style="color:red"|Test day schedule
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:tomato;"| {{result|fail}} link to wiki.
|style="background-color:tomato;"| {{result|fail}} link to wiki?
|-
|-
| style="color:red"|Test day page creation  
|style="color:red"|Test day page(run) creation  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:tomato;"| {{result|fail}} test runs can only be created from plans
|style="background-color:tomato;"| {{result|fail}} test runs can only be created from plans
|-
|-
| style="color:red"|Test day page contents
|style="color:red"|Test day page documented contents
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:tomato;"| {{result|fail}} write all intro to 'Notes' field will be too crowded!
|style="background-color:tomato;"| {{result|fail}} write all intro to 'Notes' field will be too crowded!
|-
|-
| Test day notification
|style="color:purple"|Test day notification
|style="background-color:tomato;"| {{result|fail}} send out announcement manually  
|style="background-color:tomato;"| {{result|fail}} send out announcement manually  
|style="background-color:lightgreen;"| {{result|warn}} Assign through mail, but the content is very brief.
|style="background-color:tomato;"| {{result|warn}} can assign through mail, but mail content is little.
|-
|-
|}
|}
Line 362: Line 362:
! colspan=3 style="background-color: darkgrey;"|Release Validation Test Event  
! colspan=3 style="background-color: darkgrey;"|Release Validation Test Event  
|-
|-
|width="20%" | Test event Main/intro page
|width="20%" style="color:red"|Test event Main/intro page
|width="30%" style="background-color:lightgreen;"| {{result|pass}}  
|width="30%" style="background-color:lightgreen;"| {{result|pass}}  
|width="35%" style="background-color:tomato;"| {{result|fail}} link to wiki.
|width="35%" style="background-color:tomato;"| {{result|fail}} link to wiki?
|-
|-
| Test event SOP guide page
|style="color:red"|Test event SOP guide page
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:tomato;"| {{result|fail}}link to wiki.
|style="background-color:tomato;"| {{result|fail}}link to wiki?
|-
|-
| test event Result template page
|Test event Result template page
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:tomato;"| {{result|fail}} Clone from previous test run.
|style="background-color:tomato;"| {{result|fail}} Clone from previous test run.
|-
|-
| Release Criteria page
|style="color:red"|Release Criteria page
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:tomato;"| {{result|fail}} link to wiki.
|style="background-color:tomato;"| {{result|fail}} link to wiki?
|-
|-
| style="color:red"|Test cases priority
|style="color:red"|Test cases priority
|style="background-color:tomato;"| {{result|fail}} manually add priority before each case link
|style="background-color:tomato;"| {{result|fail}} manually add priority before each case link
|style="background-color:lightgreen;"| {{result|warn}} from P1 to P5, need change to: Alpha, Beta, Final.
|style="background-color:lightgreen;"| {{result|warn}} from P1 to P5, need change to: Alpha, Beta, Final.
|-
|-
| style="color:red"|Each case with different platforms
|style="color:red"|Each case with different platforms
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}
|style="background-color:tomato;"| {{result|fail}} ?? two test runs for both platforms?
|style="background-color:tomato;"| {{result|fail}} two test runs for both platforms or clone each case for another platform
|-
|-
| Test result page creation  
|Test result page(Test run) creation  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}} created from plans
|style="background-color:lightgreen;"| {{result|pass}} created from plans
|-
|-
| Test result page contents
|style="color:red"|Test result page documented contents
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|pass}}  
|style="background-color:lightgreen;"| {{result|warn}} write intro to 'Notes' field without any syntax  
|style="background-color:lightgreen;"| {{result|warn}} write intro to 'Notes' field without any syntax  
|-
|style="color:purple"|Test event notification
|style="background-color:tomato;"| {{result|fail}} send out announcement manually
|style="background-color:lightgreen;"| {{result|warn} can assign through mail, but the content is little.
|-
|-
| Progress bar for each run
| Progress bar for each run

Revision as of 11:07, 24 January 2011

This page is a draft only
It is still under construction and content may change. Do not rely on the information on this page.

This page objectively compares feature sets of Wiki and Nitrate systems in relation to the important workflows. Instead of displaying a long feature lists, it is divided into groups by use cases. To avoid overlaps, features compared in former use cases are not listed in later cases again.

Key Section

Colour Explanation
Pass pass
Supported
Fail fail
Unsupported currently
Unknown unknown
Unknown/Research needed
A Feature A is Nice-to-Have
B Feature B is Must-Have


Wiki vs Nitrate Feature Comparison

Creating A Generic Page
Feature fedoraproject.org/wiki nitrate
Any page creation
Pass pass
Fail fail
Can only create test case/plan/run
Readable link names
Pass pass
human-readable link names
Fail fail
use ID for identification
Data entry format mediawiki markup tinyMCE
Moving a Page
Pass pass
by redirect links
Pass pass
by cloning or changing the summary(name) of case/plan/run
Templates creation/use
Pass pass
such as Special:MostLinkedTemplates
Fail fail
Editting preview
Pass pass
Fail fail
Supports data entry using a form
Fail fail
wiki syntax
Pass pass
Discussion page
Pass pass
Talk page
Fail fail
Can only add comments in test cases
History rollback(Undo changes)
Pass pass
Fail fail
History comparison
Pass pass
Fail fail
History logs
Pass pass
Pass pass
Only offer change logs and text version history of plan and case
Subpage using
Pass pass
Unknown unknown
by Tree View?
Bookmarks/watchlist
Pass pass
watch the page
Pass pass
bookmark the page
Creating A Test Case
Renaming a case
Warning warn
move to another page
Pass pass
change the summary
Test case format template
Pass pass
Template:QA/Test_Case
Pass pass
Defined
Linking files/packages/images
Pass pass
Upload somewhere and link to it
Pass pass
Test cases/plans support attachments or link to wiki
Case draft status
Warning warn
manually add draft category/note
Pass pass
Set as PROPOSED or NEED_UPDATE
Case review status
Fail fail
approved in ticket or somewhere else
Pass pass
Set as CONFIRMED
Categorizing cases
Pass pass
manually add to category
Pass pass
add category or use tag or add to plan to group cases
Categories creation permission
Pass pass
user can create it with certain permission
Warning warn
cases categories can only be added by Admin
Description part in test case
Pass pass
Fail fail
only have setup and notes parts
Tests that impact multiple packages
Warning warn
Categories could be used to organize this data, but get messy
Pass pass
allows linking tests to the packages they are designed to test
Test case re-use (write once, link anywhere)
Pass pass
search from Category and link to it
Pass pass
test runs re-use from a plan, plans clone from other plans
The time historical test case results be available
Pass pass
all history?
Unknown unknown
unknown
Re-use old versioned test case
Pass pass
by linking to its history
Fail fail
can view text history and version only
Creating A Test Plan
Test Plan re-use/update
Pass pass
copy contents from previous
Pass pass
clone previous plans
Linking test cases
Pass pass
link to cases section on test result template page
Pass pass
clone from other plans/create new tests
Plan draft status
Warning warn
manually add draft category/note
Fail fail
Set as non-active?
Plan review status
Warning warn
manually add reviewer and review time
Fail fail
Set as active?
Categorizing plans
Pass pass
manually add to category
Pass pass
no category for plan but have Plan Type and Tag etc.
Creating A Test Result Page(Test Run) Template
Result Page(Test Run) Template
Pass pass
Fail fail
doesn't support template creation. Test run(result page) can be cloned from previous run with modifications.
Sortable table
Pass pass
Pass pass
using sort
Collapse table
Warning warn
hard to manage as a whole
Pass pass
Group cases (by media)
Pass pass
flexible wiki design
Fail fail
diff test runs;sorting;diff tags
Creating A Test Result Page(Test Run)
Test result page(Test run) creation
Pass pass
Warning warn
Create from plans
documents in test result page
Pass pass
flexible wiki markup design
Warning warn
write in 'Notes' field without any syntax
Moving test results
Pass pass
manually copy
Fail fail
manually add one by one?
Directing to current test run
Pass pass
redirect links to current result page
Fail fail
set test run as running or finished
Categorizing runs/result pages
Pass pass
manually add to category
Pass pass
Can set 'product', 'version' and 'tag' etc
Posting Test Results
Quick access to active test runs
Pass pass
Open 'current' links
Fail fail
search the run's ID or search my runs(assigned to me in advance)
Result format
Pass pass
use Template:Result
Pass pass
defined
Comment as references
Pass pass
Pass pass
Bug posting
Pass pass
use Template:Bz
Pass pass
Multiple contributions for each case
Pass pass
Fail fail
only display the last modified one and logs
*Signatures using
Pass pass
~~~~ -> Rhe 09:59, 18 January 2011 (UTC)
Fail fail
Searching Test Results/Cases/Plans
Searching cases/plans/runs
Fail fail
only by searching from categories or name
Pass pass
advanced search
Toolbox(what links to here)
Pass pass
Pass pass
plans, cases, and runs related to each other
Uploading Files
Upload files/packages/images
Pass pass
upload somewhere and link to it
Warning warn
test cases/plans support attachments, test runs don't
Upload updates.img/repo to certain server
Pass pass
fedorapeople server
Fail fail
link to wiki.
Generating A Test Summary
Result summary/report generation
Fail fail
run curl command
Pass pass
automaticly
Administrating
Authorities for pages
Pass pass
Use namespaces
Unknown unknown
Can admin configure it?
Supporting anonymous user read-only access
Pass pass
Pass pass
Supporting anonymous user read-write access
Pass pass
Fail fail
Feature extension
Pass pass
Plugins
Unknown unknown
Add-ons?
Page protection
Pass pass
by Admin
Unknown unknown
Case/plan/run deletion
Pass pass
by Admin
Pass pass
Set as DISABLED. Test run can be deleted.
Licensing
Pass pass
Pass pass
License the content
Pass pass
Unknown unknown
should match wiki
Integration with FAS
Pass pass
Unknown unknown
Integration between update tools (bodhi/f-e-k) and our test infrastructure.
Pass pass
investigating
Unknown unknown
Upstream project community
Pass pass
upstream wiki list
Pass pass
upstream nitrate list
Test Days
Test day main/intro page
Pass pass
Fail fail
link to wiki?
Test day SOP guide page
Pass pass
Fail fail
link to wiki?
Test day/event result template page
Pass pass
Fail fail
Clone from previous test run
Test day schedule
Pass pass
Fail fail
link to wiki?
Test day page(run) creation
Pass pass
Fail fail
test runs can only be created from plans
Test day page documented contents
Pass pass
Fail fail
write all intro to 'Notes' field will be too crowded!
Test day notification
Fail fail
send out announcement manually
Warning warn
can assign through mail, but mail content is little.
Release Validation Test Event
Test event Main/intro page
Pass pass
Fail fail
link to wiki?
Test event SOP guide page
Pass pass
Fail fail
link to wiki?
Test event Result template page
Pass pass
Fail fail
Clone from previous test run.
Release Criteria page
Pass pass
Fail fail
link to wiki?
Test cases priority
Fail fail
manually add priority before each case link
Warning warn
from P1 to P5, need change to: Alpha, Beta, Final.
Each case with different platforms
Pass pass
Fail fail
two test runs for both platforms or clone each case for another platform
Test result page(Test run) creation
Pass pass
Pass pass
created from plans
Test result page documented contents
Pass pass
Warning warn
write intro to 'Notes' field without any syntax
Test event notification
Fail fail
send out announcement manually 		{{result|warn} can assign through mail, but the content is little.
Progress bar for each run
Fail fail
Pass pass
Retrieved from "https://fedoraproject.org/w/index.php?title=Tcms_Comparison&oldid=216973"