From Fedora Project Wiki

(Created page with 'This page aims to list feature requirements for Nitrate system for the smooth test cases/plans/runs transition from Wiki to Nitrate TCMS. It identifies Must-Have and Nice-To-Have...')
 
 
(8 intermediate revisions by 2 users not shown)
Line 1: Line 1:
{{draft}}
This page aims to list feature requirements for Nitrate system for the smooth test cases/plans/runs transition from Wiki to Nitrate TCMS. It identifies Must-Have and Nice-To-Have features missed currently in Nitrate TCMS based on [[Tcms_Comparison|feature comparison table]].
This page aims to list feature requirements for Nitrate system for the smooth test cases/plans/runs transition from Wiki to Nitrate TCMS. It identifies Must-Have and Nice-To-Have features missed currently in Nitrate TCMS based on [[Tcms_Comparison|feature comparison table]].


Line 5: Line 7:


{| class="wikitable sortable" border="1"  
{| class="wikitable sortable" border="1"  
!Feature||Description
!Solution on Nitrate
!Bug No.
|-
|-
!Feature!!Description
| History rollback
|-
| User can view/compare history versions and undo changes, see [https://fedoraproject.org/w/index.php?title=QA/TestCases/BootMethodsBootIso&action=history one], and [https://fedoraproject.org/w/index.php?title=QA%2FTestCases%2FBootMethodsBootIso&diff=188386&oldid=141783 another example].
| History rollback(Undo changes)
| Discussion with TCMS team needed to achieve this step by step.
| User can view history versions and undo changes, see [https://fedoraproject.org/w/index.php?title=QA/TestCases/BootMethodsBootIso&action=history example]
| <references/>
|-
| History comparison
| Different versions can compare with each other, see [https://fedoraproject.org/w/index.php?title=QA%2FTestCases%2FBootMethodsBootIso&diff=188386&oldid=141783 example]
|-
| Categories creation permission
| User who generates the case should have permission to create a new category.(or use tag in nitrate instead?)
|-
|-
| Description part in test case  
| Description part in test case  
| See the description in the [https://fedoraproject.org/wiki/QA/TestCases/BootMethodsBootIso example], modify “Setup” to adapt it? 
| See the Description field in the [https://fedoraproject.org/wiki/QA/TestCases/BootMethodsBootIso example]
| Write this in 'Note' field, add tinyMCE syntax editing to it.
| <references/>
|-
|-
| Group cases (by media)  
| Grouping cases (by media)  
| better to separate the cases to different groups in one test run. [https://fedoraproject.org/wiki/Test_Results:Current_Installation_Test#Test_Matrix An example] on wiki.  
| better to separate the cases to different groups in one test run. [https://fedoraproject.org/wiki/Test_Results:Current_Installation_Test#Test_Matrix An example on wiki].
| More exploration needed during pilot instance.
| <references/>
|-
|-
| Documents in test result page(Run)
| Documents in test result page(Run)
| The area and syntax for the documents in test result page.
| The area and syntax for the documents in test result page, such as contents on [[Test_Day:2011-01-27_Network_Device_Naming_With_Biosdevname|the example run page]].
| add tinyMCE syntax to “Notes” field or link to wiki documentation pages.
| <references/>
|-
|-
| Moving test results  
| Moving test results  
| Moving previous results in a test run to another.
| Moving previous results from previous test run to new run.
| Selectively include test cases when creating a new test run. On the other hand, the calculation/summary of the new run need support adding previous run results into account.
| <references/>
|-
|-
| Result format  
| Result format  
| Nitrate doesn't have 'warn' but has 'error' result status. Modify it to 'warn'?
| Nitrate doesn't have 'warn' status which indicates the test
passed, but other bugs were discovered while executing the test. Add or modify 'error' status to 'warn'?
| Mark the test PASS, and linking to additional bugs filed.
| <references/>
|-
|-
| Multiple contributions for each case  
| Multiple contributions for each case  
| [[https://fedoraproject.org/wiki/Test_Results:Current_Installation_Test#Key An example]] to show multiple results for one case on wiki.
| [https://fedoraproject.org/wiki/Test_Results:Current_Installation_Test#Key An example] to show multiple results for one case on wiki.  
| Feature required to allow multiple testers to provide feedback on a single test given that the environment under test (hardware) can vary for tests.
| <references/>
|-
|-
| Authorities for pages  
| Authorities/protection for certain pages  
| Pages with different namespaces can have different permissions.
| Pages with different namespaces can have different permissions.
| Admin the permissions by different user groups. Integration with FAS.
| <references/>
|-
|-
| Supporting anonymous user read-write access  
| Supporting anonymous user read-write access  
| Anonymous have read-write access for certain test runs.
| Anonymous have read-write access for certain test runs.
| Feature required.
| <references/>
|-
|-
| Page protection
| Integration with FAS
| Protect certain plans/cases
| Integrated with Fedora Account System: https://fedorahosted.org/fas/.
| Feature required.
| <references/>
|-
|-
| License the content  
| License the content  
| License the contents the same with wiki
| "GOOD" content license
| Should be in the list of "GOOD" licenses - https://fedoraproject.org/wiki/Licensing#Good_Licenses_3
| <references/>
|-
|-
| Upstream project community
| Upstream project community
| monitoring it and actively discussing topics.
| monitoring nitrate-devel@, and file/share requirements to bugzilla.
| Actively discussing topics/release notes/plans etc. Open permission for TCMS bugs on bugzilla.
| <references/>
|-
|-
| Test day page(run) creation  
| Test day page(run) creation  
| Test Day Plan and its cases are needed to create test day Run.
| Test Day Plan and its cases are needed to create test day Run.
|-
| Consider each test day as a test plan. More exploration needed during pilot instance.
| Test day page documented contents
| <references/>
| Documentation area(instead of 'Notes') is needed to place contents.
|-
|-
| Test cases priority  
| Test cases priority  
| Nitrate has P1, P2, P3..., modify to Alpha, Beta, Final?
| Nitrate has P1, P2, P3..., modify to Alpha, Beta, Final?
| Admins should be able to control over re-defining the values to something appropriate for Fedora.
| <references/>
|-
|-
| Each case with different platforms  
| Each case with different platforms  
| Better support two platform results submitting for each case
| Better support two platform results submitting for each case
| If it's hard to implement, set up two runs as a workaround: 1. RC1 - Installation (i386) 2. RC1 - Installation (x86_64)
| <references/>
|-
|-
| Test result page documented contents
| Import xml file
| The 'Notes' area can only place short contents.
| The Nitrate system should be able to import test cases from xml file.
| Nitrate system should at least be able to import from xml file which has the testopia format.
| {{bz|679637}}<references/>
|-
|-
|}
|}

Latest revision as of 05:43, 5 May 2011

This page is a draft only
It is still under construction and content may change. Do not rely on the information on this page.

This page aims to list feature requirements for Nitrate system for the smooth test cases/plans/runs transition from Wiki to Nitrate TCMS. It identifies Must-Have and Nice-To-Have features missed currently in Nitrate TCMS based on feature comparison table.

Must-Have

Feature Description Solution on Nitrate Bug No.
History rollback User can view/compare history versions and undo changes, see one, and another example. Discussion with TCMS team needed to achieve this step by step.
Description part in test case See the Description field in the example Write this in 'Note' field, add tinyMCE syntax editing to it.
Grouping cases (by media) better to separate the cases to different groups in one test run. An example on wiki. More exploration needed during pilot instance.
Documents in test result page(Run) The area and syntax for the documents in test result page, such as contents on the example run page. add tinyMCE syntax to “Notes” field or link to wiki documentation pages.
Moving test results Moving previous results from previous test run to new run. Selectively include test cases when creating a new test run. On the other hand, the calculation/summary of the new run need support adding previous run results into account.
Result format Nitrate doesn't have 'warn' status which indicates the test

passed, but other bugs were discovered while executing the test. Add or modify 'error' status to 'warn'?

Mark the test PASS, and linking to additional bugs filed.
Multiple contributions for each case An example to show multiple results for one case on wiki. Feature required to allow multiple testers to provide feedback on a single test given that the environment under test (hardware) can vary for tests.
Authorities/protection for certain pages Pages with different namespaces can have different permissions. Admin the permissions by different user groups. Integration with FAS.
Supporting anonymous user read-write access Anonymous have read-write access for certain test runs. Feature required.
Integration with FAS Integrated with Fedora Account System: https://fedorahosted.org/fas/. Feature required.
License the content "GOOD" content license Should be in the list of "GOOD" licenses - https://fedoraproject.org/wiki/Licensing#Good_Licenses_3
Upstream project community monitoring nitrate-devel@, and file/share requirements to bugzilla. Actively discussing topics/release notes/plans etc. Open permission for TCMS bugs on bugzilla.
Test day page(run) creation Test Day Plan and its cases are needed to create test day Run. Consider each test day as a test plan. More exploration needed during pilot instance.
Test cases priority Nitrate has P1, P2, P3..., modify to Alpha, Beta, Final? Admins should be able to control over re-defining the values to something appropriate for Fedora.
Each case with different platforms Better support two platform results submitting for each case If it's hard to implement, set up two runs as a workaround: 1. RC1 - Installation (i386) 2. RC1 - Installation (x86_64)
Import xml file The Nitrate system should be able to import test cases from xml file. Nitrate system should at least be able to import from xml file which has the testopia format. RHBZ #679637


Retrieved from "https://fedoraproject.org/w/index.php?title=Tcms_feature_requirements&oldid=234989"