From Fedora Project Wiki
(create an initial server validation matrix) |
(broken "Server validation testing" link should point to the generic Release validation testing page) |
||
Line 1: | Line 1: | ||
This page | This page is intended to record server [[QA:Release_validation_test_plan|validation testing]] test results for the Fedora '''(VERSION) (PRE-RELEASE)''' release. | ||
== How to test == | == How to test == |
Revision as of 03:32, 10 July 2014
This page is intended to record server validation testing test results for the Fedora (VERSION) (PRE-RELEASE) release.
How to test
- Download the ISO images for testing: please use one of the Network product installer images. Delta_ISOs for installer images are also available here.
- Perform one or more of the test cases and add your results to the table below.
- If a test fails, file a bug report, and propose the bug as a blocker for the appropriate release (see blocker bug process). If you notice a problem during a test which does not constitute a complete failure of the test, you should still file a bug report, but it may not be appropriate to propose it as a blocker. Use your judgment in deciding this, with reference to the Fedora_Release_Criteria, which these tests are intended to verify. If you are unsure, err on the side of proposing the bug as a blocker.
- Don't install updates before performing any of the tests, as when you are testing pre-releases, available updates are not part of the proposed released package set.
Add or Remove a Test Case
- Please request review for your changes by publishing your test case for review to server@lists.fedoraproject.org.
- Lastly, update QA:Server validation results template with the same changes.
Key
See the table below for a sample format for test results. All test results are posted using the format specified Template:Result.
Test Result | Explanation | Code Entered |
---|---|---|
Untested - This test has not been run, and is available for anyone to contribute feedback. | {{result|none}}
| |
robatino
|
Passed - The test has been run and the tester determine the test met the expected results | {{result|pass|robatino}}
|
Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn. | {{result|inprogress|adamwill}}
| |
Failed - Indicates a failed test. A link to a bug must be provided. See Template:Result for details on providing bug information. | {{result|fail|jlaska|XYZ|ZXY}}
| |
[1] | Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention.
|
{{result|warn|rhe}} <ref>Brief description about the warning status</ref>
|
Multiple results - More people can easily provide results to a single test case. | {{result|pass|hongqing}} {{result|warn|kparal}}
| |
previous <build> run
|
Result from previous test run - This test result is directly moved from the test run of previous <build>. | {{result|pass|previous <build> run}}
|
Unsupported - An unsupported test or configuration. No testing is required. |
Test Matrix
Release Level | Test Case | x86 | ARM | References |
---|---|---|---|---|
Alpha | QA:Testcase_kickstart_firewall | |||
Alpha | QA:Testcase_realmd_join_kickstart | |||
Alpha | QA:Testcase_realmd_join_server | |||
Alpha | QA:Testcase_FreeIPA_realmd_join | |||
Alpha | QA:Testcase_Server_firewall_default | |||
Alpha | QA:Testcase_Server_cockpit_default |