(created page) |
(never announced) |
||
(3 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
This page is intended to record [[QA: | {{admon/important|No longer current|This candidate is no longer the current milestone. For the latest results, see [[Test_Results:Current_Installation_Test]].}} | ||
This page is intended to record installation [[QA:Release_validation_test_plan|validation testing]] test results for the '''Fedora 21 Alpha TC1''' milestone. | |||
= Instructions = | = Instructions = | ||
This page tracks test results against the Fedora 21 Alpha TC1 build. Test results against other Fedora 21 milestones can be found at [[:Category:Fedora_21_Test_Results]]. The explanation of test case priority is available | This page tracks test results against the Fedora 21 Alpha TC1 build. Test results against other Fedora 21 milestones can be found at [[:Category:Fedora_21_Test_Results]]. The explanation of test case priority is available in [[QA:Release_validation_test_plan#anchor|the release validation test plan]]. | ||
== What To Test == | == What To Test == | ||
* | * [https://dl.fedoraproject.org/pub/alt/stage/F21a-TC1/ Download the required ISO images] for the candidate build under test. Some tests must be run against particular Products or images - for example, the [[#Default boot and install]] tests. If no particular product or image is specified either in this page or the test case page, you can use any appropriate image. For example, you can run most of the [[#General Tests]] with the Workstation live image, or either of the Server install images. | ||
* [[Delta_ISOs]] for install images are available [http://dl.fedoraproject.org/pub/alt/stage/deltaisos/ here]. If you have the Server offline install image for the previous TC/RC (or in the case of Alpha TC1, the previous stable release), you can generate the current install image with greatly reduced download size. | |||
* [[Delta_ISOs]] for install images are available [http://dl.fedoraproject.org/pub/alt/stage/deltaisos/ here]. If you have the install | |||
== Who's available == | == Who's available == | ||
Line 79: | Line 80: | ||
{| class="wikitable sortable" width=100% style="border: solid 2px white" | {| class="wikitable sortable" width=100% style="border: solid 2px white" | ||
|- | |- | ||
! Release Level !! Test Case !! | ! Release Level !! Test Case !! Server !! Workstation !! Spins !! ARM disks !! Cloud | ||
|- | |- | ||
| Alpha / Final | | Alpha / Final | ||
Line 88: | Line 89: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Beta | | Beta | ||
Line 97: | Line 97: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_Mediakit_Repoclosure]] | | [[QA:Testcase_Mediakit_Repoclosure]] | ||
| {{result|none}} | |||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_Mediakit_FileConflicts]] | | [[QA:Testcase_Mediakit_FileConflicts]] | ||
| {{result|none}} | |||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
|- | |- | ||
|} | |} | ||
|} | |} | ||
<references/> | |||
=== Default boot and install === | === Default boot and install === | ||
Line 124: | Line 123: | ||
{{admon/note|Bare metal testing required|Running these tests in a virtualized environment is valuable, but the test must pass on bare metal using a physical install medium for each release-blocking image in each test environment at least for the final release candidate image (i.e. the released image) for each milestone.}} | {{admon/note|Bare metal testing required|Running these tests in a virtualized environment is valuable, but the test must pass on bare metal using a physical install medium for each release-blocking image in each test environment at least for the final release candidate image (i.e. the released image) for each milestone.}} | ||
In all of these tests, the test case used is [[QA:Testcase_Boot_default_install]]. That is where the links point. The same test needs to be run for multiple images and target platforms. | In all of these tests, the test case used is [[QA:Testcase_Boot_default_install]]. That is where the links point. The same test needs to be run for multiple images and target platforms. Note that the non-installer-based ARM disk images are covered by the later [[#ARM disk images]] section. | ||
{| class="wikitable collapsible" border="1" width="85%" | {| class="wikitable collapsible" border="1" width="85%" | ||
Line 161: | Line 160: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| | | style="background:lightgrey;"| | ||
|- | |- | ||
| Optional | | Optional | ||
Line 168: | Line 167: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| | | style="background:lightgrey;"| | ||
|- | |- | ||
| Optional | | Optional | ||
Line 175: | Line 174: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| | | style="background:lightgrey;"| | ||
|- | |- | ||
| Optional | | Optional | ||
Line 182: | Line 181: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| | | style="background:lightgrey;"| | ||
|- | |- | ||
| Optional | | Optional | ||
Line 189: | Line 188: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| | | style="background:lightgrey;"| | ||
|- | |- | ||
|} | |} | ||
|} | |} | ||
<references/> | |||
=== USB stick === | === USB stick === | ||
Line 241: | Line 242: | ||
|} | |} | ||
|} | |} | ||
<references/> | |||
=== ARM disk images === | === ARM disk images === | ||
Line 292: | Line 295: | ||
|} | |} | ||
|} | |} | ||
<references/> | |||
=== Cloud images === | === Cloud images === | ||
Line 315: | Line 320: | ||
|} | |} | ||
|} | |} | ||
<references/> | |||
=== PXE images === | === PXE images === | ||
Line 336: | Line 343: | ||
|} | |} | ||
=== | <references/> | ||
{| class="wikitable collapsible " border="1" width="85%" | |||
=== Storage device tests === | |||
{| class="wikitable collapsible" border="1" width="85%" | |||
|- | |- | ||
! colspan="5" style="background-color: | ! colspan="5" style="background-color: orange;" | Storage device tests | ||
|- | |- | ||
| | | | ||
{| class="wikitable sortable" width=100% style="border: solid 2px white" | {| class="wikitable sortable" width=100% style="border: solid 2px white" | ||
! Release Level !! Test Case !! x86<ref>'x86' means 'x86_64 or i386'</ref> !! ARM | |||
! | |- | ||
| Alpha | |||
| [[QA:Testcase_install_to_SATA]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Alpha | |||
| [[QA:Testcase_install_to_PATA]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Alpha | |||
| [[QA:Testcase_install_to_SCSI]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |- | ||
| Alpha | | Alpha | ||
| | | [[QA:Testcase_install_to_SAS]] | ||
| [[QA: | | {{result|none}} | ||
| {{result|none}} | |||
|- | |||
| Beta | |||
| [[QA:Testcase_install_to_firmware_RAID]] | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| style="background: | |- | ||
| style=" | | Beta | ||
| [[QA:Testcase_install_to_hardware_RAID]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Beta | |||
| [[QA:Testcase_install_to_VirtIO]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Final | |||
| [[QA:Testcase_install_to_iSCSI_no_authentication]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Final | |||
| [[QA:Testcase_install_to_multipath]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Final | |||
| [[QA:Testcase_install_to_FCoE_target]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
|} | |||
|} | |||
<references/> | |||
=== Storage volume type tests === | |||
==== Guided installation ==== | |||
{| class="wikitable collapsible" border="1" width="85%" | |||
|- | |||
! colspan="5" style="background-color: orange;" | Storage volume type tests | |||
|- | |||
| | |||
{| class="wikitable sortable" width=100% style="border: solid 2px white" | |||
! Release Level !! Test Case !! x86 BIOS<ref>'x86' means 'x86_64 or i386'</ref> !! x86 UEFI !! ARM | |||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_partitioning_guided_empty]] | |||
| [[QA: | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_partitioning_guided_delete_all]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_partitioning_guided_multi_select]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Beta | | Beta | ||
| [[QA:Testcase_partitioning_guided_delete_partial]] | |||
| [[QA: | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Beta | | Beta | ||
| [[QA:Testcase_partitioning_guided_free_space]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Beta | | Beta | ||
| [[QA:Testcase_partitioning_guided_encrypted]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| | | Beta | ||
| [[QA:Testcase_partitioning_guided_multi_empty_all]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| | |} | ||
| | |} | ||
| [[QA: | |||
<references/> | |||
==== Guided shrinking ==== | |||
For this test, the column headings refer to the storage volume type ''to be shrunk'', not the one chosen to replace it for the new installation. | |||
{| class="wikitable sortable" border="1" | |||
! Release Level !! Test Case !! LVM !! ext4 !! NTFS !! BTRFS | |||
|- | |||
| Final | |||
| [[QA:Testcase_partitioning_guided_shrink]] | |||
| {{result|none}} | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |||
|} | |||
<references/> | |||
=== General Tests === | |||
{| class="wikitable collapsible " border="1" width="85%" | |||
|- | |||
! colspan="5" style="background-color: lightgreen;" | Install Variations & General Tests | |||
|- | |||
| | |||
{| class="wikitable sortable" width=100% style="border: solid 2px white" | |||
|- | |||
! width="15%"|Release Level !! width="15%"|Test Area !! width="30%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64 !! width="10%"|EFI !! width="10%"|ARM | |||
|- | |- | ||
| Beta | | Beta | ||
Line 812: | Line 890: | ||
|} | |} | ||
|} | |} | ||
Latest revision as of 14:52, 11 September 2014
This page is intended to record installation validation testing test results for the Fedora 21 Alpha TC1 milestone.
Instructions[edit]
This page tracks test results against the Fedora 21 Alpha TC1 build. Test results against other Fedora 21 milestones can be found at Category:Fedora_21_Test_Results. The explanation of test case priority is available in the release validation test plan.
What To Test[edit]
- Download the required ISO images for the candidate build under test. Some tests must be run against particular Products or images - for example, the #Default boot and install tests. If no particular product or image is specified either in this page or the test case page, you can use any appropriate image. For example, you can run most of the #General Tests with the Workstation live image, or either of the Server install images.
- Delta_ISOs for install images are available here. If you have the Server offline install image for the previous TC/RC (or in the case of Alpha TC1, the previous stable release), you can generate the current install image with greatly reduced download size.
Who's available[edit]
The following cast of characters will be available testing, workarounds, bug fixes, general discussion ...
- IRC: #fedora-qa on irc.freenode.net
- Quality Assurance - User:Robatino, User:Hongqing,User:adamwill, User:wutao85
Add or Remove a Test Case[edit]
- Please request review for your changes by publishing your test case for review to test list.
- Once reviewed, make your changes to this document
- Finally, update QA:Fedora_21_Install_Results_Template with the same changes.
Key[edit]
See the table below for a sample format for test results. All test results are posted using the format specified Template:Result.
Test Results Format | ||
---|---|---|
Test Result | Explanation | Code Entered |
Untested - This test has not been run, and is available for anyone to contribute feedback. | {{result|none}}
| |
robatino
|
Passed - The test has been run and the tester determine the test met the expected results | {{result|pass|robatino}}
|
Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn. | {{result|inprogress|adamwill}}
| |
Failed - Indicates a failed test. A link to a bug must be provided. See Template:Result for details on providing bug information. | {{result|fail|jlaska|XYZ|ZXY}}
| |
[1] | Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention.
|
{{result|warn|rhe}} <ref>Brief description about the warning status</ref>
|
Multiple results - More people can easily provide results to a single test case. | {{result|pass|hongqing}} {{result|warn|kparal}}
| |
previous <build> run
|
Result from previous test run - This test result is directly moved from the test run of previous <build>. | {{result|pass|previous <build> run}}
|
Unsupported - An unsupported test or configuration. No testing is required. |
Test Matrix[edit]
Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.
Image sanity[edit]
Image sanity tests | |||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Default boot and install[edit]
In all of these tests, the test case used is QA:Testcase_Boot_default_install. That is where the links point. The same test needs to be run for multiple images and target platforms. Note that the non-installer-based ARM disk images are covered by the later #ARM disk images section.
Default boot and install | ||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
USB stick[edit]
USB stick tests | ||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
ARM disk images[edit]
In all of these tests, the test case used is QA:Testcase_arm_image_deployment. That is where the links point. The same test needs to be run for multiple images and target platforms.
ARM disk image functionality | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Cloud images[edit]
Cloud images | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
|
PXE images[edit]
PXE boot tests | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Storage device tests[edit]
Storage device tests | ||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
- ↑ 'x86' means 'x86_64 or i386'
Storage volume type tests[edit]
Guided installation[edit]
Storage volume type tests | ||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
- ↑ 'x86' means 'x86_64 or i386'
Guided shrinking[edit]
For this test, the column headings refer to the storage volume type to be shrunk, not the one chosen to replace it for the new installation.
Release Level | Test Case | LVM | ext4 | NTFS | BTRFS |
---|---|---|---|---|---|
Final | QA:Testcase_partitioning_guided_shrink |