(rejig image sanity table for Productization) |
(add software raid back (to the storage volume type tests)) |
||
(8 intermediate revisions by 2 users not shown) | |||
Line 3: | Line 3: | ||
= Instructions = | = Instructions = | ||
This page tracks test results against the Fedora 21 build. Test results against other Fedora 21 milestones can be found at [[:Category:Fedora_21_Test_Results]]. The explanation of test case priority is available | This page tracks test results against the Fedora 21 build. Test results against other Fedora 21 milestones can be found at [[:Category:Fedora_21_Test_Results]]. The explanation of test case priority is available in [[QA:Release_validation_test_plan#anchor|the release validation test plan]]. | ||
== What To Test == | == What To Test == | ||
Line 14: | Line 14: | ||
The following cast of characters will be available testing, workarounds, bug fixes, general discussion ... | The following cast of characters will be available testing, workarounds, bug fixes, general discussion ... | ||
* IRC: [irc://irc.freenode.net/fedora-qa #fedora-qa] on irc.freenode.net | * IRC: [irc://irc.freenode.net/fedora-qa #fedora-qa] on irc.freenode.net | ||
* Quality Assurance - [[User:Robatino]], [[User: | * Quality Assurance - [[User:Robatino | Robatino ]], [[User:adamwill | adamwill ]], [[User:wutao85 | wutao85 ]], [[User:pschindl | pschindl]] | ||
== Add or Remove a Test Case == | == Add or Remove a Test Case == | ||
Line 78: | Line 78: | ||
{| class="wikitable sortable" width=100% style="border: solid 2px white" | {| class="wikitable sortable" width=100% style="border: solid 2px white" | ||
|- | |- | ||
! Release Level !! Test Case !! Server !! Workstation !! Spins !! ARM disks !! Cloud | ! Release Level !! Test Case !! Server !! Workstation !! Spins !! ARM disks !! Cloud | ||
|- | |- | ||
| Alpha / Final | | Alpha / Final | ||
Line 87: | Line 87: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Beta | | Beta | ||
Line 96: | Line 95: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Alpha | | Alpha | ||
Line 105: | Line 103: | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
|- | |- | ||
| Alpha | | Alpha | ||
Line 114: | Line 111: | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
|- | |- | ||
|} | |} | ||
|} | |} | ||
<references/> | |||
=== Default boot and install === | === Default boot and install === | ||
Line 123: | Line 121: | ||
{{admon/note|Bare metal testing required|Running these tests in a virtualized environment is valuable, but the test must pass on bare metal using a physical install medium for each release-blocking image in each test environment at least for the final release candidate image (i.e. the released image) for each milestone.}} | {{admon/note|Bare metal testing required|Running these tests in a virtualized environment is valuable, but the test must pass on bare metal using a physical install medium for each release-blocking image in each test environment at least for the final release candidate image (i.e. the released image) for each milestone.}} | ||
In all of these tests, the test case used is [[QA:Testcase_Boot_default_install]]. That is where the links point. The same test needs to be run for multiple images and target platforms. | In all of these tests, the test case used is [[QA:Testcase_Boot_default_install]]. That is where the links point. The same test needs to be run for multiple images and target platforms. Note that the non-installer-based ARM disk images are covered by the later [[#ARM disk images]] section. | ||
{| class="wikitable collapsible" border="1" width="85%" | {| class="wikitable collapsible" border="1" width="85%" | ||
Line 160: | Line 158: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| | | style="background:lightgrey;"| | ||
|- | |- | ||
| Optional | | Optional | ||
Line 167: | Line 165: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| | | style="background:lightgrey;"| | ||
|- | |- | ||
| Optional | | Optional | ||
Line 174: | Line 172: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| | | style="background:lightgrey;"| | ||
|- | |- | ||
| Optional | | Optional | ||
Line 181: | Line 179: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| | | style="background:lightgrey;"| | ||
|- | |- | ||
| Optional | | Optional | ||
Line 188: | Line 186: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| | | style="background:lightgrey;"| | ||
|- | |- | ||
|} | |} | ||
|} | |} | ||
<references/> | |||
=== USB stick === | === USB stick === | ||
Line 240: | Line 240: | ||
|} | |} | ||
|} | |} | ||
<references/> | |||
=== ARM disk images === | === ARM disk images === | ||
Line 291: | Line 293: | ||
|} | |} | ||
|} | |} | ||
<references/> | |||
=== Cloud images === | === Cloud images === | ||
Line 314: | Line 318: | ||
|} | |} | ||
|} | |} | ||
<references/> | |||
=== PXE images === | === PXE images === | ||
Line 335: | Line 341: | ||
|} | |} | ||
=== | <references/> | ||
{| class="wikitable collapsible " border="1" width="85%" | |||
=== Storage device tests === | |||
{| class="wikitable collapsible" border="1" width="85%" | |||
|- | |- | ||
! colspan="5" style="background-color: | ! colspan="5" style="background-color: orange;" | Storage device tests | ||
|- | |- | ||
| | | | ||
{| class="wikitable sortable" width=100% style="border: solid 2px white" | {| class="wikitable sortable" width=100% style="border: solid 2px white" | ||
! Release Level !! Test Case !! x86<ref>'x86' means 'x86_64 or i386'</ref> !! ARM | |||
! | |- | ||
| Alpha | |||
| [[QA:Testcase_install_to_SATA]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Alpha | |||
| [[QA:Testcase_install_to_PATA]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Alpha | |||
| [[QA:Testcase_install_to_SCSI]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |- | ||
| Alpha | | Alpha | ||
| | | [[QA:Testcase_install_to_SAS]] | ||
| [[QA: | | {{result|none}} | ||
| {{result|none}} | |||
|- | |||
| Beta | |||
| [[QA:Testcase_install_to_firmware_RAID]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Beta | |||
| [[QA:Testcase_install_to_hardware_RAID]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Beta | |||
| [[QA:Testcase_install_to_VirtIO]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Final | |||
| [[QA:Testcase_install_to_iSCSI_no_authentication]] | |||
| {{result|none}} | |||
| {{result|none}} | | {{result|none}} | ||
|- | |||
| Final | |||
| [[QA:Testcase_install_to_multipath]] | |||
| {{result|none}} | | {{result|none}} | ||
| style="background: | | {{result|none}} | ||
| style=" | |- | ||
| Final | |||
| [[QA:Testcase_install_to_FCoE_target]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
|} | |||
|} | |||
<references/> | |||
=== Storage volume type tests === | |||
==== Guided installation ==== | |||
{| class="wikitable collapsible" border="1" width="85%" | |||
|- | |||
! colspan="5" style="background-color: orange;" | Storage volume type tests | |||
|- | |||
| | |||
{| class="wikitable sortable" width=100% style="border: solid 2px white" | |||
! Release Level !! Test Case !! x86 BIOS<ref>'x86' means 'x86_64 or i386'</ref> !! x86 UEFI !! ARM | |||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_partitioning_guided_empty]] | |||
| [[QA: | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_partitioning_guided_delete_all]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_partitioning_guided_multi_select]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Beta | | Beta | ||
| [[QA:Testcase_Partitioning_On_Software_RAID]] | |||
| [[QA: | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Beta | | Beta | ||
| [[QA:Testcase_partitioning_guided_delete_partial]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Beta | | Beta | ||
| [[QA:Testcase_partitioning_guided_free_space]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| | | Beta | ||
| [[QA:Testcase_partitioning_guided_encrypted]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Beta | | Beta | ||
| | | [[QA:Testcase_partitioning_guided_multi_empty_all]] | ||
| [[QA: | | {{result|none}} | ||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
|} | |||
|} | |||
<references/> | |||
==== Guided shrinking ==== | |||
For this test, the column headings refer to the storage volume type ''to be shrunk'', not the one chosen to replace it for the new installation. | |||
{| class="wikitable sortable" border="1" | |||
! Release Level !! Test Case !! LVM !! ext4 !! NTFS !! BTRFS | |||
|- | |||
| Final | |||
| [[QA:Testcase_partitioning_guided_shrink]] | |||
| {{result|none}} | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |||
|} | |||
<references/> | |||
=== General Tests === | |||
{| class="wikitable collapsible " border="1" width="85%" | |||
|- | |||
! colspan="5" style="background-color: lightgreen;" | Install Variations & General Tests | |||
|- | |||
| | |||
{| class="wikitable sortable" width=100% style="border: solid 2px white" | |||
|- | |||
! width="15%"|Release Level !! width="15%"|Test Area !! width="30%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64 !! width="10%"|EFI !! width="10%"|ARM | |||
|- | |- | ||
| Beta | | Beta | ||
Line 572: | Line 655: | ||
| Install Repository | | Install Repository | ||
| [[QA:Testcase_install_repository_Hard_drive_variation]] | | [[QA:Testcase_install_repository_Hard_drive_variation]] | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
Line 612: | Line 671: | ||
| Storage Devices | | Storage Devices | ||
| [[QA:Testcase_Install_to_Current_KVM]] | | [[QA:Testcase_Install_to_Current_KVM]] | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
Line 636: | Line 679: | ||
| Storage Devices | | Storage Devices | ||
| [[QA:Testcase_Boot_Methods_Xen_Para_Virt]] | | [[QA:Testcase_Boot_Methods_Xen_Para_Virt]] | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
Line 811: | Line 846: | ||
|} | |} | ||
|} | |} | ||
<references/> | <references/> | ||
[[Category:Install Results Templates|21]] | [[Category:Install Results Templates|21]] | ||
Latest revision as of 04:26, 11 September 2014
This page is intended to record installation validation testing test results for the Fedora 21 milestone.
Instructions
This page tracks test results against the Fedora 21 build. Test results against other Fedora 21 milestones can be found at Category:Fedora_21_Test_Results. The explanation of test case priority is available in the release validation test plan.
What To Test
- Download the required ISO images for the candidate build under test. Some tests must be run against particular Products or images - for example, the #Default boot and install tests. If no particular product or image is specified either in this page or the test case page, you can use any appropriate image. For example, you can run most of the #General Tests with the Workstation live image, or either of the Server install images.
- Delta_ISOs for install images are available here. If you have the Server offline install image for the previous TC/RC (or in the case of Alpha TC1, the previous stable release), you can generate the current install image with greatly reduced download size.
Who's available
The following cast of characters will be available testing, workarounds, bug fixes, general discussion ...
- IRC: #fedora-qa on irc.freenode.net
- Quality Assurance - Robatino , adamwill , wutao85 , pschindl
Add or Remove a Test Case
- Please request review for your changes by publishing your test case for review to test list.
- Once reviewed, make your changes to this document
- Finally, update QA:Fedora_21_Install_Results_Template with the same changes.
Key
See the table below for a sample format for test results. All test results are posted using the format specified Template:Result.
Test Results Format | ||
---|---|---|
Test Result | Explanation | Code Entered |
Untested - This test has not been run, and is available for anyone to contribute feedback. | {{result|none}}
| |
robatino
|
Passed - The test has been run and the tester determine the test met the expected results | {{result|pass|robatino}}
|
Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn. | {{result|inprogress|adamwill}}
| |
Failed - Indicates a failed test. A link to a bug must be provided. See Template:Result for details on providing bug information. | {{result|fail|jlaska|XYZ|ZXY}}
| |
[1] | Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention.
|
{{result|warn|rhe}} <ref>Brief description about the warning status</ref>
|
Multiple results - More people can easily provide results to a single test case. | {{result|pass|hongqing}} {{result|warn|kparal}}
| |
previous <build> run
|
Result from previous test run - This test result is directly moved from the test run of previous <build>. | {{result|pass|previous <build> run}}
|
Unsupported - An unsupported test or configuration. No testing is required. |
Test Matrix
Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.
Image sanity
Image sanity tests | |||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Default boot and install
In all of these tests, the test case used is QA:Testcase_Boot_default_install. That is where the links point. The same test needs to be run for multiple images and target platforms. Note that the non-installer-based ARM disk images are covered by the later #ARM disk images section.
Default boot and install | ||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
USB stick
USB stick tests | ||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
ARM disk images
In all of these tests, the test case used is QA:Testcase_arm_image_deployment. That is where the links point. The same test needs to be run for multiple images and target platforms.
ARM disk image functionality | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Cloud images
Cloud images | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
|
PXE images
PXE boot tests | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Storage device tests
Storage device tests | ||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
- ↑ 'x86' means 'x86_64 or i386'
Storage volume type tests
Guided installation
Storage volume type tests | |||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
- ↑ 'x86' means 'x86_64 or i386'
Guided shrinking
For this test, the column headings refer to the storage volume type to be shrunk, not the one chosen to replace it for the new installation.
Release Level | Test Case | LVM | ext4 | NTFS | BTRFS |
---|---|---|---|---|---|
Final | QA:Testcase_partitioning_guided_shrink |
General Tests