(xfs should now be tested on ARM (pwhalen)) |
(add software raid back (to the storage volume type tests)) |
||
(12 intermediate revisions by 2 users not shown) | |||
Line 1: | Line 1: | ||
This page is intended to record [[QA: | This page is intended to record installation [[QA:Release_validation_test_plan|validation testing]] test results for the '''Fedora 21''' milestone. | ||
= Instructions = | = Instructions = | ||
This page tracks test results against the Fedora 21 build. Test results against other Fedora 21 milestones can be found at [[:Category:Fedora_21_Test_Results]]. The explanation of test case priority is available | This page tracks test results against the Fedora 21 build. Test results against other Fedora 21 milestones can be found at [[:Category:Fedora_21_Test_Results]]. The explanation of test case priority is available in [[QA:Release_validation_test_plan#anchor|the release validation test plan]]. | ||
== What To Test == | == What To Test == | ||
* | * [https://dl.fedoraproject.org/pub/alt/stage Download the required ISO images] for the candidate build under test. Some tests must be run against particular Products or images - for example, the [[#Default boot and install]] tests. If no particular product or image is specified either in this page or the test case page, you can use any appropriate image. For example, you can run most of the [[#General Tests]] with the Workstation live image, or either of the Server install images. | ||
* [[Delta_ISOs]] for install images are available [http://dl.fedoraproject.org/pub/alt/stage/deltaisos/ here]. If you have the Server offline install image for the previous TC/RC (or in the case of Alpha TC1, the previous stable release), you can generate the current install image with greatly reduced download size. | |||
* [[Delta_ISOs]] for install images are available [http://dl.fedoraproject.org/pub/alt/stage/deltaisos/ here]. If you have the install | |||
== Who's available == | == Who's available == | ||
Line 15: | Line 14: | ||
The following cast of characters will be available testing, workarounds, bug fixes, general discussion ... | The following cast of characters will be available testing, workarounds, bug fixes, general discussion ... | ||
* IRC: [irc://irc.freenode.net/fedora-qa #fedora-qa] on irc.freenode.net | * IRC: [irc://irc.freenode.net/fedora-qa #fedora-qa] on irc.freenode.net | ||
* Quality Assurance - [[User:Robatino]], [[User: | * Quality Assurance - [[User:Robatino | Robatino ]], [[User:adamwill | adamwill ]], [[User:wutao85 | wutao85 ]], [[User:pschindl | pschindl]] | ||
== Add or Remove a Test Case == | == Add or Remove a Test Case == | ||
Line 79: | Line 78: | ||
{| class="wikitable sortable" width=100% style="border: solid 2px white" | {| class="wikitable sortable" width=100% style="border: solid 2px white" | ||
|- | |- | ||
! Release Level !! Test Case !! | ! Release Level !! Test Case !! Server !! Workstation !! Spins !! ARM disks !! Cloud | ||
|- | |- | ||
| Alpha / Final | | Alpha / Final | ||
Line 88: | Line 87: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Beta | | Beta | ||
Line 97: | Line 95: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_Mediakit_Repoclosure]] | | [[QA:Testcase_Mediakit_Repoclosure]] | ||
| {{result|none}} | |||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_Mediakit_FileConflicts]] | | [[QA:Testcase_Mediakit_FileConflicts]] | ||
| {{result|none}} | |||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
|- | |- | ||
|} | |} | ||
|} | |} | ||
=== | <references/> | ||
=== Default boot and install === | |||
{{admon/note|Bare metal testing required|Running these tests in a virtualized environment is valuable, but the test must pass on bare metal using a physical install medium for each release-blocking image in each test environment at least for the final release candidate image (i.e. the released image) for each milestone.}} | |||
{| class="wikitable collapsible " border="1" width="85%" | In all of these tests, the test case used is [[QA:Testcase_Boot_default_install]]. That is where the links point. The same test needs to be run for multiple images and target platforms. Note that the non-installer-based ARM disk images are covered by the later [[#ARM disk images]] section. | ||
{| class="wikitable collapsible" border="1" width="85%" | |||
|- | |- | ||
! colspan="5" style="background-color: | ! colspan="5" style="background-color: pink;" | Default boot and install | ||
|- | |- | ||
| | | | ||
{| class="wikitable sortable" width=100% style="border: solid 2px white" | {| class="wikitable sortable" width=100% style="border: solid 2px white" | ||
|- | |- | ||
! width=" | ! width="10%"|Release Level !! width="25%"|Image !! width="10%"|i386 !! width="10%"| x86_64 !! width="10%"|UEFI !! width="10%"|ARM | ||
|- | |||
| Alpha / Optional (ARM) | |||
| [[QA:Testcase_Boot_default_install|Workstation]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_Boot_default_install|Server netinst]] | |||
| [[QA: | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_Boot_default_install|Server offline]] | |||
| [[QA: | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
Line 160: | Line 154: | ||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_Boot_default_install|KDE]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| style="background:lightgrey;"| | |||
|- | |- | ||
|} | | Optional | ||
|} | | [[QA:Testcase_Boot_default_install|Xfce]] | ||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
{| | | style="background:lightgrey;"| | ||
| | |||
|- | |- | ||
| | | Optional | ||
| [[QA:Testcase_Boot_default_install|LXDE]] | |||
| | | {{result|none}} | ||
| {{result|none}} | |||
| {{result|none}} | |||
| style="background:lightgrey;"| | |||
|- | |- | ||
| | | Optional | ||
| [[QA:Testcase_arm_image_deployment|MATE]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| style="background:lightgrey;"| | |||
|- | |- | ||
| | | Optional | ||
| [[QA:Testcase_arm_image_deployment|SoaS]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| style="background:lightgrey;"| | |||
|- | |- | ||
|} | |} | ||
|} | |} | ||
<references/> | |||
=== USB stick === | === USB stick === | ||
Line 244: | Line 240: | ||
|} | |} | ||
|} | |} | ||
<references/> | |||
=== ARM disk images === | === ARM disk images === | ||
Line 295: | Line 293: | ||
|} | |} | ||
|} | |} | ||
<references/> | |||
=== Cloud images === | === Cloud images === | ||
Line 318: | Line 318: | ||
|} | |} | ||
|} | |} | ||
<references/> | |||
=== PXE images === | === PXE images === | ||
Line 339: | Line 341: | ||
|} | |} | ||
=== | <references/> | ||
{| class="wikitable collapsible " border="1" width="85%" | |||
=== Storage device tests === | |||
{| class="wikitable collapsible" border="1" width="85%" | |||
|- | |- | ||
! colspan="5" style="background-color: | ! colspan="5" style="background-color: orange;" | Storage device tests | ||
|- | |- | ||
| | | | ||
{| class="wikitable sortable" width=100% style="border: solid 2px white" | {| class="wikitable sortable" width=100% style="border: solid 2px white" | ||
! Release Level !! Test Case !! x86<ref>'x86' means 'x86_64 or i386'</ref> !! ARM | |||
! | |- | ||
| Alpha | |||
| [[QA:Testcase_install_to_SATA]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Alpha | |||
| [[QA:Testcase_install_to_PATA]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Alpha | |||
| [[QA:Testcase_install_to_SCSI]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |- | ||
| Alpha | | Alpha | ||
| | | [[QA:Testcase_install_to_SAS]] | ||
| [[QA: | | {{result|none}} | ||
| {{result|none}} | |||
|- | |||
| Beta | |||
| [[QA:Testcase_install_to_firmware_RAID]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Beta | |||
| [[QA:Testcase_install_to_hardware_RAID]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Beta | |||
| [[QA:Testcase_install_to_VirtIO]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Final | |||
| [[QA:Testcase_install_to_iSCSI_no_authentication]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Final | |||
| [[QA:Testcase_install_to_multipath]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
| Final | |||
| [[QA:Testcase_install_to_FCoE_target]] | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| style="background: | |- | ||
| style=" | |} | ||
|} | |||
<references/> | |||
=== Storage volume type tests === | |||
==== Guided installation ==== | |||
{| class="wikitable collapsible" border="1" width="85%" | |||
|- | |||
! colspan="5" style="background-color: orange;" | Storage volume type tests | |||
|- | |||
| | |||
{| class="wikitable sortable" width=100% style="border: solid 2px white" | |||
! Release Level !! Test Case !! x86 BIOS<ref>'x86' means 'x86_64 or i386'</ref> !! x86 UEFI !! ARM | |||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_partitioning_guided_empty]] | |||
| [[QA: | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_partitioning_guided_delete_all]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Alpha | | Alpha | ||
| [[QA:Testcase_partitioning_guided_multi_select]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Beta | | Beta | ||
| [[QA:Testcase_Partitioning_On_Software_RAID]] | |||
| [[QA: | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Beta | | Beta | ||
| [[QA:Testcase_partitioning_guided_delete_partial]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Beta | | Beta | ||
| [[QA:Testcase_partitioning_guided_free_space]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| | | Beta | ||
| [[QA:Testcase_partitioning_guided_encrypted]] | |||
| [[QA: | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |- | ||
| Beta | | Beta | ||
| | | [[QA:Testcase_partitioning_guided_multi_empty_all]] | ||
| [[QA: | | {{result|none}} | ||
| {{result|none}} | |||
| {{result|none}} | |||
|- | |||
|} | |||
|} | |||
<references/> | |||
==== Guided shrinking ==== | |||
For this test, the column headings refer to the storage volume type ''to be shrunk'', not the one chosen to replace it for the new installation. | |||
{| class="wikitable sortable" border="1" | |||
! Release Level !! Test Case !! LVM !! ext4 !! NTFS !! BTRFS | |||
|- | |||
| Final | |||
| [[QA:Testcase_partitioning_guided_shrink]] | |||
| {{result|none}} | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
|- | |||
|} | |||
<references/> | |||
=== General Tests === | |||
{| class="wikitable collapsible " border="1" width="85%" | |||
|- | |||
! colspan="5" style="background-color: lightgreen;" | Install Variations & General Tests | |||
|- | |||
| | |||
{| class="wikitable sortable" width=100% style="border: solid 2px white" | |||
|- | |||
! width="15%"|Release Level !! width="15%"|Test Area !! width="30%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64 !! width="10%"|EFI !! width="10%"|ARM | |||
|- | |- | ||
| Beta | | Beta | ||
Line 576: | Line 655: | ||
| Install Repository | | Install Repository | ||
| [[QA:Testcase_install_repository_Hard_drive_variation]] | | [[QA:Testcase_install_repository_Hard_drive_variation]] | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
Line 616: | Line 671: | ||
| Storage Devices | | Storage Devices | ||
| [[QA:Testcase_Install_to_Current_KVM]] | | [[QA:Testcase_Install_to_Current_KVM]] | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
Line 640: | Line 679: | ||
| Storage Devices | | Storage Devices | ||
| [[QA:Testcase_Boot_Methods_Xen_Para_Virt]] | | [[QA:Testcase_Boot_Methods_Xen_Para_Virt]] | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
Line 692: | Line 723: | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
| style="background:lightgrey;"| | | style="background:lightgrey;"| | ||
|- | |||
| Alpha | |||
| Kickstart installation | |||
| [[QA:Testcase_kickstart_user_creation]] | |||
| {{result|none}} | |||
| {{result|none}} | |||
| style="background:lightgrey;"| | |||
| {{result|none}} | |||
|- | |- | ||
| Beta | | Beta | ||
Line 807: | Line 846: | ||
|} | |} | ||
|} | |} | ||
<references/> | <references/> | ||
[[Category:Install Results Templates|21]] | [[Category:Install Results Templates|21]] | ||
Latest revision as of 04:26, 11 September 2014
This page is intended to record installation validation testing test results for the Fedora 21 milestone.
Instructions
This page tracks test results against the Fedora 21 build. Test results against other Fedora 21 milestones can be found at Category:Fedora_21_Test_Results. The explanation of test case priority is available in the release validation test plan.
What To Test
- Download the required ISO images for the candidate build under test. Some tests must be run against particular Products or images - for example, the #Default boot and install tests. If no particular product or image is specified either in this page or the test case page, you can use any appropriate image. For example, you can run most of the #General Tests with the Workstation live image, or either of the Server install images.
- Delta_ISOs for install images are available here. If you have the Server offline install image for the previous TC/RC (or in the case of Alpha TC1, the previous stable release), you can generate the current install image with greatly reduced download size.
Who's available
The following cast of characters will be available testing, workarounds, bug fixes, general discussion ...
- IRC: #fedora-qa on irc.freenode.net
- Quality Assurance - Robatino , adamwill , wutao85 , pschindl
Add or Remove a Test Case
- Please request review for your changes by publishing your test case for review to test list.
- Once reviewed, make your changes to this document
- Finally, update QA:Fedora_21_Install_Results_Template with the same changes.
Key
See the table below for a sample format for test results. All test results are posted using the format specified Template:Result.
Test Results Format | ||
---|---|---|
Test Result | Explanation | Code Entered |
Untested - This test has not been run, and is available for anyone to contribute feedback. | {{result|none}}
| |
robatino
|
Passed - The test has been run and the tester determine the test met the expected results | {{result|pass|robatino}}
|
Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn. | {{result|inprogress|adamwill}}
| |
Failed - Indicates a failed test. A link to a bug must be provided. See Template:Result for details on providing bug information. | {{result|fail|jlaska|XYZ|ZXY}}
| |
[1] | Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention.
|
{{result|warn|rhe}} <ref>Brief description about the warning status</ref>
|
Multiple results - More people can easily provide results to a single test case. | {{result|pass|hongqing}} {{result|warn|kparal}}
| |
previous <build> run
|
Result from previous test run - This test result is directly moved from the test run of previous <build>. | {{result|pass|previous <build> run}}
|
Unsupported - An unsupported test or configuration. No testing is required. |
Test Matrix
Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.
Image sanity
Image sanity tests | |||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Default boot and install
In all of these tests, the test case used is QA:Testcase_Boot_default_install. That is where the links point. The same test needs to be run for multiple images and target platforms. Note that the non-installer-based ARM disk images are covered by the later #ARM disk images section.
Default boot and install | ||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
USB stick
USB stick tests | ||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
ARM disk images
In all of these tests, the test case used is QA:Testcase_arm_image_deployment. That is where the links point. The same test needs to be run for multiple images and target platforms.
ARM disk image functionality | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Cloud images
Cloud images | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
|
PXE images
PXE boot tests | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Storage device tests
Storage device tests | ||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
- ↑ 'x86' means 'x86_64 or i386'
Storage volume type tests
Guided installation
Storage volume type tests | |||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
- ↑ 'x86' means 'x86_64 or i386'
Guided shrinking
For this test, the column headings refer to the storage volume type to be shrunk, not the one chosen to replace it for the new installation.
Release Level | Test Case | LVM | ext4 | NTFS | BTRFS |
---|---|---|---|---|---|
Final | QA:Testcase_partitioning_guided_shrink |
General Tests