User:Rhe/Validation Test Results Test Matrices: Difference between revisions

Latest revision as of 17:50, 12 June 2010

Key

See the table below for a sample format for test results.

Test Result	Explanation
none	Untested - This test has not been run, and is available for anyone to contribute feedback.
pass liam	Passed - The test has been run and the tester determine the test met the expected results
inprogress adamwill	Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn.
fail jlaska ^[1] ^[2]	Failed - Indicates a failed test. A link to a bug must be provided. See Template:Result for details on providing bug information. ↑ RHBZ #XYZ ↑ RHBZ #ZXY
warn rhe ^[1]	Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention. ↑ Brief description about the warning status
pass rhe warn kparal	Multiple results - More people can easily provide results to a single test case.
none	Unsupported - An unsupported test or configuration. No testing is required.

Priority

The explanation of test case priority is available at QA:Fedora_13_Install_Test_Plan#Test_Priority.

Test Matrices

Boot.iso

Release Level	Test Area	Test Case	i386	x86_64
Alpha	Image Sanity	QA:Testcase_Mediakit_ISO_Size	none	none
Alpha	Image Sanity	QA:Testcase_Mediakit_ISO_Checksums	none	none
Alpha	Boot Methods	QA/TestCases/BootMethodsBootIso	none	none
Alpha	Image Source	QA/TestCases/ImageSourceBootIso	none	none
Alpha	Install Source	QA/TestCases/InstallSourceHttp	none	none
Alpha	Package Set	QA/TestCases/PackageSetsDefaultPackageInstall	none	none
Alpha	Partitioning	User:Rhe/Validation_Test_Results_Test_Matrices#Partition
Alpha	User Interface	User:Rhe/Validation_Test_Results_Test_Matrices#User_Interface
Alpha	Variations	User:Rhe/Validation_Test_Results_Test_Matrices#Variations

DVD.iso

Release Level	Test Area	Test Case	i386	x86_64
Alpha	Image Sanity	QA:Testcase_Mediakit_ISO_Size	none	none
Alpha	Image Sanity	QA:Testcase_Mediakit_ISO_Checksums	none	none
Alpha	Image Sanity	QA:Testcase_Mediakit_Repoclosure	none	none
Alpha	Image Sanity	QA:Testcase_Mediakit_FileConflicts	none	none
Alpha	Boot Methods	QA/TestCases/BootMethodsDvd	none	none
Alpha	Image Source	QA/TestCases/ImageSourceDvd	none	none
Alpha	Install Source	QA/TestCases/InstallSourceDvd	none	none
Alpha	Package Set	QA/TestCases/PackageSetsDefaultPackageInstall	none	none
Alpha	Partitioning	User:Rhe/Validation_Test_Results_Test_Matrices#Partition
Alpha	User Interface	User:Rhe/Validation_Test_Results_Test_Matrices#User_Interface
Alpha	Variations	User:Rhe/Validation_Test_Results_Test_Matrices#Variations

CD.iso

Release Level	Test Area	Test Case	i386	x86_64
Alpha	Image Sanity	QA:Testcase_Mediakit_ISO_Size	none	none
Alpha	Image Sanity	QA:Testcase_Mediakit_ISO_Checksums	none	none
Alpha	Image Sanity	QA:Testcase_Mediakit_Repoclosure	none	none
Alpha	Image Sanity	QA:Testcase_Mediakit_FileConflicts	none	none
Beta	Boot Methods	QA/TestCases/BootMethodsCdrom	none	none
Beta	Image Source	QA/TestCases/ImageSourceCdrom	none	none
Beta	Install Source	QA/TestCases/InstallSourceCdrom	none	none
Alpha	Package Set	QA/TestCases/PackageSetsDefaultPackageInstall	none	none
Alpha	Partitioning	User:Rhe/Validation_Test_Results_Test_Matrices#Partition
Alpha	User Interface	User:Rhe/Validation_Test_Results_Test_Matrices#User_Interface
Alpha	Variations	User:Rhe/Validation_Test_Results_Test_Matrices#Variations

Live Image

Release Level	Test Area	Test Case	i386	x86_64
Alpha	Image Sanity	QA:Testcase_Mediakit_ISO_Size	none	none
Alpha	Image Sanity	QA:Testcase_Mediakit_ISO_Checksums	none	none
Alpha	Image Sanity	QA:Testcase_Mediakit_Repoclosure	none	none
Alpha	Image Sanity	QA:Testcase_Mediakit_FileConflicts	none	none
Alpha	Install Source	QA:TestCases/Install Source Live Image	none	none
Alpha	Partitioning	User:Rhe/Validation_Test_Results_Test_Matrices#Partition

PXE Images

Release Level	Test Area	Test Case	i386	x86_64
Alpha	Boot Methods	QA/TestCases/BootMethodsPxeboot	none	none
Alpha	Partitioning	User:Rhe/Validation_Test_Results_Test_Matrices#Partition
Alpha	Variations	User:Rhe/Validation_Test_Results_Test_Matrices#Variations

Partition

Release Level	Test Area	Test Case	i386	x86_64
Alpha	Partitioning	QA/TestCases/PartitioningUninitializedDisks	none	none
Alpha	Partitioning	QA:Testcase_Anaconda_autopart_install	none	none
Alpha	Partitioning	QA:Testcase_Anaconda_autopart_(encrypted)_install	none	none
Alpha	Partitioning	QA:Testcase_Anaconda_autopart_(shrink)_install	none	none
Alpha	Partitioning	QA:Testcase_Anaconda_autopart_(use_free_space)_install	none	none
Alpha	Partitioning	QA/TestCases/PartitioningExt4OnNativeDevice	none	none
Final	Partitioning	QA/TestCases/PartitioningExt3OnNativeDevice	none	none
Final	Partitioning	QA/TestCases/PartitioningExt2OnNativeDevice	none	none
Final	Partitioning	QA/TestCases/PartitioningNoSwap	none	none
Final	Partitioning	QA:Testcase_Partitioning_On_Software_RAID	none	none

User Interface

Release Level	Test Area	Test Case	i386	x86_64
Alpha	User Interface	QA:Testcase_Anaconda_User_Interface_Graphical	none	none
Alpha	User Interface	QA:Testcase_Anaconda_User_Interface_Text	none	none
Alpha	User Interface	QA:Testcase_Anaconda_User_Interface_VNC	none	none
Alpha	User Interface	QA:Testcase_Anaconda_User_Interface_Cmdline	none	none
Alpha	User Interface	QA:Testcase_Anaconda_User_Interface_serial_console	none	none
Final	User Interface	QA:Testcase_Anaconda_User_Interface_Telnet	none	none
Alpha	User Interface	QA:Testcase_Anaconda_rescue_mode	none	none

Variations

Release Level	Test Area	Test Case	i386	x86_64
Beta	Install Source	QA/TestCases/InstallSourceFtpNonAnonymous	none	none
Beta	Install Source	QA/TestCases/InstallSourceNfs	none	none
Final	Install Source	QA/TestCases/InstallSourceNfsIso	none	none
Final	Install Source	QA/TestCases/InstallSourceHardDrive	none	none
Alpha	Repository	QA:Testcase Additional Ftp Repository	none	none
Alpha	Repository	QA:Testcase Additional Http Repository	none	none
Alpha	Repository	QA:Testcase Additional Mirrorlist Repository	none	none
Beta	Repository	QA:Testcase Additional NFS Repository	none	none
Alpha	Memory Test	memtest86+	none	none

General Tests

Release Level	Test Area	Test Case	i386	x86_64
Beta	Boot Methods	QA/TestCases/BootMethodsXenParaVirt	none	none
Beta	Boot Methods	QA/TestCases/BootMethodsKVM	none	none
Beta	Boot Methods	QA:Testcase_Boot_Methods_efidisk.img	none	none
Alpha	Kickstart Delivery	QA/TestCases/KickstartKsHttpServerKsCfg	none	none
Beta	Kickstart Delivery	QA/TestCases/KickstartKsFilePathKsCfg	none	none
Beta	Kickstart Delivery	QA/TestCases/KickstartKsHdDevicePathKsCfg	none	none
Beta	Kickstart Delivery	QA/TestCases/KickstartKsNfsServerPathKsCfg	none	none
Alpha	Recovery	QA:Testcase_Anaconda_updates.img_via_URL	none	none
Beta	Recovery	QA:Testcase_Anaconda_updates.img_via_installation_source	none	none
Beta	Recovery	QA:Testcase_Anaconda_updates.img_via_local_media	none	none
Alpha	Recovery	QA:Testcase Anaconda save traceback to remote system	none	none
Alpha	Recovery	QA:Testcase Anaconda save traceback to bugzilla	none	none
Alpha	Recovery	QA:Testcase Anaconda save traceback to disk	none	none
Final	Recovery	QA:Testcase Anaconda traceback debug mode	none	none
Alpha	Storage Devices	QA:Testcase_install_to_SATA_device	none	none
Alpha	Storage Devices	QA:Testcase_install_to_SCSI_device	none	none
Alpha	Storage Devices	QA:Testcase_install_to_PATA_device	none	none
Beta	Storage Devices	QA:Testcase_Install_to_BIOS_RAID	none	none
Beta	Storage Devices	QA:Testcase_Install_to_Hardware_RAID	none	none
Final	Storage Devices	QA:Testcase_Anaconda_ISCSI_No_Authentication	none	none
Beta	Upgrade system	QA:Testcase_Anaconda_Upgrade_New_Bootloader	none	none
Beta	Upgrade system	QA:Testcase_Anaconda_Upgrade_Skip_Bootloader	none	none
Beta	Upgrade system	QA:Testcase_Anaconda_Upgrade_Update_Bootloader	none	none
Beta	Upgrade system	QA:Testcase_Anaconda_Upgrade_Encrypted_Root	none	none
Beta	Upgrade system	QA:Testcase_Preupgrade	none	none
Beta	Upgrade system	QA:Testcase_Preupgrade_low_/boot_disk_space_to_install	none	none

[bzXYZ-1] RHBZ #XYZ

[bzZXY-2] RHBZ #ZXY

[3] Brief description about the warning status

[1]

[2]

[1]

Search

User:Rhe/Validation Test Results Test Matrices: Difference between revisions

Latest revision as of 17:50, 12 June 2010

Contents

Key

Priority

Test Matrices

Boot.iso

DVD.iso

CD.iso

Live Image

PXE Images

Partition

User Interface

Variations

General Tests

@@ Line 91: / Line 91: @@
 |-
 | Alpha
-| Partitioning
+| Variations
 | colspan="4" align="left" | [[User:Rhe/Validation_Test_Results_Test_Matrices#Variations]]
 |-
 |}
+----
 === DVD.iso ===
@@ Line 139: / Line 141: @@
 | Alpha
 | Image Source
-| [[QA/TestCases/ImageSourceDVD]]
+| [[QA/TestCases/ImageSourceDvd]]
 | {{result|none}}
 | {{result|none}}
@@ Line 167: / Line 169: @@
 |-
 | Alpha
-| Partitioning
+| Variations
 | colspan="4" align="left" | [[User:Rhe/Validation_Test_Results_Test_Matrices#Variations]]
 |-
 |}
+----
 === CD.iso ===
@@ Line 206: / Line 210: @@
 | <references/>
 |-
-| Alpha
+| Beta
 | Boot Methods
 | [[QA/TestCases/BootMethodsCdrom]]
@@ Line 213: / Line 217: @@
 | <references/>
 |-
-| Alpha
+| Beta
 | Image Source
 | [[QA/TestCases/ImageSourceCdrom]]
@@ Line 220: / Line 224: @@
 | <references/>
 |-
-| Alpha
+| Beta
 | Install Source
 | [[QA/TestCases/InstallSourceCdrom]]
@@ Line 243: / Line 247: @@
 |-
 | Alpha
-| Partitioning
+| Variations
 | colspan="4" align="left" | [[User:Rhe/Validation_Test_Results_Test_Matrices#Variations]]
 |-
 |}
+----
 === Live Image ===
@@ Line 295: / Line 301: @@
 |}
+----
+=== PXE Images ===
+{| class="wikitable sortable" border="1"
+! Release Level !! Test Area !! Test Case !! i386 !! x86_64 !! References
+|-
+| Alpha
+| Boot Methods
+| [[QA/TestCases/BootMethodsPxeboot]]
+| {{result|none}}
+| {{result|none}}
+| <references/>
+|-
+| Alpha
+| Partitioning
+| colspan="4" align="left" | [[User:Rhe/Validation_Test_Results_Test_Matrices#Partition]]
+|-
+| Alpha
+| Variations
+| colspan="4" align="left" | [[User:Rhe/Validation_Test_Results_Test_Matrices#Variations]]
+|-
+|}
+----
 === Partition ===
@@ Line 343: / Line 376: @@
 | <references/>
 |-
-|-
+| Final
-| Beta
 | Partitioning
-| [[QA/TestCases/PartitioningRootfsOnRaid1]]
+| [[QA/TestCases/PartitioningExt3OnNativeDevice]]
-| {{result|none}}
-| {{result|none}}
-| <references/>
-|-
-| Beta
-| Partitioning
-| [[QA/TestCases/PartitioningRaid0OnLvmDevice]]
-| {{result|none}}
-| {{result|none}}
-| <references/>
-|-
-| Beta
-| Partitioning
-| [[QA/TestCases/PartitioningUsrOnRaid0]]
-| {{result|none}}
-| {{result|none}}
-| <references/>
-|-
-| Beta
-| Partitioning
-| [[QA/TestCases/PartitioningUsrOnRaid5]]
-| {{result|none}}
-| {{result|none}}
-| <references/>
-|-
-| Beta
-| Partitioning
-| [[QA/TestCases/PartitioningUsrOnRaid6]]
 | {{result|none}}
 | {{result|none}}
@@ Line 381: / Line 385: @@
 | Final
 | Partitioning
-| [[QA/TestCases/PartitioningExt3OnNativeDevice]]
+| [[QA/TestCases/PartitioningExt2OnNativeDevice]]
 | {{result|none}}
 | {{result|none}}
@@ Line 388: / Line 392: @@
 | Final
 | Partitioning
-| [[QA/TestCases/PartitioningExt2OnNativeDevice]]
+| [[QA/TestCases/PartitioningNoSwap]]
 | {{result|none}}
 | {{result|none}}
@@ Line 395: / Line 399: @@
 | Final
 | Partitioning
-| [[QA/TestCases/PartitioningNoSwap]]
+| [[QA:Testcase_Partitioning_On_Software_RAID]]
 | {{result|none}}
 | {{result|none}}
@@ Line 401: / Line 405: @@
 |-
 |}
 === User Interface ===
 {| class="wikitable sortable" border="1"
@@ Line 443: / Line 445: @@
 | {{result|none}}
 | <references/>
-|}
+|-
+| Final
-=== Variations ===
+| User Interface
+| [[QA:Testcase_Anaconda_User_Interface_Telnet]]
-{| class="wikitable sortable" border="1"
+| {{result|none}}
-! Release Level !! Test Area !! Test Case !! i386 !! x86_64 !! References
+| {{result|none}}
+| <references/>
 |-
 | Alpha
@@ Line 457: / Line 460: @@
 | <references/>
 |-
-| Alpha
+|}
+=== Variations ===
+{| class="wikitable sortable" border="1"
+! Release Level !! Test Area !! Test Case !! i386 !! x86_64 !! References
+|-
+| Beta
 | Install Source
 | [[QA/TestCases/InstallSourceFtpNonAnonymous]]
@@ Line 464: / Line 474: @@
 | <references/>
 |-
-| Alpha
+| Beta
 | Install Source
 | [[QA/TestCases/InstallSourceNfs]]
@@ Line 471: / Line 481: @@
 | <references/>
 |-
-| Alpha
+| Final
 | Install Source
 | [[QA/TestCases/InstallSourceNfsIso]]
@@ Line 478: / Line 488: @@
 | <references/>
 |-
-| Alpha
+| Final
 | Install Source
 | [[QA/TestCases/InstallSourceHardDrive]]
@@ Line 506: / Line 516: @@
 | <references/>
 |-
-| Alpha
+| Beta
 | Repository
 | [[QA:Testcase Additional NFS Repository]]
@@ Line 515: / Line 525: @@
 | Alpha
 | Memory Test
-| [[memtest86]]
+| [[memtest86+]]
 | {{result|none}}
 | {{result|none}}
@@ Line 523: / Line 533: @@
+----
+=== General Tests ===
-=== General TEST ===
 {| class="wikitable sortable" border="1"
@@ Line 582: / Line 591: @@
 | Alpha
 | Recovery
-| [[QA:Testcase_Anaconda_rescue_mode]]
+| [[QA:Testcase_Anaconda_updates.img_via_URL]]
+| {{result|none}}
+| {{result|none}}
+| <references/>
+|-
+| Beta
+| Recovery
+| [[QA:Testcase_Anaconda_updates.img_via_installation_source]]
 | {{result|none}}
 | {{result|none}}
 | <references/>
 |-
-| Alpha
+| Beta
 | Recovery
-| [[QA:Testcase_Anaconda_updates.img_via_URL]]
+| [[QA:Testcase_Anaconda_updates.img_via_local_media]]
 | {{result|none}}
 | {{result|none}}
@@ Line 611: / Line 627: @@
 | Recovery
 | [[QA:Testcase Anaconda save traceback to disk]]
+| {{result|none}}
+| {{result|none}}
+| <references/>
+|-
+| Final
+| Recovery
+| [[QA:Testcase Anaconda traceback debug mode]]
 | {{result|none}}
 | {{result|none}}
@@ Line 638: / Line 661: @@
 | Beta
 | Storage Devices
-| [[QA:Testcase_Anaconda_partitioning_dmraid_rootfs]]
+| [[QA:Testcase_Install_to_BIOS_RAID]]
+| {{result|none}}
+| {{result|none}}
+| <references/>
+|-
+| Beta
+| Storage Devices
+| [[QA:Testcase_Install_to_Hardware_RAID]]
+| {{result|none}}
+| {{result|none}}
+| <references/>
+|-
+| Final
+| Storage Devices
+| [[QA:Testcase_Anaconda_ISCSI_No_Authentication]]
 | {{result|none}}
 | {{result|none}}