Architectures/AArch64/QA/Fedora-27-20171020.n.0: Difference between revisions

Latest revision as of 16:32, 25 October 2017

Test Matrix

Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.

Image sanity

Milestone	Test Case	Server	Everything
Alpha / Final	QA:Testcase_Mediakit_Checksums	none	none
Beta	QA:Testcase_Mediakit_ISO_Size	none	none
Alpha	QA:Testcase_Mediakit_Repoclosure	none
Alpha	QA:Testcase_Mediakit_FileConflicts	none

Default boot and install

Milestone	Image	Result
Alpha	Everything netinst	pass pwhalen ^[1]
Alpha	Server netinst	none
Alpha	Server dvd	none

↑ seattle optical

PXE boot

Milestone	Test Case	Result
Beta	QA:Testcase_Boot_Methods_Pxeboot	pass pwhalen ^[1]

↑ mustang, seattle. Also installs with acpi=force tested on both

USB media

Milestone	Test Case	Server DVD	Server netinstall	Everything netinstall
Alpha	QA:Testcase_USB_dd	warn pwhalen ^[1]	none	none

↑ sync exception when booting with BOOTAA64.EFI - not able to reproduce again

Virtualization

Milestone	Test Case	Result
Beta	QA:Testcase_Install_to_Previous_KVM	pass pwhalen
Beta	QA:Testcase_Install_to_Current_KVM	pass pwhalen

Storage devices

Milestone	Test Case	Result
Alpha	QA:Testcase_install_to_SATA	pass pwhalen
Alpha	QA:Testcase_install_to_SCSI	none
Beta	QA:Testcase_install_to_VirtIO	pass pwhalen
Final	QA:Testcase_install_to_iSCSI_no_authentication	none

Guided storage configuration

Milestone	Test Case	Result
Alpha	QA:Testcase_partitioning_guided_empty	pass pwhalen
Alpha	QA:Testcase_partitioning_guided_delete_all	pass pwhalen
Alpha	QA:Testcase_partitioning_guided_multi_select
Beta	QA:Testcase_partitioning_guided_delete_partial
Beta	QA:Testcase_partitioning_guided_free_space
Beta	QA:Testcase_partitioning_guided_encrypted	pass pwhalen
Beta	QA:Testcase_partitioning_guided_multi_empty_all

Guided storage shrinking

Environments
For this test, the column headings refer to the storage volume type to be shrunk, not the one chosen to replace it for the new installation.

Milestone	Test Case	ext4	NTFS
Final	QA:Testcase_partitioning_guided_shrink	none

Custom storage configuration

Milestone	Test Case	Result
Beta	QA:Testcase_partitioning_custom_software_RAID
Final	QA:Testcase_partitioning_custom_btrfs	none
Final	QA:Testcase_partitioning_custom_lvmthin	none
Final	QA:Testcase_partitioning_custom_standard_partition_ext3	none
Final	QA:Testcase_partitioning_custom_standard_partition_xfs	none
Optional	QA:Testcase_partitioning_custom_no_swap	none

User interface

Milestone	Test Case	Result
Alpha	QA:Testcase_Anaconda_User_Interface_Graphical	none
Alpha	QA:Testcase_Anaconda_User_Interface_Text	pass pwhalen
Alpha	QA:Testcase_Anaconda_User_Interface_VNC	pass pwhalen
Alpha	QA:Testcase_Anaconda_User_Interface_VNC_Vncconnect	none

Milestone	Test Case	Result
Beta	QA:Testcase_Anaconda_User_Interface_serial_console	pass pwhalen

Package sets

Milestone	Test Case	Result
Beta	QA:Testcase_Package_Sets_Minimal_Package_Install	pass pwhalen

Kickstart

Milestone	Test Case	Result
Alpha	QA:Testcase_kickstart_user_creation	pass pwhalen
Beta	QA:Testcase_Kickstart_Http_Server_Ks_Cfg	pass pwhalen
Beta	QA:Testcase_Kickstart_File_Path_Ks_Cfg	none
Beta	QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg	none
Beta	QA:Testcase_Kickstart_Nfs_Server_Path_Ks_Cfg	none

Upgrade

Milestone	Test Case	Result
Beta	QA:Testcase_upgrade_dnf_current_server	pass pwhalen
Beta	QA:Testcase_upgrade_dnf_previous_server	pass pwhalen
Beta	QA:Testcase_upgrade_dnf_current_minimal	pass pwhalen
Beta	QA:Testcase_upgrade_dnf_previous_minimal	pass pwhalen

Miscellaneous

Milestone	Test Case	Result
Alpha	QA:Testcase_Anaconda_user_creation	pass pwhalen

Milestone	Test Case	Result
Alpha	QA:Testcase_Anaconda_save_traceback_to_bugzilla (GUI mode)	pass pwhalen
Alpha	QA:Testcase_Anaconda_save_traceback_to_bugzilla (text mode)	pass pwhalen
Alpha	QA:Testcase_Anaconda_updates.img_via_URL	none
Final	QA:Testcase_Anaconda_updates.img_via_installation_source	none
Final	QA:Testcase_Anaconda_updates.img_via_local_media	none
Final	QA:Testcase_Anaconda_help	none
Optional	QA:Testcase_Anaconda_traceback_debug_mode (GUI mode)	none
Optional	QA:Testcase_Anaconda_traceback_debug_mode (text mode)	none

Milestone	Test Case	Result
Beta	QA:Testcase_Anaconda_rescue_mode

Base

Milestone	Test Case	Result
Alpha	QA:Testcase_base_startup	pass pwhalen
Alpha	QA:Testcase_base_system_logging	pass pwhalen
Alpha	QA:Testcase_base_update_cli	pass pwhalen
Final	QA:Testcase_Services_start	pass pwhalen
Final	QA:Testcase_base_selinux	pass pwhalen
Final	QA:Testcase_base_service_manipulation	none

Server

General tests

Milestone	Test Case	Result
Alpha	QA:Testcase_kickstart_firewall_disabled	pass pwhalen
Alpha	QA:Testcase_kickstart_firewall_configured	pass pwhalen
Alpha	QA:Testcase_Server_firewall_default	pass pwhalen
Alpha	QA:Testcase_Server_cockpit_default	pass pwhalen
Beta	QA:Testcase_Server_cockpit_basic	pass pwhalen

Disk Images

Milestone	Image	Ext boot
Alpha	Minimal	pass pwhalen ^[1]
Alpha	Workstation	fail pwhalen ^[2]
Alpha	Server	pass pwhalen ^[3]

Container Images

Milestone	Image	Result
Alpha	Docker	pass pwhalen ^[4]
Alpha	Container Minimal	pass pwhalen
Alpha	Atomic Host	warn pwhalen ^[5]
Alpha	Cloud	none

↑ rpi3
↑ did not boot to i-s, boots to log in, rpi3
↑ p64 plus, needed to create dtb symlink for network
↑ no images for 20171020, these are all from 20171023
↑ RHBZ #1505532

[1] seattle optical

[2] ustang, seattle. Also installs with acpi=force tested on both

[3] sync exception when booting with BOOTAA64.EFI - not able to reproduce again

[4] rpi3

[5] t boot to i-s, boots to log in, rpi3

[6] 64 plus, needed to create dtb symlink for network

[7] s for 20171020, these are all from 20171023

[bz1505532-8] RHBZ #1505532

[1]

[1]

[1]

[1]

[2]

[3]

[4]

[5]

@@ Line 45: / Line 45: @@
 | Alpha
 | [[QA:Testcase_Boot_default_install|Everything netinst]]
-| {{result|none}}
+| {{result|pass|pwhalen}}<ref>seattle optical</ref>
 |-
 | Alpha
@@ Line 59: / Line 59: @@
 <div style="background-color: dodgerblue; text-align: center; border-style: solid; border-width: thin">
 ==== PXE boot ====
 </div>
@@ Line 67: / Line 68: @@
 | Beta
 | [[QA:Testcase_Boot_Methods_Pxeboot]]
-| {{result|pass|pwhalen}}
+| {{result|pass|pwhalen}}<ref>mustang, seattle. Also installs with acpi=force tested on both</ref>
 |-
 |}
@@ Line 81: / Line 82: @@
 | Alpha
 | [[QA:Testcase_USB_dd]]
-| {{result|none}}
+| {{result|warn|pwhalen}}<ref>sync exception when booting with BOOTAA64.EFI - not able to reproduce again</ref>
 | {{result|none}}
 | {{result|none}}
@@ Line 97: / Line 98: @@
 | Beta
 | [[QA:Testcase_Install_to_Previous_KVM]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Beta
 | [[QA:Testcase_Install_to_Current_KVM]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 |}
 <references/>
 <div style="background-color: orange; text-align: center; border-style: solid; border-width: thin">
 ==== Storage devices ====
 </div>
@@ Line 114: / Line 116: @@
 | Alpha
 | [[QA:Testcase_install_to_SATA]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Alpha
@@ Line 122: / Line 124: @@
 | Beta
 | [[QA:Testcase_install_to_VirtIO]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Final
@@ Line 140: / Line 142: @@
 | Alpha
 | [[QA:Testcase_partitioning_guided_empty]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Alpha
 | [[QA:Testcase_partitioning_guided_delete_all]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Alpha
@@ Line 160: / Line 162: @@
 | Beta
 | [[QA:Testcase_partitioning_guided_encrypted]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Beta
@@ Line 231: / Line 233: @@
 | Alpha
 | [[QA:Testcase_Anaconda_User_Interface_Text]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Alpha
 | [[QA:Testcase_Anaconda_User_Interface_VNC]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Alpha
@@ Line 248: / Line 250: @@
 | Beta
 | [[QA:Testcase_Anaconda_User_Interface_serial_console]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 |}
 <references/>
 <div style="background-color: lavender; text-align: center; border-style: solid; border-width: thin">
 ==== Package sets ====
 </div>
@@ Line 261: / Line 264: @@
 | Beta
 | [[QA:Testcase_Package_Sets_Minimal_Package_Install]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 |}
@@ Line 275: / Line 278: @@
 | Alpha
 | [[QA:Testcase_kickstart_user_creation]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Beta
 | [[QA:Testcase_Kickstart_Http_Server_Ks_Cfg]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Beta
@@ Line 296: / Line 299: @@
 <references/>
 <div style="background-color: pink; text-align: center; border-style: solid; border-width: thin">
 ==== Upgrade ====
 </div>
@@ Line 304: / Line 308: @@
 | Beta
 | [[QA:Testcase_upgrade_dnf_current_server]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Beta
 | [[QA:Testcase_upgrade_dnf_previous_server]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Beta
 | [[QA:Testcase_upgrade_dnf_current_minimal]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Beta
 | [[QA:Testcase_upgrade_dnf_previous_minimal]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 |}
@@ Line 330: / Line 334: @@
 | Alpha
 | [[QA:Testcase_Anaconda_user_creation]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 |}
@@ Line 339: / Line 343: @@
 | Alpha
 | [[QA:Testcase_Anaconda_save_traceback_to_bugzilla]] (GUI mode)
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Alpha
 | [[QA:Testcase_Anaconda_save_traceback_to_bugzilla]] (text mode)
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Alpha
@@ Line 450: / Line 454: @@
 | Alpha
 | [[QA:Testcase_arm_image_deployment|Minimal]]
-| {{result|none}}
+| {{result|pass|pwhalen}}<ref>rpi3</ref>
 |-
 | Alpha
 | [[QA:Testcase_arm_image_deployment|Workstation]]
-| {{result|none}}
+| {{result|fail|pwhalen}}<ref>did not boot to i-s, boots to log in, rpi3</ref>
 |-
 | Alpha
 | [[QA:Testcase_arm_image_deployment|Server]]
-| {{result|none}}
+| {{result|pass|pwhalen}}<ref>p64 plus, needed to create dtb symlink for network</ref>
 |-
 |}
 ==== Container Images ====
 {| class="wikitable sortable collapsible" width=100%
@@ Line 468: / Line 473: @@
 | Alpha
 | [[QA:Testcase_arm_image_deployment|Docker]]
-| {{result|none}}
+| {{result|pass|pwhalen}}<ref>no images for 20171020, these are all from 20171023</ref>
 |-
 | Alpha
 | [[QA:Testcase_arm_image_deployment|Container Minimal]]
-| {{result|none}}
+| {{result|pass|pwhalen}}
 |-
 | Alpha
 | [[QA:Testcase_arm_image_deployment|Atomic Host]]
-| {{result|none}}
+| {{result|warn|pwhalen|1505532}}
 |-
 | Alpha

Search