Test Results:Fedora 21 Beta TC4 Summary: Difference between revisions

Latest revision as of 07:21, 24 October 2014

No longer current
This candidate is no longer the current milestone. For the latest results, see Test_Results:Current_Summary.

Fedora 21 Beta TC4 release validation summary. This page shows the results from all the individual result pages for this compose together. You can file results directly from this page and they will be saved into the correct individual result page.

Installation[edit]

Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.

Image sanity[edit]

Milestone	Test Case	Server	Workstation	Spins	ARM disks	Cloud
Alpha / Final	QA:Testcase_Mediakit_Checksums	pass roshi	pass roshi	none	none	none
Beta	QA:Testcase_Mediakit_ISO_Size	pass adamwill	pass adamwill	fail adamwill ^[1] ^[2] ^[3]		none
Alpha	QA:Testcase_Mediakit_Repoclosure	pass adamwill
Alpha	QA:Testcase_Mediakit_FileConflicts	pass adamwill

↑ RHBZ #1142522
↑ RHBZ #1142521
↑ RHBZ #1142520

Default boot and install[edit]

Bare metal testing required
Running these tests in a virtualized environment is valuable, but the test must pass on bare metal using a physical install medium for each release-blocking image in each test environment at least for the final release candidate image (i.e. the released image) for each milestone.

Single test table
In all of these tests, the test case used is QA:Testcase_Boot_default_install. That is where the links point. The same test needs to be run for multiple images and target platforms. Note that the non-installer-based ARM disk images are covered by the later #ARM disk images section.

Milestone	Image	i386	x86_64	UEFI
Alpha	Workstation live	fail roshi ^[1] ^[2] fail adamwill ^[1]	pass adamwill ^[3] pass roshi ^[4]	none
Alpha	Workstation netinst	none	none	none
Alpha	Server netinst	none	none	none
Alpha	Server offline	pass roshi	pass adamwill ^[5]	none
Alpha	KDE live	pass roshi	pass satellit ^[6]	none
Optional	Xfce live	none	none pass satellit ^[7]	none
Optional	LXDE live	none	none	pass satellit ^[8]
Optional	MATE live	none	pass satellit ^[9] ^[10]	pass satellit ^[11]
Optional	SoaS live	none	pass satellit ^[12]	pass satellit ^[13]

↑ ^1.0 ^1.1 RHBZ #1156198
↑ usb, dvd bare metal installs as well as kvm
↑ virt test
↑ Bare metal from DVD
↑ virt test
↑ Virtualbox test
↑ Virtualbox test
↑ efi install with DVD to USB HD Yoga Pro 2 (insecure mode)
↑ RHBZ #1036306#c10
↑ liveusb-creator USB - persistence file worked - wireless worked
↑ M$ 8.1 Yoga Pro 2 liveusb-creator USB - wireless worked - USB boot only
↑ Virtualbox test
↑ Yoga Pro2 - dd USB - boot only -insecure mode - wireless worked

ARM disk images[edit]

Single test table
In all of these tests, the test case used is QA:Testcase_arm_image_deployment. That is where the links point. The same test needs to be run for multiple images and target platforms.

Milestone	Image	Ext boot
Alpha	Minimal	pass pwhalen
Alpha	KDE	pass pwhalen
Optional	Xfce	pass pwhalen
Optional	Desktop	none
Optional	LXDE	none
Optional	MATE	none
Optional	SoaS	none

Cloud images[edit]

Milestone	Test case	i386	x86_64
Alpha	QA:Testcase_EC2_AMI_Validation	warn roshi ^[1]	warn roshi ^[2]
Alpha	QA:Testcase_OpenStack_Image_Validation	warn roshi ^[3]	warn roshi ^[4]

↑ No TC4 cloud images
↑ No TC4 cloud images
↑ No TC4 cloud images
↑ No TC4 cloud images

PXE boot[edit]

Milestone	Test Case	i386	x86_64	ARM
Alpha	QA:Testcase_Boot_Methods_Pxeboot	none	pass adamwill	pass pwhalen

USB media[edit]

Milestone	Test Case	i386	x86_64	UEFI
Alpha	QA:Testcase_USB_stick_Live LiveUSB-creator	none	pass satellit ^[1] ^[2] pass adamwill	pass satellit ^[3]
Alpha	QA:Testcase_USB_stick_Live Live-ISO-to-Disk	none	none	none pass satellit ^[4]^[5]
Alpha	QA:Testcase_USB_stick_Live_dd	fail roshi ^[6]	pass satellit ^[7] pass adamwill	pass adamwill
Alpha	QA:Testcase_USB_stick_DVD Live-ISO-to-Disk	pass roshi	none	none
Alpha	QA:Testcase_USB_stick_DVD_dd	pass roshi	none	none

↑ RHBZ #1036306#c10
↑ Workstation & KDE-TC4 Live...iso USB written from Booted KDE DVD (liveusb-creator is installed in KDE) - USB boots (install not tested)
↑ M$ 8.1 Yoga Pro 2 liveusb-creator USB -Mate-TC4-Live - wireless worked - USB boot only
↑ livecd-iso-to-disk --format --reset-mbr --efi Fedora-Live-KDE-x86_64-21_Beta-TC4.iso /dev/sdc
↑ M$ 8.1 Yoga Pro 2 - wireless worked - USB boot only; insecure mode
↑ RHBZ #1156198
↑ SoaS - boot USB only

Virtualization[edit]

Milestone	Test Case	x86 BIOS^[1]	x86 UEFI	ARM
Beta	QA:Testcase_Install_to_Previous_KVM	none	none	none
Beta	QA:Testcase_Install_to_Current_KVM	pass adamwill	none	none
Final	QA:Testcase_Boot_Methods_Xen_Para_Virt	none	none	none

↑ 'x86' means 'x86_64 or i386'

Storage devices[edit]

Milestone	Test Case	x86^[1]	ARM
Alpha	QA:Testcase_install_to_SATA	none	none
Alpha	QA:Testcase_install_to_PATA	none
Alpha	QA:Testcase_install_to_SCSI	none	none
Alpha	QA:Testcase_install_to_SAS	none
Beta	QA:Testcase_install_to_firmware_RAID	none
Beta	QA:Testcase_install_to_hardware_RAID	none
Beta	QA:Testcase_install_to_VirtIO	pass roshi	none
Final	QA:Testcase_install_to_iSCSI_no_authentication	none
Final	QA:Testcase_install_to_multipath	none
Final	QA:Testcase_install_to_FCoE_target	none

↑ 'x86' means 'x86_64 or i386'

Guided storage configuration[edit]

Milestone	Test Case	x86 BIOS^[1]	x86 UEFI	ARM
Alpha	QA:Testcase_partitioning_guided_empty	none	none	none
Alpha	QA:Testcase_partitioning_guided_delete_all	pass roshi	none	none
Alpha	QA:Testcase_partitioning_guided_multi_select	none	none
Beta	QA:Testcase_partitioning_guided_delete_partial	none	none
Beta	QA:Testcase_partitioning_guided_free_space	none	none
Beta	QA:Testcase_partitioning_guided_encrypted	pass adamwill	none	none
Beta	QA:Testcase_partitioning_guided_multi_empty_all	none	none

↑ 'x86' means 'x86_64 or i386'

Guided storage shrinking[edit]

Environments
For this test, the column headings refer to the storage volume type to be shrunk, not the one chosen to replace it for the new installation.

Milestone	Test Case	LVM	ext4	NTFS	BTRFS
Final	QA:Testcase_partitioning_guided_shrink	none	none	none	none

Custom storage configuration[edit]

Milestone	Test Case	x86 BIOS^[1]	x86 UEFI	ARM
Beta	QA:Testcase_Partitioning_On_Software_RAID	none	none
Final	QA:Testcase_anaconda_btrfs_rootfs_on_disk_partition	none	none	none
Final	QA:Testcase_anaconda_ext3_rootfs_on_disk_partition	none	none	none
Final	QA:Testcase_anaconda_xfs_rootfs_on_disk_partition	none	none	none
Optional	QA:Testcase_Partitioning_No_Swap	none	none	none

↑ 'x86' means 'x86_64 or i386'

User interface[edit]

Milestone	Test Case	x86	ARM
Alpha	QA:Testcase_Anaconda_User_Interface_Graphical	pass lnie pass adamwill
Alpha	QA:Testcase_Anaconda_User_Interface_Basic_Video_Driver	none
Alpha	QA:Testcase_Anaconda_User_Interface_Text	none	none
Alpha	QA:Testcase_Anaconda_User_Interface_VNC	pass lnie	none
Alpha	QA:Testcase_Anaconda_User_Interface_VNC_Vncconnect	pass lnie	none
Beta	QA:Testcase_Anaconda_User_Interface_serial_console	none	none

Installation repositories[edit]

Milestone	Test Case	Result
Alpha	QA:Testcase_install_repository_Mirrorlist_graphical	none
Alpha	QA:Testcase_install_repository_HTTP/FTP_graphical	none
Alpha	QA:Testcase_install_repository_HTTP/FTP_variation	none
Beta	QA:Testcase_install_repository_NFS_graphical	none
Beta	QA:Testcase_install_repository_NFS_variation	none
Final	QA:Testcase_install_repository_NFSISO_variation	none
Final	QA:Testcase_install_repository_Hard_drive_variation	none

Kickstart[edit]

Milestone	Test Case	Result
Alpha	QA:Testcase_kickstart_user_creation	pass pwhalen
Beta	QA:Testcase_Kickstart_Http_Server_Ks_Cfg	pass pwhalen pass adamwill fail kparal ^[1]
Beta	QA:Testcase_Kickstart_File_Path_Ks_Cfg	pass jsedlak warn kparal ^[2]
Beta	QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg	fail kparal ^[3]
Beta	QA:Testcase_Kickstart_Nfs_Server_Path_Ks_Cfg	none

↑ RHBZ #1156008
↑ RHBZ #1155964
↑ RHBZ #1156073

Upgrade[edit]

Milestone	Test Case	x86 BIOS^[1]	x86 UEFI	ARM
Beta	QA:Testcase_upgrade_fedup_cli_previous_desktop	none	none	none
Beta	QA:Testcase_upgrade_fedup_cli_previous_kde	none	none	none
Beta	QA:Testcase_upgrade_fedup_cli_previous_minimal	none	none	none
Beta	QA:Testcase_upgrade_fedup_cli_previous_desktop_encrypted	none	none	none

↑ 'x86' means 'x86_64 or i386'

Miscellaneous[edit]

Milestone	Test Case	x86 BIOS^[1]	x86 UEFI	ARM
Alpha	QA:Testcase_Anaconda_save_traceback_to_bugzilla	none	none	none
Alpha	QA:Testcase_Anaconda_updates.img_via_URL	none	none	none
Alpha	QA:Testcase_Anaconda_user_creation	pass adamwill	none	none
Beta	QA:Testcase_Anaconda_rescue_mode	none	none
Final	QA:Testcase_dualboot_with_windows	none	none
Final	QA:Testcase_dualboot_with_OSX		none
Final	QA:Testcase_Anaconda_updates.img_via_installation_source	none	none	none
Final	QA:Testcase_Anaconda_updates.img_via_local_media	none	none	none
Optional	QA:Testcase_Install_Image_Boot_Local	none
Optional	QA:Testcase_Memtest86	pass adamwill
Optional	QA:Testcase_Anaconda_traceback_debug_mode	none	none	none

↑ 'x86' means 'x86_64 or i386'

Base[edit]

Milestone	Test Case	Workstation	Server	KDE	ARM	Cloud
Alpha	QA:Testcase_base_initial_setup	none		none	pass pwhalen ^[1]
Alpha	QA:Testcase_base_startup	none	pass adamwill	none	none
Alpha	QA:Testcase_base_system_logging	pass adamwill	pass adamwill	none	none	none
Final	QA:Testcase_Services_start	none	warn adamwill ^[2]	none	none	none
Final	QA:Testcase_base_selinux	pass adamwill	pass adamwill	none	pass pwhalen	none
Final	QA:Testcase_base_service_manipulation	none	none	none	none	none

↑ Minimal, KDE
↑ RHBZ #892178

Server[edit]

General tests[edit]

Milestone	Test Case	x86	ARM
Alpha	QA:Testcase_kickstart_firewall	pass adamwill	none
Alpha	QA:Testcase_realmd_join_kickstart	warn adamwill ^[1]	none
Alpha	QA:Testcase_realmd_join_server	none	none
Alpha	QA:Testcase_FreeIPA_realmd_join	pass dmossor	none
Alpha	QA:Testcase_Server_firewall_default	pass adamwill	none
Alpha	QA:Testcase_Server_cockpit_default	pass adamwill	none
Beta	QA:Testcase_Server_cockpit_basic	pass adamwill	none
Beta	QA:Testcase_realmd_join_cockpit	pass adamwill	none

↑ RHBZ #1145777

Release-blocking roles[edit]

Single test table
In all of these tests, the test case used is QA:Testcase Server role deploy. That is where the links point. The test must be run for each release-blocking role.

Milestone	Test Case	x86	ARM
Beta	Domain controller	fail adamwill ^[1] ^[2] ^[3]	none

↑ RHBZ #1155301
↑ RHBZ #1155304
↑ RHBZ #1155329

Non-release-blocking roles[edit]

Single test table
In all of these tests, the test case used is QA:Testcase Server role deploy. That is where the links point. The test may be run for each non-release-blocking role.

Milestone	Test Case	x86	ARM
Optional	Database server	none	none

Cloud[edit]

x86_64[edit]

Milestone	Test Case	Local	EC2	OpenShift
Alpha	QA:Testcase_base_initial_setup	none	none	none
Alpha	QA:Testcase_base_startup	none	none	none
Alpha	QA:Testcase_base_system_logging	none	none	none
Final	QA:Testcase_Services_start	none	none	none
Final	QA:Testcase_base_selinux	none	none	none
Final	QA:Testcase_base_service_manipulation	none	none	none

i386[edit]

Milestone	Test Case	Local	EC2	OpenShift
Alpha	QA:Testcase_base_initial_setup	none	none	none
Alpha	QA:Testcase_base_startup	none	none	none
Alpha	QA:Testcase_base_system_logging	none	none	none
Final	QA:Testcase_Services_start	none	none	none
Final	QA:Testcase_base_selinux	none	none	none
Final	QA:Testcase_base_service_manipulation	none	none	none

Atomic[edit]

Milestone	Test Case	Local	EC2	OpenShift
Optional	QA:Testcase_base_initial_setup	none	none	none
Optional	QA:Testcase_base_startup	none	none	none
Optional	QA:Testcase_base_system_logging	none	none	none
Optional	QA:Testcase_Services_start	none	none	none
Optional	QA:Testcase_base_selinux	none	none	none
Optional	QA:Testcase_base_service_manipulation	none	none	none

Desktop[edit]

Release-blocking desktops: x86 / x86_64[edit]

Milestone	Test Case	Workstation	KDE
Alpha	QA:Testcase_desktop_browser	pass roshi	none
Alpha	QA:Testcase_desktop_terminal	pass roshi	none
Alpha	QA:Testcase_desktop_updates (installation)	none	none
Beta	QA:Testcase_desktop_login	none	none
Beta	QA:Testcase_audio_basic	none	none
Beta	QA:Testcase_desktop_panel_basic	none	none
Beta	QA:Testcase_desktop_automount	none	none
Beta	QA:Testcase_desktop_updates (notification)	warn satellit ^[1] ^[2]	none
Beta	QA:Testcase_workstation_core_applications	none
Beta	QA:Testcase_workstation_theming	none
Final	QA:Testcase_desktop_error_checks	none	none
Final	QA:Testcase_desktop_menus	none	none
Final	QA:Testcase_desktop_panel_advanced	none	none
Final	QA:Testcase_desktop_keyring	none	none

↑ RHBZ #1141414
↑ Bare Metal - Kernel panic on first reboot; Update on 2nd reboot

Release-blocking desktops: ARM[edit]

Milestone	Test Case	KDE
Alpha	QA:Testcase_desktop_browser	none
Alpha	QA:Testcase_desktop_terminal	none
Alpha	QA:Testcase_desktop_updates (installation)	none
Beta	QA:Testcase_desktop_login	none
Beta	QA:Testcase_audio_basic	none
Beta	QA:Testcase_desktop_panel_basic	none
Beta	QA:Testcase_desktop_automount	none
Beta	QA:Testcase_desktop_updates (notification)	none
Final	QA:Testcase_desktop_error_checks	none
Final	QA:Testcase_desktop_menus	none
Final	QA:Testcase_desktop_panel_advanced	none
Final	QA:Testcase_desktop_keyring	none

Non release-blocking desktops: x86 / x86_64[edit]

Milestone	Test Case	Xfce	LXDE	MATE	Cinnamon	GNOME Classic
Alpha	QA:Testcase_desktop_browser	pass satellit ^[1]	pass satellit ^[2]	none	none	pass satellit ^[3]
Alpha	QA:Testcase_desktop_terminal	none	none	none	none	pass satellit ^[4]
Alpha	QA:Testcase_desktop_updates (installation)	none	none	none	none	none
Beta	QA:Testcase_desktop_login	none	none	none	none	none
Beta	QA:Testcase_audio_basic	none	none	none	none	none
Beta	QA:Testcase_desktop_panel_basic	none	none	none	none	none
Beta	QA:Testcase_desktop_automount	none	none	none	none	none
Beta	QA:Testcase_desktop_updates (notification)	none	none	none	none	none
Final	QA:Testcase_desktop_error_checks	none	none	none	none	none
Final	QA:Testcase_desktop_menus	none	none	none	none	none
Final	QA:Testcase_desktop_panel_advanced	none	none	none	none	none
Final	QA:Testcase_desktop_keyring	none	none	none	none	none

↑ Virtualbox
↑ efi install with DVD to USB HD Yoga Pro 2
↑ DVD install
↑ DVD install

Non release-blocking desktops: ARM[edit]

Milestone	Test Case	Workstation	Xfce	LXDE	MATE	Cinnamon	GNOME Classic
Alpha	QA:Testcase_desktop_browser	none	none	none	none	none	none
Alpha	QA:Testcase_desktop_terminal	none	none	none	none	none	none
Alpha	QA:Testcase_desktop_updates (installation)	none	none	none	none	none	none
Beta	QA:Testcase_desktop_login	none	none	none	none	none	none
Beta	QA:Testcase_audio_basic	none	none	none	none	none	none
Beta	QA:Testcase_desktop_panel_basic	none	none	none	none	none	none
Beta	QA:Testcase_desktop_automount	none	none	none	none	none	none
Beta	QA:Testcase_desktop_updates (notification)	none	none	none	none	none	none
Beta	QA:Testcase_workstation_core_applications	none
Final	QA:Testcase_desktop_error_checks	none	none	none	none	none	none
Final	QA:Testcase_desktop_menus	none	none	none	none	none	none
Final	QA:Testcase_desktop_panel_advanced	none	none	none	none	none	none
Final	QA:Testcase_desktop_keyring	none	none	none	none	none	none
Final	QA:Testcase_workstation_theming	none

Sugar (non-blocking, all arches)[edit]

Sugar test cases
The Sugar desktop differs significantly from a typical desktop, so it gets its own test cases. At present these live on the Sugar wiki.

Test Case	x86	ARM
QA:Testcase_SoaS boots to the (name) selection screen	none	none
QA:Testcase_SoaS installed to hard disk with liveinst from root terminal	none	none
QA:Testcase_Jabber.sugarlabs.org should connect and display XO "Buddies"	none	none
QA:Testcase_When a USB storage device is inserted, it should show up in the Frame	none	none
QA:Testcase_Functions in My Settings (Sugar control panel)	none	none
QA:Testcase_Applications in the Home Screen	none	none
QA:Testcase_Sugar-desktop installed in another Desktop	none	none

Security Lab[edit]

Milestone	Test Case	Security Lab
Beta	QA:Testcase_Mediakit_ISO_Size	Unknown unknown SampleUser
Beta	QA:Testcase_Mediakit_ISO_Checksums	Unknown unknown SampleUser
Beta	QA:TestCases/Install_Source_Live_Image	Unknown unknown SampleUser
Beta	QA:Testcase_base_firstboot	Unknown unknown SampleUser
Beta	QA:Testcase_base_startup	Unknown unknown SampleUser
Beta	QA:Testcase_base_system_logging	Unknown unknown SampleUser
Beta	QA:Testcase_desktop_browser	Unknown unknown SampleUser
Beta	QA:Testcase_desktop_updates	Unknown unknown SampleUser
Beta	QA:Testcase_desktop_login	Unknown unknown SampleUser
Beta	QA:Testcase_desktop_panel_basic	Unknown unknown SampleUser
Beta	QA:Testcase_desktop_error_checks	Unknown unknown SampleUser
Beta	QA:Testcase_desktop_menus	Unknown unknown SampleUser
Beta	QA:Testcase_Nmap	Unknown unknown SampleUser
Beta	QA:Testcase_Wireshark	Unknown unknown SampleUser
Beta	QA:Testcase_Nikto	Unknown unknown SampleUser
Beta	QA:Testcase_OpenVAS	Unknown unknown SampleUser
Beta	QA:Testcase_HTTPing	Unknown unknown SampleUser
Beta	QA:Testcase_Rkhunter	Unknown unknown SampleUser
Beta	QA:Testcase_OpenSSH	Unknown unknown SampleUser

[bz1142522-1] RHBZ #1142522

[bz1142521-2] RHBZ #1142521

[bz1142520-3] RHBZ #1142520

[bz1156198-4] 1.0 ^1.1 RHBZ #1156198

[5] usb, dvd bare metal installs as well as kvm

[6] virt test

[7] Bare metal from DVD

[8] virt test

[9] Virtualbox test

[10] Virtualbox test

[11] stall with DVD to USB HD Yoga Pro 2 (insecure mode)

[bz1036306#c10-12] RHBZ #1036306#c10

[13] veusb-creator USB - persistence file worked - wireless worked

[14] M$ 8.1 Yoga Pro 2 liveusb-creator USB - wireless worked - USB boot only

[15] Virtualbox test

[16] Yoga Pro2 - dd USB - boot only -insecure mode - wireless worked

[17] No TC4 cloud images

[18] No TC4 cloud images

[19] No TC4 cloud images

[20] No TC4 cloud images

[bz1036306#c10-21] RHBZ #1036306#c10

[22] Workstation & KDE-TC4 Live...iso USB written from Booted KDE DVD (liveusb-creator is installed in KDE) - USB boots (install not tested)

[23] M$ 8.1 Yoga Pro 2 liveusb-creator USB -Mate-TC4-Live - wireless worked - USB boot only

[24] vecd-iso-to-disk --format --reset-mbr --efi Fedora-Live-KDE-x86_64-21_Beta-TC4.iso /dev/sdc

[25] M$ 8.1 Yoga Pro 2 - wireless worked - USB boot only; insecure mode

[bz1156198-26] RHBZ #1156198

[27] SoaS - boot USB only

[28] 'x86' means 'x86_64 or i386'

[29] 'x86' means 'x86_64 or i386'

[30] 'x86' means 'x86_64 or i386'

[31] 'x86' means 'x86_64 or i386'

[bz1156008-32] RHBZ #1156008

[bz1155964-33] RHBZ #1155964

[bz1156073-34] RHBZ #1156073

[35] 'x86' means 'x86_64 or i386'

[1]

[2]

[3]

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]

[13]

[1]

[2]

[3]

[4]

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[1]

[1]

[1]

[1]

[1]

[2]

[3]

[1]

[1]

[1]

[2]

[1]

[1]

[2]

[3]

[1]

[2]

[1]

[2]

[3]

[4]

@@ Line 1: / Line 1: @@
+{{admon/important|No longer current|This candidate is no longer the current milestone.  For the latest results, see [[Test_Results:Current_Summary]].}}
 Fedora 21 Beta TC4 [[QA:Release validation test plan|release validation]] summary. This page shows the results from all the individual result pages for this compose together. You can file results directly from this page and they will be saved into the correct individual result page.
 __TOC__

Search