This page is intended to record installation validation testing test results for the Fedora 21 PPC milestone.

This is a first draft that keep all tests of original template to ease comparison of this specific ppc64/ppc64le (secondary architecture) results versus those of primary arch.

TODO: I still need to mark unsupported testcases with background grey lines.

Instructions

This page tracks test results against the Fedora 21 PPC build. Test results against other Fedora 21 milestones can be found at Category:Fedora_21_Test_Results. The explanation of test case priority is available in the release validation test plan.

What To Test

Tests requiring physical media (e.g. DVD or CD images) -- download the latest ISO images Alpha RC1. (link from -- ML email from pbrobinson)
Unless otherwise noted, you may use nightly Fedora 21 branch install images. Review for information on downloading and installing Branched.

Who's available

The following cast of characters will be available testing, workarounds, bug fixes, general discussion ...

IRC: #fedora-ppc on irc.freenode.net
PPC Secondary Arch team - efi, gustavold, hamzy,

Menantea, Michelmno, mjwolf, Kick_, pknirsch

Add or Remove a Test Case

Please request review for your changes by publishing your test case for review to test list.
Once reviewed, make your changes to this document
Finally, update QA:Fedora_21_Install_Results_Template with the same changes.

Workarounds

Available workarounds for known problems in composes

21_Alpha_TC3

manually install crash

Key

See the table below for a sample format for test results. All test results are posted using the format specified Template:Result.

Test Results Format
Test Result	Explanation	Code Entered
none	Untested - This test has not been run, and is available for anyone to contribute feedback.	`{{result\|none}}`
pass robatino	Passed - The test has been run and the tester determine the test met the expected results	`{{result\|pass\|robatino}}`
inprogress adamwill	Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn.	`{{result\|inprogress\|adamwill}}`
fail jlaska ^[1] ^[2]	Failed - Indicates a failed test. A link to a bug must be provided. See Template:Result for details on providing bug information. ↑ RHBZ #XYZ ↑ RHBZ #ZXY	`{{result\|fail\|jlaska\|XYZ\|ZXY}}`
warn rhe ^[1]	Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention. ↑ Brief description about the warning status	`{{result\|warn\|rhe}} <ref>Brief description about the warning status</ref>`
pass hongqing warn kparal	Multiple results - More people can easily provide results to a single test case.	`{{result\|pass\|hongqing}} {{result\|warn\|kparal}}`
pass previous <build> run	Result from previous test run - This test result is directly moved from the test run of previous <build>.	`{{result\|pass\|previous <build> run}}`
	Unsupported - An unsupported test or configuration. No testing is required.

Test Matrix Install

Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.

Image sanity

Image sanity tests

Release Level	Test Case	Server	Workstation	Spins	ARM disks	Cloud
Alpha / Final	QA:Testcase_Mediakit_Checksums	pass RC1 jcajka ^[1]	none	none	none	none
Beta	QA:Testcase_Mediakit_ISO_Size	none	none	none	none	none
Alpha	QA:Testcase_Mediakit_Repoclosure	warn jcajka menantea ^[2]
Alpha	QA:Testcase_Mediakit_FileConflicts	pass RC1 jcajka ^[3]^[4]

↑ + ppc64le TC4 ok
↑ RC1 ppc64le failed (see https://bugzilla.redhat.com/show_bug.cgi?id=1148029)
↑ After avoiding zero division error in check script(in progress output) by ceiling variable milestone
↑ ppc64le TC4 ok

Default boot and install

Bare metal testing required
Running these tests in a virtualized environment is valuable, but the test must pass on bare metal using a physical install medium for each release-blocking image in each test environment at least for the final release candidate image (i.e. the released image) for each milestone.

In all of these tests, the test case used is QA:Testcase_Boot_default_install. That is where the links point. The same test needs to be run for multiple images and target platforms. Note that the non-installer-based ARM disk images are covered by the later #ARM disk images section.

Default boot and install

Release Level	Image	ppc64 host	ppc64 KVM guest	ppc64 LPAR	ppc64le host	ppc64le KVM guest
Alpha / Optional (ARM)	Workstation	none	none	none	none	none
Alpha	Server netinst	none	none	none	none	none
Alpha	Server offline	none	none	none	none	none
Alpha	KDE	none	none	none	none	none
Optional	Xfce	none	none	none	none	none
Optional	LXDE	none	none	none	none	none
Optional	MATE	none	none	none	none	none
Optional	SoaS	none	none	none	none	none

There is no need fo USB stick test matrix for ppc64/ppc64le architectures, So no tests related to QA:Fedora_21_Install_Results_Template#USB_stick

There is no need for ARM disk images' test matrix for ppc64/ppc64le architectures, So no tests related to QA:Fedora_21_Install_Results_Template#ARM_disk_images

Cloud images

Release Level	Test Case	ppc64 host	ppc64 KVM guest	ppc64 LPAR	ppc64le host	ppc64le KVM guest
Alpha	QA:Testcase_EC2_AMI_Validation	none	none	none	none	none
Alpha	QA:Testcase_OpenStack_Image_Validation	none	none	none	none	none

PXE images

PXE boot tests

Release Level	Test Area	Test Case	ppc64 host	ppc64 KVM guest	ppc64 LPAR	ppc64le host	ppc64le KVM guest
Alpha	Boot Methods	QA:Testcase_Boot_Methods_Pxeboot	pass gustavold tc4 ^[1]	pass michel_mno TC3 TC4 RC1 RC2	none	fail gustavold RC1 ^[2] ^[3]	pass michel_mno TC4 RC2 pass RC1 menantea

↑ P8 works fine. P7+ installed system doesn't boot.
↑ RHBZ #1149862
↑ RHBZ #1151129

Storage device tests

Release Level	Test Case	ppc64 host	ppc64 KVM guest	ppc64 LPAR	ppc64le host	ppc64le KVM guest
Alpha	QA:Testcase_install_to_SCSI (vscsi)			pass TC4 efi pass RC1 efi pass RC2 efi
Alpha	QA:Testcase_install_to_SAS	none	none	none	none	none
Beta	QA:Testcase_install_to_firmware_RAID	none	none	none	none	none
Beta	QA:Testcase_install_to_hardware_RAID	none	none	none	none	none
Beta	QA:Testcase_install_to_VirtIO		fail Alpha RC1 michel_mno ^[1]			fail Alpha RC1 michel_mno ^[1]
Final	QA:Testcase_install_to_iSCSI_no_authentication	none	none	none	none	none
Final	QA:Testcase_install_to_multipath	none	none	none	none	none
Final	QA:Testcase_install_to_FCoE_target	none	none	none	none	none

↑ ^1.0 ^1.1 RHBZ #1153080

Storage volume type tests

Guided installation

Storage volume type tests

Release Level	Test Case	ppc64 host	ppc64 KVM guest	ppc64 LPAR	ppc64le host	ppc64le KVM guest
Alpha	QA:Testcase_partitioning_guided_empty	pass TC4 gustavold	pass jcajka pass TC4 efi pass RC2 jcapik	pass TC4 hamzy pass RC1 efi	none	pass RC1 RC2 menantea
Alpha	QA:Testcase_partitioning_guided_delete_all	none	pass RC1 jcajka pass TC4 efi pass RC2 jcapik	pass TC4 hamzy pass RC1 efi pass RC2 efi	none	pass RC1 RC2 menantea jcajka
Alpha	QA:Testcase_partitioning_guided_multi_select	pass TC4 gustavold	pass jcajka pass TC4 efi pass RC2 jcapik	pass TC4 hamzy	none	pass RC1 RC2 menantea
Beta	QA:Testcase_Partitioning_On_Software_RAID	none	none	none	none	none
Beta	QA:Testcase_partitioning_guided_delete_partial	none	none	none	none	none
Beta	QA:Testcase_partitioning_guided_free_space	none	none	none	none	none
Beta	QA:Testcase_partitioning_guided_encrypted	none	none	none	none	none
Beta	QA:Testcase_partitioning_guided_multi_empty_all	none	none	none	none	none

Guided shrinking

For this test, the column headings refer to the storage volume type to be shrunk, not the one chosen to replace it for the new installation.

Release Level	Test Case	LVM	ext4	NTFS	BTRFS
Final	QA:Testcase_partitioning_guided_shrink	none	none	none	none

General Tests

Install Variations & General Tests

Release Level	Test Area	Test Case	ppc64 host	ppc64 KVM guest	ppc64 LPAR	ppc64le host	ppc64le KVM guest
Beta	Partitioning	QA:Testcase_Anaconda_custom_partitioning	none	none	none	none	none
Beta	Partitioning	QA:Testcase_Partitioning_On_Software_RAID	none	none	none	none	none
Final	Partitioning	QA:Testcase_anaconda_btrfs_rootfs_on_disk_partition	none	none	none	none	none
Final	Partitioning	QA:Testcase_anaconda_ext3_rootfs_on_disk_partition	none	none	none	none	none
Final	Partitioning	QA:Testcase_anaconda_xfs_rootfs_on_disk_partition	none	none	none	none	none
Alpha	User Interface	QA:Testcase_Anaconda_User_Interface_Graphical	^[1]
Alpha	User Interface	QA:Testcase_Anaconda_User_Interface_Basic_Video_Driver
Alpha	User Interface	QA:Testcase_Anaconda_User_Interface_Text	none	pass TC4 efi pass RC1 hamzy warn RC1 jcajka ^[2]	pass TC4 menantea warn RC1 efi warn RC2 efi ^[3]	none	warn RC1 RC2 menantea jcajka
Alpha	User Interface	QA:Testcase_Anaconda_User_Interface_VNC	pass TC4 gustavold	warn TC4 efi ^[4] ^[5] pass RC1 hamzy jcajka pass RC2 jcapik	warn TC4 menantea pass RC1 efi pass RC2 efi	none	pass RC1 RC2 menantea jcajka
Alpha	User Interface	QA:Testcase_Anaconda_User_Interface_VNC_Vncconnect	none	pass TC4 jcajka pass RC2 jcapik	pass TC4 menantea pass RC1 efi	none	pass RC1 menantea
Beta	User Interface	QA:Testcase_Anaconda_User_Interface_serial_console	none	none	none	none	none
Alpha	Install Repository	QA:Testcase_install_repository_Mirrorlist_default	none	fail TC4 jcajka ^[6] fail RC1 hamzy fail RC2 michel_mno	fail RC1 efi	none	fail RC1 menantea ^[7] fail RC1 hamzy
Alpha	Install Repository	QA:Testcase_install_repository_Mirrorlist_graphical	none	pass jcajka pass RC1 hamzy fail RC2 michel_mno ^[8] pass RC2 jcapik	pass TC4 efi pass RC1 efi ^[9]	none	pass TC4 menantea ^[10] pass RC1 hamzy
Alpha	Install Repository	QA:Testcase_install_repository_HTTP/FTP_graphical	none	pass jcajka pass RC1 hamzy pass RC2 jcapik	pass TC4 efi ^[11]	none	pass TC4 menantea ^[12]
Alpha	Install Repository	QA:Testcase_install_repository_HTTP/FTP_variation	none	pass TC4 jcajka ^[13] pass RC2 jcapik	pass TC4 efi pass RC1 efi ^[14]	none	pass RC1 menantea ^[15]
Beta	Install Repository	QA:Testcase_install_repository_NFS_graphical	none	none	none	none	none
Beta	Install Repository	QA:Testcase_install_repository_NFS_variation	none	none	none	none	none
Final	Install Repository	QA:Testcase_install_repository_NFSISO_variation	none	none	none	none	none
Final	Install Repository	QA:Testcase_install_repository_Hard_drive_variation	none	none	none	none	none
Beta	Storage Devices	QA:Testcase_Install_to_Previous_KVM	none	none	none	none	none
Beta	Storage Devices	QA:Testcase_Install_to_Current_KVM	none	none	none	none	none
Final	Storage Devices	QA:Testcase_Boot_Methods_Xen_Para_Virt	none	none	none	none	none
Alpha	Recovery	QA:Testcase_Anaconda_save_traceback_to_bugzilla	none	none	pass RC1 efi ^[16]	none	pass TC4 menantea
Alpha	Recovery	QA:Testcase_Anaconda_rescue_mode	none	fail TC4 efi ^[17] fail RC1 jcajka ^[18] ^[19] fail RC2 michel_mno ^[19]	fail TC4 menantea ^[17] fail RC1 efi ^[19]	none	pass RC1 RC2 menantea
Alpha	Recovery	QA:Testcase_Anaconda_updates.img_via_URL	none	pass RC1 michel_mno	none	none	pass RC1 michel_mno
Final	Recovery	QA:Testcase_Anaconda_updates.img_via_installation_source	none	none	none	none	none
Final	Recovery	QA:Testcase_Anaconda_updates.img_via_local_media	none	none	none	none	none
Alpha	Kickstart installation	QA:Testcase_kickstart_user_creation	none	pass RC1 jcajka ^[20]	pass TC4 efi pass RC1 efi	none	warn RC2 jcajka ^[21]
Beta	Kickstart Delivery	QA:Testcase_Kickstart_Http_Server_Ks_Cfg	none	none	none	none	none
Beta	Kickstart Delivery	QA:Testcase_Kickstart_File_Path_Ks_Cfg	none	none	none	none	none
Beta	Kickstart Delivery	QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg	none	none	none	none	none
Beta	Kickstart Delivery	QA:Testcase_Kickstart_Nfs_Server_Path_Ks_Cfg	none	none	none	none	none
Alpha	User Creation	QA:Testcase_Anaconda_user_creation	none	pass TC4 efi pass RC1 jcajka	pass TC4 menantea pass RC1 efi pass RC2 efi	none	pass RC1 RC2 menantea jcajka
Beta	Upgrade system	QA:Testcase_upgrade_fedup_cli_previous_desktop	none	none	none	none	none
Beta	Upgrade system	QA:Testcase_upgrade_fedup_cli_previous_kde	none	none	none	none	none
Beta	Upgrade system	QA:Testcase_upgrade_fedup_cli_previous_minimal	none	none	none	none	none
Beta	Upgrade system	QA:Testcase_upgrade_fedup_cli_previous_desktop_encrypted	none	none	none	none	none
Optional	Boot Methods	QA:Testcase_Install_Image_Boot_Local	none	none	none	none	none
Optional	Memory Test	QA:Testcase_Memtest86	none	none	none	none	none
Optional	Recovery	QA:Testcase_Anaconda_traceback_debug_mode	none	none	none	none	none
Optional	Partitioning	QA:Testcase_Partitioning_No_Swap	none	none	none	none	none
Optional	Partitioning	QA:Testcase_Anaconda_autopart_(shrink)_install	none	none	none	none	none

↑ not tested as no graphical card
↑ options text/inst.text seems to be ignored, text mode needs to be selected manually
↑ Installation is successful, however the text install mode (choice 2) has to be manually selected at the beginning despite the inst.text boot option.
↑ Using password protected VNC makes installation hang in the end, manual restart is needed, but installation is OK. Known issue, fix on the way(https://lists.fedorahosted.org/pipermail/anaconda-patches/2014-September/013080.html).
↑ Hang at the end with password protected VNC is still present with TC4.
↑ default urls fail https://mirrors.fedoraproject.org/metalink?repo=fedora-workstation-21&arch=ppc64 , https://mirrors.fedoraproject.org/metalink?repo=fedora-server-21&arch=ppc64 , https://mirrors.fedoraproject.org/metalink?repo=fedora-cloud-21&arch=ppc64 with No repomd file. pbrobinson on irc: when we declare it alpha, it gets moved to another directory and synced automatically to the mirrors.
↑ no ppc64le image found in https://mirrors.fedoraproject.org/metalink?repo=fedora-server-21&arch=ppc64le
↑ RHBZ #1153657
↑ tested using ppc64 image found in http://mirrors.fedoraproject.org/mirrorlist?repo=fedora-21&arch=ppc64
↑ tested using ppc64le image found in http://mirrors.fedoraproject.org/mirrorlist?repo=fedora-21&arch=ppc64le
↑ tested using ppc64 packages found in http://ppc.koji.fedoraproject.org/stage/21_Alpha_TC4/Server/ppc64/os/
↑ tested using ppc64le packages found in http://fr2.rpmfind.net/linux/fedora-secondary/development/21/ppc64le/os/
↑ tested using ppc64 packages found in http://ppc.koji.fedoraproject.org/stage/21_Alpha_TC4/Server/ppc64/os/
↑ tested using ppc64 packages found in http://ppc.koji.fedoraproject.org/stage/21_Alpha_TC4/Server/ppc64/os/ and in http://ppc.koji.fedoraproject.org/stage/21_Alpha/Server/ppc64/os/
↑ warning with anaconda cmdline: grub> linux /ppc/ppc64/vmlinuz inst.repo=http://ppc.koji.fedoraproject.org/stage/f21_Alpha_RC1/21_Alpha/Server/ppc64le/os/ ip=:::::eth0:dhcp; [ 132.603815] dracut-initqueue[524]: Warning: Downloading 'http://ppc.koji.fedoraproject.org/stage/f21_Alpha_RC1/21_Alpha/Server/ppc64le/os//images/product.img' failed!
↑ Tested in text mode, resulting bug is RHBZ #1151455.
↑ ^17.0 ^17.1 RHBZ #1101341
↑ RHBZ #1152014
↑ ^19.0 ^19.1 ^19.2 RHBZ #1151455
↑ As graphical mode is not available and alternative is not specified in provided ks file, installer will prompt.
↑ using https://jcajka.fedorapeople.org/ks/root-user-crypted-net.ks instead of provided ks file(replaced installation source(DVD)), otherwise installation fails due to missing e2fsprogs

Test Matrix Server validation

Release Level	Test Case	ppc64 host	ppc64 KVM guest	ppc64 LPAR	ppc64le host	ppc64le KVM guest
Alpha	QA:Testcase_kickstart_firewall	none	pass TC4 michel_mno	pass RC1 efi	none	warn RC1 menantea RC2 jcajka ^[1]^[2] fail TC4 michel_mno RC1 menantea RC2 jcajka ^[3] ^[4]
Alpha	QA:Testcase_realmd_join_kickstart	none	none	none	none	none
Alpha	QA:Testcase_realmd_join_server	none	none	none	none	none
Alpha	QA:Testcase_FreeIPA_realmd_join	none	none	none	none	none
Alpha	QA:Testcase_Server_firewall_default	none	pass RC1 jcajka	pass RC1 efi	none	pass RC2 jcajka
Alpha	QA:Testcase_Server_cockpit_default	none	pass RC1 jcajka	pass RC1 efi	none	pass RC2 jcajka

↑ Using cdrom for installation instead of provided url in ks file. Installation fails due to missing e2fsprogs when unmodified ks file is used.
↑ modified ks files: https://jcajka.fedorapeople.org/ks/firewall-configured-net.ks, https://jcajka.fedorapeople.org/ks/firewall-disabled-net.ks
↑ RHBZ #1150023
↑ RHBZ #1153690

Test Matrix Base validation

Release Level	Test Case	Workstation	Server	KDE	ARM	Cloud	References
Alpha	QA:Testcase_base_initial_setup	none	none	none	none
Alpha	QA:Testcase_base_startup	none	pass jcajka menantea ^[1]	none	none	none	↑ RC1 ppc64 KVM / RC2 ppc64le KVM
Alpha	QA:Testcase_base_system_logging	none	pass jcajka menantea ^[1]	none	none	none	↑ RC1 ppc64 KVM / RC2 ppc64le KVM
Final	QA:Testcase_Services_start	none	none	none	none	none
Final	QA:Testcase_base_selinux	none	none	none	none	none
Final	QA:Testcase_base_service_manipulation	none	none	none	none	none

@@ Line 593: / Line 593: @@
 | [[QA:Testcase_install_repository_HTTP/FTP_variation]]
 | {{result|none}}
-| {{result|pass|TC4 jcajka}}<ref>tested using ppc64 packages found in http://ppc.koji.fedoraproject.org/stage/21_Alpha_TC4/Server/ppc64/os/</ref>
+| {{result|pass|TC4 jcajka}}<ref>tested using ppc64 packages found in http://ppc.koji.fedoraproject.org/stage/21_Alpha_TC4/Server/ppc64/os/</ref>{{result|pass|RC2 jcapik}}
 | {{result|pass|TC4 efi}}{{result|pass|RC1 efi}}<ref>tested using ppc64 packages found in http://ppc.koji.fedoraproject.org/stage/21_Alpha_TC4/Server/ppc64/os/ and in http://ppc.koji.fedoraproject.org/stage/21_Alpha/Server/ppc64/os/</ref>
 | {{result|none}}

Search

F21PPC Install Results: Difference between revisions

Revision as of 18:43, 16 October 2014

Contents

Instructions

What To Test

Who's available

Add or Remove a Test Case

Workarounds

21_Alpha_TC3

Key

Test Matrix Install

Image sanity

Default boot and install

Cloud images

PXE images

Storage device tests

Storage volume type tests

Guided installation

Guided shrinking

General Tests

Test Matrix Server validation

Test Matrix Base validation