From Fedora Project Wiki

Revision as of 19:18, 26 July 2012 by Clumens (talk | contribs)

This page is intended to record QA:Fedora_17_Install_Test_Plan test results for snapshots of the new Anaconda UI scheduled for Fedora 18.

Instructions

DANGER
Do NOT perform any kind of testing of these snapshots within ten miles of any data you care about. This is very raw code and it eats babies. You absolutely must perform all testing on disposable systems or VMs.
No bugs, please
Please do NOT file bugs for failures related to this testing, per the anaconda team's request. Please explain failures with a brief reference note instead. If you cannot describe the failure concisely, please mail the test@ list with a description of the failure.

This page tracks test results against variously dated snapshots of the newUI anaconda branch, with other packages filled out from Rawhide. It is a special instance of the installation validation matrix intended for tracking the progress of the new UI.

What To Test

The snapshot images can be downloaded here. All snapshots are network install images to be written to USB or CD/DVD media, or booted directly in a virtual machine. Direct links:

Key

See the table below for a sample format for test results. All test results are posted using the format specified Template:Result.

Test Results Format
Test Result Explanation Code Entered
none
Untested - This test has not been run, and is available for anyone to contribute feedback. {{result|none}}
Pass pass robatino
Passed - The test has been run and the tester determine the test met the expected results {{result|pass|robatino}}
Inprogress inprogress adamwill
Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn. {{result|inprogress|adamwill}}
Fail fail jlaska
[1]
Failed - Indicates a failed test. For the purposes of this newUI testing, do NOT file any bugs for failures. Explain the failure with a reference.
  1. Brief description of the failure
{{result|fail|jlaska}} <ref>Brief description of the failure</ref>
Warning warn rhe
[1]
Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention.
  1. Brief description about the warning status
{{result|warn|rhe}} <ref>Brief description about the warning status</ref>
Pass pass hongqing
Warning warn kparal
Multiple results - More people can easily provide results to a single test case. {{result|pass|hongqing}} {{result|warn|kparal}}
Pass pass previous <build> run
Result from previous test run - This test result is directly moved from the test run of previous <build>. {{result|pass|previous <build> run}}
none
Unsupported - An unsupported test or configuration. No testing is required.

Test Matrix

Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.


Boot Iso

Boot.iso/Netinst.iso installation
Test Area Test Case 20120703 20120716
Boot Methods QA:Testcase_Boot_Methods_Boot_Iso
Pass pass Thub
none
Install Repository QA:Testcase_install_repository_Mirrorlist_default
Pass pass Thub
none
Install Repository QA:Testcase_install_repository_HTTP/FTP_variation
none
none

USB Stick

USB installation
Test Area Test Case 20120703 20120716
Boot Methods QA:Testcase_USB_stick_DVD Live-ISO-to-Disk
none
none
Boot Methods QA:Testcase_USB_stick_DVD_dd
none
none

General Tests

Install Variations & General Tests
Test Area Test Case 20120703 20120716
Partitioning QA:Testcase_dualboot_with_windows
none
none
User Interface QA:Testcase_Anaconda_User_Interface_Graphical
Fail fail cpuobsessed
[1]
Fail fail thub
[2]
Fail fail red
[3]
Fail fail dennisjac
[4]
Fail fail jskladan
[5]
Fail fail jskladan
[6]
Fail fail jskladan
[7]
Fail fail jskladan
[8]
Fail fail jskladan
[9]
Fail fail jskladan
[10]
Fail fail jskladan
[11]
Fail fail pschindl
[12]
User Interface QA:Testcase_Anaconda_User_Interface_Basic_Video_Driver
none
none
User Interface QA:Testcase_Anaconda_User_Interface_Text
none
none
User Interface QA:Testcase_Anaconda_User_Interface_VNC
none
none
User Interface QA:Testcase_Anaconda_User_Interface_VNC_Vncconnect
none
none
User Interface QA:Testcase_Anaconda_User_Interface_VNC_Password
none
none
User Interface QA:Testcase_Anaconda_User_Interface_Cmdline
none
none
User Interface QA:Testcase_Anaconda_User_Interface_serial_console
none
none
Install Repository QA:Testcase_install_repository_NFS_variation
none
none
Install Repository QA:Testcase_install_repository_NFSISO_variation
none
none
Install Repository QA:Testcase_install_repository_Hard_drive_variation
none
none
Partitioning QA:Testcase_Anaconda_autopart_install
none
none
Partitioning QA:Testcase_Anaconda_autopart_(encrypted)_install
none
none
Partitioning QA:Testcase_Anaconda_autopart_(use_all_space)_install
none
none
Partitioning QA:Testcase_Anaconda_autopart_(shrink)_install
none
none
Partitioning QA:Testcase_Anaconda_autopart_(use_free_space)_install
none
none
Package Set QA:Testcase_Package_Sets_Default_Package_Install
none
none
Package Set QA:Testcase_Package_Sets_Minimal_Package_Install
none
none
Package Set QA:Testcase_Package_Sets_Package_Groups_Check
none
none
Kickstart Delivery QA:Testcase_Kickstart_Http_Server_Ks_Cfg
none
none
Kickstart Delivery QA:Testcase_Kickstart_File_Path_Ks_Cfg
none
none
Kickstart Delivery QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg
none
none
Kickstart Delivery QA:Testcase_Kickstart_Nfs_Server_Path_Ks_Cfg
none
none
Recovery QA:Testcase_Anaconda_rescue_mode
none
none
Recovery QA:Testcase_Anaconda_updates.img_via_URL
none
none
Recovery QA:Testcase_Anaconda_updates.img_via_installation_source
none
none
Recovery QA:Testcase_Anaconda_updates.img_via_local_media
none
none
Storage Devices QA:Testcase_Install_to_Current_KVM
none
none
Storage Devices QA:Testcase_Install_to_Previous_KVM
none
none
Storage Devices QA:Testcase_Boot_Methods_Xen_Para_Virt
none
none
Storage Devices QA:Testcase_install_to_SATA_device
none
none
Storage Devices QA:Testcase_install_to_SCSI_device
none
none
Storage Devices QA:Testcase_install_to_PATA_device
none
none
Storage Devices QA:Testcase_Install_to_BIOS_RAID
none
none
Storage Devices QA:Testcase_Install_to_Hardware_RAID
none
none
Storage Devices QA:Testcase_Anaconda_ISCSI_No_Authentication
none
none

References

  1. Clicking the disk configuration and then accepting the defaults by clicking continue crashed the installer
    I don't see a traceback, but there was a problem like this related to uninitialized disks. Should be fixed in 20120716. --clumens
  2. Entering the network configuration page and clicking the Back button crashes with "No such file or directory: '/etc/sysconfig/network-scripts/ifcfg-eth0'"
  3. Completely froze when I clicked "I accept my fate". VM (KVM) with 1 CPU and 512 MB RAM. When trying to reproduce, I saw the hub but couldn't do anything before it froze, again. Works with 1024MB RAM.
    Should be fixed in git (3e0b5f6). --clumens
  4. Keyboard: Way too many variants listed.
    We're not playing the game of choosing which keyboard layouts to list anymore, as that made a lot of people unhappy. --clumens
  5. Entering the network configuration page and clicking the Back button crashes with "No such file or directory: '/etc/sysconfig/network-scripts/ifcfg-eth0'"
  6. Select "Czech" as the language on first screen. On the 'hub' English is selected as "Language". Go to the "Language" tab, Czech is automatically pre-selected. Push Back button, Czech is selected as Language in the 'hub'.
    msivak is looking into this. --clumens
  7. The 'search' field in Language selection tab only works for english names of languages. E.g. finds 'german' but not 'deutsch'.
    Agreed. --clumens
  8. Counter-intuitive automatic pre-selection of keyboard layouts. E.g. for Czech, there are 2 default layouts (english + czech), but for other languages with special national symbols (e.g. Spanish), there is only english layout.
  9. The whole UI is really hard to use just with keyboard.
    I've spent a very long time working on making the keyboard work nicely. Please send me a mail explaining exactly what problems you are seeing. --clumens
  10. The tabs should each have a 'Continue' button, which would switch to the next tab (e.g. "Installation Destination" tab has it).
    This isn't how the installer is laid out, though. We're not providing a linear progression anymore so Continue doesn't make sense. Storage is special in that you can have custom storage setups. --clumens
  11. With just "GNOME Desktop" selected in Software selection, the item is marked as incomplete. Message "Error checking software selection" under the section name on 'main page', is not at all enough informative. There should be a way to get to logs/error messages/...
    This should be working as of July 24. --clumens
  12. There isn't clear on what I'm clicking in 'Installation summary'. Icons haven't clear borders and 'Installation destination' is like loooooooong cat
    I don't know what the last bit means. You can click on the icon or on the text or in any of the blank space between the two. I thought it was pretty clear. I'm not sure we can do much more, but maybe mizmo has an idea. --clumens