From Fedora Project Wiki

m (Updated test cases)
(Drop direct Test Days category membership)
 
(51 intermediate revisions by 11 users not shown)
Line 21: Line 21:
* Quality Assurance
* Quality Assurance
** [[User:jlaska|James Laska]]
** [[User:jlaska|James Laska]]
** [[User:liam|liam]]


== What's needed to test ==
== What's needed to test ==
Line 26: Line 27:
''Required'' for testing:
''Required'' for testing:
* [[Releases/Rawhide|Rawhide]] or [https://fedoraproject.org/get-prerelease Fedora 11 Beta] fully updated.
* [[Releases/Rawhide|Rawhide]] or [https://fedoraproject.org/get-prerelease Fedora 11 Beta] fully updated.
* A system capable of testing [[Features/EFI]] support
* A [http://bugzilla.redhat.com Red Hat Bugzilla] account.
* A [http://bugzilla.redhat.com Red Hat Bugzilla] account.


Line 49: Line 49:
! Architecture !! MD5SUM  
! Architecture !! MD5SUM  
|-
|-
| <!-- [http://jlaska.fedorapeople.org/live/livecd-fedora-livecd-testday-20090331-i386.iso i386] --> Coming soon || Coming soon
| [http://jlaska.fedorapeople.org/live/livecd-fedora-livecd-testday-20090414-i386.iso i386] || <code>8b80b540016d06a292438d9787ec5c25</code>
|-
|-
| <!-- [http://jlaska.fedorapeople.org/live/livecd-fedora-livecd-testday-20090331-x86_64.iso x86_64] --> Coming soon || Coming soon
| [http://jlaska.fedorapeople.org/live/livecd-fedora-livecd-testday-20090414-x86_64.iso x86_64] || <code>c3582375fda8c0103a77e6a1c482e56a</code>
|-
|-
|}
|}
Line 62: Line 62:
=== Test ===
=== Test ===


Follow each of these test cases:  
The following test cases are designed to stress the installer auto-partitioning:


* [[QA:TestCases/Autopart_install]]
* [[QA:Testcase Anaconda autopart_install]]
* [[QA:TestCases/Autopart_(encrypted)_install]]
* [[QA:Testcase Anaconda autopart_(encrypted)_install]]
* [[QA:Testcase_Anaconda_partitioning_uninitialized_disks]]
* [[QA:Testcase Anaconda autopart_(shrink)_install]]
* [[QA:Test_Plans/iSCSI_Installation_Test_plan#No_authentication|QA:Testcase Anaconda iSCSI no authentication]]
* [[QA:Testcase Anaconda autopart_(use free space)_install]]
* [[QA:Testcase_Anaconda_partitioning_dmraid_rootfs]]
* [[QA:Testcase_Anaconda_partitioning_dmraid_rootfs|QA:Testcase Anaconda autopart with dmraid]]
* [[QA:Test_Plans/iSCSI_Installation_Test_plan#No_authentication|QA:Testcase Anaconda autopart with iSCSI (no authentication)]]
 
The following test cases validate different software raid scenarios:
 
* [[QA/TestCases/PartitioningUsrOnRaid0]]
* [[QA/TestCases/PartitioningRootfsOnRaid1]]
* [[QA/TestCases/PartitioningUsrOnRaid5]]
* [[QA/TestCases/PartitioningUsrOnRaid6]]
* [[QA/TestCases/PartitioningRaid0OnLvmDevice]]
* [[QA/TestCases/PartitioningPreExistingRaidRaid]]
 
{{admon/note|Got updates?|All testing should be performed using a [[Anaconda/Updates]].  To benefit from test day fixes, you must provide the following boot argument: <pre>updates=http://clumens.fedorapeople.org/updates.img</pre>}}


=== Report your results ===
=== Report your results ===
Line 76: Line 88:
** The second should be a link to your Smolt hardware profile (see [[#What.27s_needed_to_test]] for details)
** The second should be a link to your Smolt hardware profile (see [[#What.27s_needed_to_test]] for details)
** For each test case, refer to the test case instructions for details
** For each test case, refer to the test case instructions for details
** Finally, the last column is available for any general comments or concerns not eddress
** Finally, the last column is available for any general comments or concerns


== Results ==
== Results ==
Please record ''autopart'' test results in the table below:
{|
{|
! User
! User
! Smolt Profile
! Smolt Profile
! [[QA:TestCases/Autopart_install|autopart]]
! [[QA:Testcase Anaconda autopart_install|autopart]]
! [[QA:TestCases/Autopart_(encrypted)_install|autopart (luks)]]
! [[QA:Testcase Anaconda autopart_(encrypted)_install|autopart encrypt]]
! [[QA:Testcase_test3]]
! [[QA:Testcase Anaconda autopart_(shrink)_install|autopart shrink]]
! [[QA:Testcase_test4]]
! [[QA:Testcase Anaconda autopart_(use free space)_install|autopart freespace]]
! [[QA:Testcase_test5]]
! [[QA:Testcase_Anaconda_partitioning_dmraid_rootfs|dmraid]]
! [[QA:Test_Plans/iSCSI_Installation_Test_plan#No_authentication|iSCSI]]
! Comments
! Comments
|-
|-
| [[User:SampleUser]]  
| [[User:SampleUser | SampleUser]]  
| <!-- Smolt profile -->  
| <!-- Smolt profile -->  
| <!-- [[QA:Testcase_test1]] -->
| <!-- [[QA:Testcase Anaconda autopart_install|autopart]] -->
| <!-- [[QA:Testcase_test2]] -->
| <!-- [[QA:Testcase Anaconda autopart_(encrypted)_install|autopart+encrypt]] -->
| <!-- [[QA:Testcase_test3]] -->
| <!-- [[QA:Testcase Anaconda autopart_(shrink)_install|autopart shrink]] -->
| <!-- [[QA:Testcase_test4]] -->
| <!-- [[QA:Testcase Anaconda autopart_(use free space)_install|autopart freespace]] -->
| <!-- [[QA:Testcase_test5]] -->
| <!-- [[QA:Testcase_Anaconda_partitioning_dmraid_rootfs|dmraid]] -->
| <!--  [[QA:Test_Plans/iSCSI_Installation_Test_plan#No_authentication|iSCSI]] -->
| <!-- Comments -->
| <!-- Comments -->
|-
| [[User:mnowak | Michal Nowak]]
| [http://www.smolts.org/client/show/pub_cb1b20e9-801a-4dbb-b558-c2e52a7846e2 HW]
| PASS
| PASS
| ----
| ----
| N/A
| N/A
|
* running rawhide-20090407 -- recent trees are not installable for me due to several--reported already--bugs
* so wide "Enter password dialog"
* while entering password the screen ugly blinks
* mouse pointer is set to "busy" when on GRUB screen -> "Back" -> "Continue" until next screen
|-
| [[User:jlaska|James Laska]]
| KVM virtio guest <!-- Smolt profile -->
| <!--  [[QA:Testcase Anaconda autopart_install|autopart]] --> PASS <ref>Updates image required</ref>
| <!--  [[QA:Testcase Anaconda autopart_(encrypted)_install|autopart+encrypt]] --> PASS <ref>Updates image required</ref>
FAIL <ref>[[rhbug:495785|495785]] - LVMError: lvcreate failed for vg_brutus/lv_swap</ref>
| <!--  [[QA:Testcase Anaconda autopart_(shrink)_install|autopart shrink]] --> INPROGRESS <ref>[[rhbug:493219|493219]] - mixing disks from previous installs fails</ref>
| <!--  [[QA:Testcase Anaconda autopart_(use free space)_install|autopart freespace]] --> INPROGRESS
| <!--  [[QA:Testcase_Anaconda_partitioning_dmraid_rootfs|dmraid]] -->
| <!--  [[QA:Test_Plans/iSCSI_Installation_Test_plan#No_authentication|iSCSI]] -->
| <!-- Comments -->
<references/>
Other bugs found:
* [[rhbug:495708|495708]] - TypeError: argument 2 must be string, not None
* [[rhbug:495713|495713]] - while reinitializing an empty disk
* [[rhbug:491700|491700]] - while trying to SaveToBugzilla
|-
| [[User:jlaska|James Laska]]
| IBM Power5 <!-- Smolt profile -->
| <!--  [[QA:Testcase Anaconda autopart_install|autopart]] --> [[rhbug:491754|FAIL]]
| <!--  [[QA:Testcase Anaconda autopart_(encrypted)_install|autopart+encrypt]] -->
| <!--  [[QA:Testcase Anaconda autopart_(shrink)_install|autopart shrink]] -->
| <!--  [[QA:Testcase Anaconda autopart_(use free space)_install|autopart freespace]] -->
| <!--  [[QA:Testcase_Anaconda_partitioning_dmraid_rootfs|dmraid]] -->
| <!--  [[QA:Test_Plans/iSCSI_Installation_Test_plan#No_authentication|iSCSI]] -->
| <!-- Comments -->
* [[rhbug:491754|491754]] - DeviceError: cannot commit to disk sda after 5 attempts
|-
| [[User:ixs | Andreas Thienemann]]
| [http://www.smolts.org/client/show/pub_1d475516-b059-4755-b201-c80d7ea5e02a HW]
| PASS
| FAIL <ref>[[rhbug:493575|493575]] - Off by one error calculating free extents</ref>
| <!--  [[QA:Testcase Anaconda autopart_(shrink)_install|autopart shrink]] -->
| <!--  [[QA:Testcase Anaconda autopart_(use free space)_install|autopare freespace]] -->
| <!--  [[QA:Testcase_Anaconda_partitioning_dmraid_rootfs|dmraid]] -->
| <!--  [[QA:Test_Plans/iSCSI_Installation_Test_plan#No_authentication|iSCSI]] -->
| <!-- Comments --> <references/>
|-
| [[User:alindebe|Andy Lindeberg]]
| <!-- Smolt profile -->
| <!--  [[QA:Testcase Anaconda autopart_install|autopart]] --> PASS <ref>[[rhbug:495708|495708]] - TypeError: argument 2 must be string, not None </ref>
| <!--  [[QA:Testcase Anaconda autopart_(encrypted)_install|autopart+encrypt]] --> FAIL
| <!--  [[QA:Testcase Anaconda autopart_(shrink)_install|autopart shrink]] -->
| <!--  [[QA:Testcase Anaconda autopart_(use free space)_install|autopart freespace]] -->
| <!--  [[QA:Testcase_Anaconda_partitioning_dmraid_rootfs|dmraid]] -->
| <!--  [[QA:Test_Plans/iSCSI_Installation_Test_plan#No_authentication|iSCSI]] -->
| <!-- Comments --> <references/>
|-
| [[User:redwolfe|G.Wolfe Woodbury]]
| <!-- Smolt profile --> [http://www.smolts.org/client/show/pub_5b4371f7-d567-4b8a-a2b9-358e41f3f736 HW]
| <!--  [[QA:Testcase Anaconda autopart_install|autopart]] --> FAIL
| <!--  [[QA:Testcase Anaconda autopart_(encrypted)_install|autopart+encrypt]] --> N/A
| <!--  [[QA:Testcase Anaconda autopart_(shrink)_install|autopart shrink]] --> N/A
| <!--  [[QA:Testcase Anaconda autopart_(use free space)_install|autopart freespace]] --> N/A
| <!--  [[QA:Testcase_Anaconda_partitioning_dmraid_rootfs|dmraid]] --> N/A
| <!--  [[QA:Test_Plans/iSCSI_Installation_Test_plan#No_authentication|iSCSI]] --> FAIL
| <!-- Comments -->
* Failure setting "Root Password" after install - can't BZ due to lockup in exception finding storage devices
|-
! User
! Smolt Profile
! [[QA:Testcase Anaconda autopart_install|autopart]]
! [[QA:Testcase Anaconda autopart_(encrypted)_install|autopart+encrypt]]
! [[QA:Testcase Anaconda autopart_(shrink)_install|autopart shrink]]
! [[QA:Testcase Anaconda autopart_(use free space)_install|autopart freespace]]
! [[QA:Testcase_Anaconda_partitioning_dmraid_rootfs|dmraid]]
! [[QA:Test_Plans/iSCSI_Installation_Test_plan#No_authentication|iSCSI]]
! Comments
|-
|}
Any ''RAID'' test results can be noted in the following table:
{|
! User
! Smolt Profile
! [[QA/TestCases/PartitioningUsrOnRaid0|RAID0]]
! [[QA/TestCases/PartitioningRootfsOnRaid1|RAID1]]
! [[QA/TestCases/PartitioningUsrOnRaid5|RAID5]]
! [[QA/TestCases/PartitioningUsrOnRaid6|RAID6]]
! [[QA/TestCases/PartitioningRaid0OnLvmDevice|RAID on LVM]]
! [[QA/TestCases/PartitioningPreExistingRaidRaid|RAID on RAID]]
! Comments
|-
| [[User:SampleUser | SampleUser]]
| <!-- Smolt profile -->
| <!--  [[QA:Testcase Anaconda autopart_install|autopart]] -->
| <!--  [[QA:Testcase Anaconda autopart_(encrypted)_install|autopart+encrypt]] -->
| <!--  [[QA:Testcase Anaconda autopart_(shrink)_install|autopart shrink]] -->
| <!--  [[QA:Testcase Anaconda autopart_(use free space)_install|autopare freespace]] -->
| <!--  [[QA:Testcase_Anaconda_partitioning_dmraid_rootfs|dmraid]] -->
| <!--  [[QA:Test_Plans/iSCSI_Installation_Test_plan#No_authentication|iSCSI]] -->
| <!-- Comments -->
|-
| [[User:Bruno | Bruno Wolff]]
| None Yet
| N/A
| PASS <ref>[[rhbug:495288|495288]] - AttributeError: 'NoneType' object has no attribute 'get_active'</ref> <ref>[[rhbug:495608|495608]] -  Traceback while doing custom layout install with raid and encryption</ref>
| N/A
| N/A
| N/A
| N/A
| <references/> With anaconda 11.5.0.47 I was able to install with a custom layout using encryption on top of raid 1.
|-
| [[User:jlaska |James Laska]]
| <!-- Smolt profile -->
| <!--  [[QA:Testcase Anaconda autopart_install|autopart]] -->
| <!--  [[QA:Testcase Anaconda autopart_(encrypted)_install|autopart+encrypt]] -->
| <!--  [[QA:Testcase Anaconda autopart_(shrink)_install|autopart shrink]] -->
| <!--  [[QA:Testcase Anaconda autopart_(use free space)_install|autopare freespace]] -->
| <!--  [[QA:Testcase_Anaconda_partitioning_dmraid_rootfs|dmraid]] -->
| <!--  [[QA:Test_Plans/iSCSI_Installation_Test_plan#No_authentication|iSCSI]] -->
| <!-- Comments -->
|-
| [[User:Messerting|Messerting]]
| [http://www.smolts.org/client/show/pub_dad3dfe3-622e-47b7-ad0f-130cc78dc305 HW]
| N/A
| N/A
| N/A
| N/A
| N/A
| N/A
| Fedora-11-Snap1-x86_64-Live-KDE on Asus P5E-VM HDMI. Tried Custom Layout, but hit [https://bugzilla.redhat.com/show_bug.cgi?id=495582 bz 495582] when I tried to keep my /home and reformat swap and "/". That left the two latter empty/uninitialized, so my second attempt resulted in [https://bugzilla.redhat.com/show_bug.cgi?id=495584 bz 495584] (-> [https://bugzilla.redhat.com/show_bug.cgi?id=495288 bz 495288]). I then booted the live cd again, downloaded and update anaconda-11.5.0.44-1 from koji, and tried again and hit [https://bugzilla.redhat.com/show_bug.cgi?id=495665 bz 495665].
|-
|-
! User
! User
! Smolt Profile
! Smolt Profile
! [[QA:TestCases/Autopart_install|autopart]]
! [[QA/TestCases/PartitioningUsrOnRaid0|RAID0]]
! [[QA:TestCases/Autopart_(encrypted)_install|autopart (luks)]]
! [[QA/TestCases/PartitioningRootfsOnRaid1|RAID1]]
! [[QA:Testcase_test3]]
! [[QA/TestCases/PartitioningUsrOnRaid5|RAID5]]
! [[QA:Testcase_test4]]
! [[QA/TestCases/PartitioningUsrOnRaid6|RAID6]]
! [[QA:Testcase_test5]]
! [[QA/TestCases/PartitioningRaid0OnLvmDevice|RAID on LVM]]
! [[QA/TestCases/PartitioningPreExistingRaidRaid|RAID on RAID]]
! Comments
! Comments
|-
|-
|}
|}


[[Category:Test Days]]
[[Category:Fedora 11 Test Days]]

Latest revision as of 19:31, 26 June 2015

DATE TIME WHERE
Tue April 14, 2009 All day #fedora-qa)

What to test?[edit]

Today's installment of Fedora Test Day will revisit:

Who's available[edit]

The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...

What's needed to test[edit]

Required for testing:

Optional but recommended for testing:

  • FAS Account - you can create an account in 3 minutes if you don't have one. This account lets you make non-anonymous contributions to the Fedora wiki.
  • Your hardware profile uploaded to Smolt according to these instructions
Rawhide is raw
Rawhide is a development branch of Fedora. While changes to Fedora post-beta are limited, it is advised you back up your data before participating.

How to test?[edit]

Update your machine[edit]

See the instructions on the Rawhide page on the various ways in which you can install or update to Rawhide. Or:

Live Image[edit]

Optionally, you may download a rawhide live image for your architecture. Tips on using a live image are available at FedoraLiveCD.


Architecture MD5SUM
i386 8b80b540016d06a292438d9787ec5c25
x86_64 c3582375fda8c0103a77e6a1c482e56a


Latest syslinux package?
Creating a LiveUSB of this rawhide image requires the latest version of syslinux, which is currently available in Rawhide and in the latest Windows liveusb-creator. Users of F10 and below can upgrade to the latest syslinux package using 
yum --enablerepo=rawhide update syslinux
.

Test[edit]

The following test cases are designed to stress the installer auto-partitioning:

The following test cases validate different software raid scenarios:

Got updates?
All testing should be performed using a Anaconda/Updates. To benefit from test day fixes, you must provide the following boot argument: 
updates=http://clumens.fedorapeople.org/updates.img

Report your results[edit]

  • If you experience any unexpected outcomes or failures while executing any of the tests, report a bug to Bugzilla. If you are unsure about exactly how to file the report, just ask on IRC and we will help you.
  • Once you have completed the tests, add your results to the Results table below.
    • The first column should be your name with a link to your User page in the Wiki if you have one, typically in the format [[User:FasName]]
    • The second should be a link to your Smolt hardware profile (see #What.27s_needed_to_test for details)
    • For each test case, refer to the test case instructions for details
    • Finally, the last column is available for any general comments or concerns

Results[edit]

Please record autopart test results in the table below:

User Smolt Profile autopart autopart encrypt autopart shrink autopart freespace dmraid iSCSI Comments
SampleUser
Michal Nowak HW PASS PASS ---- ---- N/A N/A
  • running rawhide-20090407 -- recent trees are not installable for me due to several--reported already--bugs
  • so wide "Enter password dialog"
  • while entering password the screen ugly blinks
  • mouse pointer is set to "busy" when on GRUB screen -> "Back" -> "Continue" until next screen
James Laska KVM virtio guest PASS [1] PASS [2]

FAIL [3]

INPROGRESS [4] INPROGRESS
  1. ↑ Updates image required
  2. ↑ Updates image required
  3. ↑ 495785 - LVMError: lvcreate failed for vg_brutus/lv_swap
  4. ↑ 493219 - mixing disks from previous installs fails

Other bugs found:

  • 495708 - TypeError: argument 2 must be string, not None
  • 495713 - while reinitializing an empty disk
  • 491700 - while trying to SaveToBugzilla
James Laska IBM Power5 FAIL
  • 491754 - DeviceError: cannot commit to disk sda after 5 attempts
Andreas Thienemann HW PASS FAIL [1]
  1. ↑ 493575 - Off by one error calculating free extents
Andy Lindeberg PASS [1] FAIL
  1. ↑ 495708 - TypeError: argument 2 must be string, not None
G.Wolfe Woodbury HW FAIL N/A N/A N/A N/A FAIL
  • Failure setting "Root Password" after install - can't BZ due to lockup in exception finding storage devices
User Smolt Profile autopart autopart+encrypt autopart shrink autopart freespace dmraid iSCSI Comments

Any RAID test results can be noted in the following table:

User Smolt Profile RAID0 RAID1 RAID5 RAID6 RAID on LVM RAID on RAID Comments
SampleUser
Bruno Wolff None Yet N/A PASS [1] [2] N/A N/A N/A N/A
  1. ↑ 495288 - AttributeError: 'NoneType' object has no attribute 'get_active'
  2. ↑ 495608 - Traceback while doing custom layout install with raid and encryption
With anaconda 11.5.0.47 I was able to install with a custom layout using encryption on top of raid 1.
James Laska
Messerting HW N/A N/A N/A N/A N/A N/A Fedora-11-Snap1-x86_64-Live-KDE on Asus P5E-VM HDMI. Tried Custom Layout, but hit bz 495582 when I tried to keep my /home and reformat swap and "/". That left the two latter empty/uninitialized, so my second attempt resulted in bz 495584 (-> bz 495288). I then booted the live cd again, downloaded and update anaconda-11.5.0.44-1 from koji, and tried again and hit bz 495665.
User Smolt Profile RAID0 RAID1 RAID5 RAID6 RAID on LVM RAID on RAID Comments
Retrieved from "https://fedoraproject.org/w/index.php?title=Test_Day:2009-04-14_AnacondaStorageRewrite&oldid=416608"