From Fedora Project Wiki

(Drop direct Test Days category membership)
 
(17 intermediate revisions by 5 users not shown)
Line 9: Line 9:
The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...
The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...
* Development - [[User:dlehman|Dave Lehman]], [[User:clumens|Chris Lumens]],  [[User:jgranados|Joel Granados]]
* Development - [[User:dlehman|Dave Lehman]], [[User:clumens|Chris Lumens]],  [[User:jgranados|Joel Granados]]
* Quality Assurance - [[User:robertmwilliams|Robert Williams]], [[User:jlaska|James Laska]], [[User:Adamwill|Adam Williamson]]
* Quality Assurance - [[User:robertmwilliams|Robert Williams]], [[User:jlaska|James Laska]], [[User:Adamwill|Adam Williamson]], [[User:wwoods|Will Woods]]


== Prerequisite for Test Day ==
== Prerequisite for Test Day ==


* [[Releases/Rawhide|Rawhide]] fully updated (some tips below). Remember, Rawhide is an unsupported development branch: use an installation you don't mind getting broken.
* [[Releases/Rawhide|Rawhide]] fully updated (some tips below) with anaconda-11.5.0.24-3. Remember, Rawhide is an unsupported development branch: use an installation you don't mind getting broken.
* FAS Account - you can [https://admin.fedoraproject.org/accounts/ create] an account in 3 minutes if you don't have one
* FAS Account - you can [https://admin.fedoraproject.org/accounts/ create] an account in 3 minutes if you don't have one
* Selinux enabled. If you need to run in permissive mode please file a [https://bugzilla.redhat.com bug] against selinux
* Selinux enabled. If you need to run in permissive mode please file a [https://bugzilla.redhat.com bug] against selinux
* ''(optional)'' - A link to your smolt profile page on [http://www.smolts.org Smolt]


== How to test ==
== How to test ==
Line 35: Line 36:
In addition to the baseline test cases in the table below, [[QA/Exploratory_Testing|exploratory testing]] of anaconda and block devices is especially desirable.
In addition to the baseline test cases in the table below, [[QA/Exploratory_Testing|exploratory testing]] of anaconda and block devices is especially desirable.


{{admon/caution|Not Ready for Testing|Before exploring different test areas, please note that some components are known to be unstable for the test day.  This list includes:
* Multipath devices
* Partition resize
}}
=== Updates ===
All testing will start with [[Releases/Rawhide|rawhide]].  All changes for the day will be done using [[Anaconda/Updates|anaconda updates.img process]].  To test the latest storage fixes, you '''must''' boot with:
* For all architectures - <pre> updates=http://dlehman.fedorapeople.org/storage/testing/updates.img </pre>
=== Filing Bugs ===
Please file bugs against [[Anaconda]].  If manually filing a bug, please set the following attributes:
* component - anaconda
* version - rawhide
* whiteboard - StorageRewrite
Or just [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&component=anaconda&version=rawhide&short_desc=%5BStorageRewrite%5D&cf_whiteboard=StorageRewrite click here] to start a bug report.


== Test Areas and Results ==
== Test Areas and Results ==
Line 48: Line 68:


The reason for these as the major test areas is that other things like autopart, encrypted fs and ext4 could be considered functions which are applied to those test areas and anaconda interacts with them in a direct manner (that is, with fewer layers or abstractions between).
The reason for these as the major test areas is that other things like autopart, encrypted fs and ext4 could be considered functions which are applied to those test areas and anaconda interacts with them in a direct manner (that is, with fewer layers or abstractions between).


{|
{|
! style="color: white; background-color: blue;" |Native
! style="color:white; background-color:#5F94C9;" colspan="6" |Native
! style="background-color: blue;" |
! style="background-color: blue;" |
! style="background-color: blue;" |
! style="background-color: blue;" |
! style="background-color: blue;" |
! style="background-color: blue;" |
|-
|-
| style="background-color: lightgrey;" |
| style="background-color: lightyellow;font-weight: bold;" | User
| style="background-color: lightyellow; font-weight: bold;" | User
| style="background-color: lightyellow;font-weight: bold;" | Smolt Profile
| style="background-color: lightyellow;font-weight: bold;" | Smolt Profile
| style="background-color: lightyellow;font-weight: bold;" | AutoPart
| style="background-color: lightyellow;font-weight: bold;" | AutoPart
Line 67: Line 79:
| style="background-color: lightyellow;font-weight: bold;" | EncryptFS
| style="background-color: lightyellow;font-weight: bold;" | EncryptFS
|-
|-
| style="background-color: lightgrey;" |
| [[User:sample_user]]
| [[User:sample_user]]
| link to smolt profile
| link to smolt profile
Line 75: Line 86:
| style="background-color: lightgreen;" | pass
| style="background-color: lightgreen;" | pass
|-
|-
| style="background-color: lightgrey;" |
| [[User:sample_user]]
| [[User:sample_user]]
| link to smolt profile
| link to smolt profile
Line 83: Line 93:
| style="background-color: lightgreen;" | pass
| style="background-color: lightgreen;" | pass
|-
|-
| style="background-color: lightgrey;" |
| <!-- [[User:FasName]] -->
|  
| <!-- [http://www.smolts.org/client/show/pub_uuid HW] -->
|  
| <!-- PASS || FAIL || INPROGRESS -->
|  
| <!-- PASS || FAIL || INPROGRESS -->
|  
| <!-- PASS || FAIL || INPROGRESS -->
|  
| <!-- PASS || FAIL || INPROGRESS -->
|  
|-
|-
! style="color: white; background-color: blue;" |RAID
! style="color:white; background-color:#5F94C9;" colspan="6" |RAID
! style="background-color: blue;" |
! style="background-color: blue;" |
! style="background-color: blue;" |
! style="background-color: blue;" |
! style="background-color: blue;" |
! style="background-color: blue;" |
|-
|-
| style="background-color: lightgrey;" |
| style="background-color: lightyellow;font-weight: bold;" | User
| style="background-color: lightyellow;font-weight: bold;" | User
| style="background-color: lightyellow;font-weight: bold;" | Smolt Profile
| style="background-color: lightyellow;font-weight: bold;" | Smolt Profile
Line 107: Line 109:
| style="background-color: lightyellow;font-weight: bold;" | EncryptFS
| style="background-color: lightyellow;font-weight: bold;" | EncryptFS
|-
|-
| style="background-color: lightgrey;" |
| [[User:sample_user]]
| [[User:sample_user]]
| link to smolt profile
| link to smolt profile
Line 115: Line 116:
| style="background-color: lightgreen;" | pass
| style="background-color: lightgreen;" | pass
|-
|-
| style="background-color: lightgrey;" |
| [[User:sample_user]]
| [[User:sample_user]]
| link to smolt profile
| link to smolt profile
Line 123: Line 123:
| style="background-color: lightgreen;" | pass
| style="background-color: lightgreen;" | pass
|-
|-
| style="background-color: lightgrey;" |
| <!-- [[User:FasName]] -->
|  
| <!-- [http://www.smolts.org/client/show/pub_uuid HW] -->
|  
| <!-- PASS || FAIL || INPROGRESS -->
|  
| <!-- PASS || FAIL || INPROGRESS -->
|  
| <!-- PASS || FAIL || INPROGRESS -->
|  
| <!-- PASS || FAIL || INPROGRESS -->
|  
|-
|-
! style="color: white; background-color: blue;" |iSCSI
! style="color:white; background-color:#5F94C9;" colspan="6" |iSCSI
! style="background-color: blue;" |
! style="background-color: blue;" |
! style="background-color: blue;" |
! style="background-color: blue;" |
! style="background-color: blue;" |
! style="background-color: blue;" |
|-
|-
| style="background-color: lightgrey;" |
| style="background-color: lightyellow;font-weight: bold;" | User
| style="background-color: lightyellow;font-weight: bold;" | User
| style="background-color: lightyellow;font-weight: bold;" | Smolt Profile
| style="background-color: lightyellow;font-weight: bold;" | Smolt Profile
Line 147: Line 139:
| style="background-color: lightyellow;font-weight: bold;" | EncryptFS
| style="background-color: lightyellow;font-weight: bold;" | EncryptFS
|-
|-
| style="background-color: lightgrey;" |
| [[User:sample_user]]
| [[User:sample_user]]
| link to smolt profile
| link to smolt profile
Line 155: Line 146:
| style="background-color: lightgreen;" | pass
| style="background-color: lightgreen;" | pass
|-
|-
| style="background-color: lightgrey;" |
| [[User:sample_user]]
| [[User:sample_user]]
| link to smolt profile
| link to smolt profile
Line 163: Line 153:
| style="background-color: lightgreen;" | pass
| style="background-color: lightgreen;" | pass
|-
|-
| style="background-color: lightgrey;" |
| <!-- [[User:FasName]] -->
|  
| <!-- [http://www.smolts.org/client/show/pub_uuid HW] -->
|  
| <!-- PASS || FAIL || INPROGRESS -->
|  
| <!-- PASS || FAIL || INPROGRESS -->
|  
| <!-- PASS || FAIL || INPROGRESS -->
|  
| <!-- PASS || FAIL || INPROGRESS -->
|  
|-
|-
|}
|}


== Exploratory Testing ==
== Exploratory Testing ==


{|
{|  
! style="color: white; background-color: blue;" | User
! style="color:white; background-color:#5F94C9;" | User
! style="color: white; background-color: blue;" | SMOLT profile  
! style="color:white; background-color:#5F94C9;" | SMOLT profile  
! style="color: white; background-color: blue;" | Test Area (Native, RAID, iSCSI)   
! style="color:white; background-color:#5F94C9;" | Test Area (Native, RAID, iSCSI)   
! style="color: white; background-color: blue;" | Function  
! style="color:white; background-color:#5F94C9;" | Function  
! style="color: white; background-color: blue;" | How to Test
! style="color:white; background-color:#5F94C9;" | How to Test
! style="color: white; background-color: blue;" | Expected Results  
! style="color:white; background-color:#5F94C9;" | Expected Results  
! style="color: white; background-color: blue;" | Results
! style="color:white; background-color:#5F94C9;" | Results
|-
|-
| [[User:sample_user]]
| [[User:sample_user]]
Line 190: Line 178:
| Ext4 on EncryptFS
| Ext4 on EncryptFS
| install using Ext4 format on Encrypted /home partition
| install using Ext4 format on Encrypted /home partition
| installation complete and all expected password prompts function as expected
| installation complete and all password prompts function as expected
| style="background-color: lightgreen;" | PASS
| style="background-color: lightgreen;" | PASS
|-
|-
Line 198: Line 186:
| Ext4 on EncryptFS
| Ext4 on EncryptFS
| install using Ext4 format on Encrypted /home partition
| install using Ext4 format on Encrypted /home partition
| installation complete and all expected password prompts function as expected
| installation complete and all password prompts function as expected
| style="background-color: red;" | FAIL
| style="background-color: red;" | FAIL
|-
|-
|
| <!-- [[User:FasName]] -->
|
| <!-- [http://www.smolts.org/client/show/pub_uuid HW] -->
|  
| <!-- (Native, RAID, iSCSI) -->
|
| <!-- Function -->
|
| <!-- How to Test -->
|
| <!-- Expected Results -->
|
| <!-- PASS || FAIL || INPROGRESS -->
|-
|-
|}
|}
[[Category:Fedora 11 Test Days]]

Latest revision as of 19:46, 26 June 2015

What to test?[edit]

Today's instalment of Fedora Test Day will focus on:

Who's available[edit]

The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...

Prerequisite for Test Day[edit]

  • Rawhide fully updated (some tips below) with anaconda-11.5.0.24-3. Remember, Rawhide is an unsupported development branch: use an installation you don't mind getting broken.
  • FAS Account - you can create an account in 3 minutes if you don't have one
  • Selinux enabled. If you need to run in permissive mode please file a bug against selinux
  • (optional) - A link to your smolt profile page on Smolt

How to test[edit]

This testing effort will focus on improvements in the way in which anaconda interacts with block devices.

During this test we will focus on validation of code updates to anaconda using known good test cases. Any failures seen during this test day are especially important as they may indicate a regression in functionality from previous test results.

Test Areas[edit]

The following areas will be exercised during the execution of the defined test cases:

  • RAID
  • DMRAID
  • LVM
  • Encrypted Block Device

In addition to the baseline test cases in the table below, exploratory testing of anaconda and block devices is especially desirable.

Not Ready for Testing
Before exploring different test areas, please note that some components are known to be unstable for the test day. This list includes:
  • Multipath devices
  • Partition resize

Updates[edit]

All testing will start with rawhide. All changes for the day will be done using anaconda updates.img process. To test the latest storage fixes, you must boot with:

  • For all architectures -
     updates=http://dlehman.fedorapeople.org/storage/testing/updates.img 

Filing Bugs[edit]

Please file bugs against Anaconda. If manually filing a bug, please set the following attributes:

  • component - anaconda
  • version - rawhide
  • whiteboard - StorageRewrite

Or just click here to start a bug report.

Test Areas and Results[edit]

In order to improve on our ability to record test results and encourage exploratory testing with the community, we are trying a different format for this test day. Instead for specific test cases, which hit different scenarios we define, a few high level 'test areas' which exercise the desired functions.

For example, we now have 3 test areas which block device types are defined as ....

  1. - Native (think workstation or integrated hard disks)
  2. - iSCSI
  3. - RAID (both hardware and software)

The reason for these as the major test areas is that other things like autopart, encrypted fs and ext4 could be considered functions which are applied to those test areas and anaconda interacts with them in a direct manner (that is, with fewer layers or abstractions between).

Native
User Smolt Profile AutoPart LVM Ext4 EncryptFS
User:sample_user link to smolt profile pass pass fail pass
User:sample_user link to smolt profile pass fail pass pass
RAID
User Smolt Profile AutoPart LVM Ext4 EncryptFS
User:sample_user link to smolt profile pass pass fail pass
User:sample_user link to smolt profile pass fail pass pass
iSCSI
User Smolt Profile AutoPart LVM Ext4 EncryptFS
User:sample_user link to smolt profile pass pass fail pass
User:sample_user link to smolt profile pass fail pass pass

Exploratory Testing[edit]

User SMOLT profile Test Area (Native, RAID, iSCSI) Function How to Test Expected Results Results
User:sample_user linky Native Ext4 on EncryptFS install using Ext4 format on Encrypted /home partition installation complete and all password prompts function as expected PASS
User:sample_user linky RAID Ext4 on EncryptFS install using Ext4 format on Encrypted /home partition installation complete and all password prompts function as expected FAIL