From Fedora Project Wiki

m (minor wiki-fication)
(Drop direct Test Days category membership)
 
(22 intermediate revisions by 6 users not shown)
Line 1: Line 1:
== Block Device Test Day ==
== What to test? ==
 
Today's instalment of Fedora Test Day will focus on:
 
* [[Features/AnacondaStorageRewrite]]
 
== Who's available ==
 
The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...
* Development - [[User:dlehman|Dave Lehman]], [[User:clumens|Chris Lumens]],  [[User:jgranados|Joel Granados]]
* Quality Assurance - [[User:robertmwilliams|Robert Williams]], [[User:jlaska|James Laska]], [[User:Adamwill|Adam Williamson]], [[User:wwoods|Will Woods]]
 
== Prerequisite for Test Day ==
 
* [[Releases/Rawhide|Rawhide]] fully updated (some tips below) with anaconda-11.5.0.24-3. Remember, Rawhide is an unsupported development branch: use an installation you don't mind getting broken.
* FAS Account - you can [https://admin.fedoraproject.org/accounts/ create] an account in 3 minutes if you don't have one
* Selinux enabled. If you need to run in permissive mode please file a [https://bugzilla.redhat.com bug] against selinux
* ''(optional)'' - A link to your smolt profile page on [http://www.smolts.org Smolt]
 
== How to test ==


This testing effort will focus on improvements in the way in which anaconda interacts with block devices.
This testing effort will focus on improvements in the way in which anaconda interacts with block devices.
During this test we will focus on validation of code updates to anaconda using known good test cases.
During this test we will focus on validation of code updates to anaconda using known good test cases.
Any failures seen during this test day are especially important as they may indicate a regression in functionality from previous test results.
Any failures seen during this test day are especially important as they may indicate a regression in functionality from previous test results.


'''Test Areas'''
=== Test Areas ===


The following areas will be exercised during the execution of the defined test cases:
The following areas will be exercised during the execution of the defined test cases:
Line 14: Line 34:
* Encrypted Block Device
* Encrypted Block Device


In addition to the baseline test cases in the table below, ''exploratory testing'' of anaconda and block devices is especially desirable.
In addition to the baseline test cases in the table below, [[QA/Exploratory_Testing|exploratory testing]] of anaconda and block devices is especially desirable.
 
{{admon/caution|Not Ready for Testing|Before exploring different test areas, please note that some components are known to be unstable for the test day.  This list includes:
* Multipath devices
* Partition resize
}}
 
=== Updates ===
 
All testing will start with [[Releases/Rawhide|rawhide]].  All changes for the day will be done using [[Anaconda/Updates|anaconda updates.img process]].  To test the latest storage fixes, you '''must''' boot with:
 
* For all architectures - <pre> updates=http://dlehman.fedorapeople.org/storage/testing/updates.img </pre>
 
=== Filing Bugs ===
 
Please file bugs against [[Anaconda]].  If manually filing a bug, please set the following attributes:
* component - anaconda
* version - rawhide
* whiteboard - StorageRewrite
 
Or just [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&component=anaconda&version=rawhide&short_desc=%5BStorageRewrite%5D&cf_whiteboard=StorageRewrite click here] to start a bug report.
 
== Test Areas and Results ==
 
In order to improve on our ability to record test results and encourage [https://fedoraproject.org/wiki/QA/Exploratory_Testing exploratory testing] with the community, we are trying a different format for this test day.
Instead for specific test cases, which hit different scenarios we define, a few high level 'test areas' which exercise the desired functions.
 
For example, we now have 3 test areas which block device types are defined as ....
 
# - Native (think workstation or integrated hard disks)
# - iSCSI
# - RAID (both hardware and software)
 
The reason for these as the major test areas is that other things like autopart, encrypted fs and ext4 could be considered functions which are applied to those test areas and anaconda interacts with them in a direct manner (that is, with fewer layers or abstractions between).


== Test Cases and Results ==
{|
{|
! Test Case
! style="color:white; background-color:#5F94C9;" colspan="6" |Native
! User
! Smolt Profile
! Pass/Fail
! Comments
|-
|-
| style="font-weight: bold;" | [https://fedoraproject.org/wiki/QA/TestCases/PartitioningRaid0OnLvmDevice Raid0 on LVM]
| style="background-color: lightyellow;font-weight: bold;" | User
| style="background-color: lightblue;" |
| style="background-color: lightyellow;font-weight: bold;" | Smolt Profile
| style="background-color: lightblue;" |
| style="background-color: lightyellow;font-weight: bold;" | AutoPart
| style="background-color: lightblue;" |
| style="background-color: lightyellow;font-weight: bold;" | LVM
| style="background-color: lightblue;" |
| style="background-color: lightyellow;font-weight: bold;" | Ext4
| style="background-color: lightyellow;font-weight: bold;" | EncryptFS
|-
|-
| style="background-color: lightyellow;" |
| [[User:sample_user]]
| [[User:SampleUser]]
| link to smolt profile
| <!-- Smolt profile -->
| style="background-color: lightgreen;" | pass
| PASS
| style="background-color: lightgreen;" | pass
|  
| style="background-color: red;" | fail
| style="background-color: lightgreen;" | pass
|-
|-
| style="background-color: lightyellow;" |
| [[User:sample_user]]
| [[User:SampleUser]]
| link to smolt profile
| <!-- Smolt profile -->
| style="background-color: lightgreen;" | pass
| PASS
| style="background-color: red;" | fail
|  
| style="background-color: lightgreen;" | pass
| style="background-color: lightgreen;" | pass
|-
|-
| style="font-weight: bold;" | [https://fedoraproject.org/wiki/QA/TestCases/PartitioningUsrOnRaid5 \usr on RAID5]
| <!-- [[User:FasName]] -->
| style="background-color: lightblue;" |
| <!-- [http://www.smolts.org/client/show/pub_uuid HW] -->
| style="background-color: lightblue;" |
| <!-- PASS || FAIL || INPROGRESS -->
| style="background-color: lightblue;" |
| <!-- PASS || FAIL || INPROGRESS -->
| style="background-color: lightblue;" |
| <!-- PASS || FAIL || INPROGRESS -->
| <!-- PASS || FAIL || INPROGRESS -->
|-
|-
| style="background-color: lightyellow;" |
! style="color:white; background-color:#5F94C9;" colspan="6" |RAID
| [[User:SampleUser]]
| <!-- Smolt profile -->
| PASS
|
|-
|-
| style="background-color: lightyellow;" |
| style="background-color: lightyellow;font-weight: bold;" | User
| [[User:SampleUser]]
| style="background-color: lightyellow;font-weight: bold;" | Smolt Profile
| <!-- Smolt profile -->
| style="background-color: lightyellow;font-weight: bold;" | AutoPart
| PASS
| style="background-color: lightyellow;font-weight: bold;" | LVM
|  
| style="background-color: lightyellow;font-weight: bold;" | Ext4
| style="background-color: lightyellow;font-weight: bold;" | EncryptFS
|-
|-
| style="font-weight: bold;" | [https://fedoraproject.org/wiki/QA/TestCases/PartitioningRootfsOnDmraidDevice \ on DM-RAID]
| [[User:sample_user]]
| style="background-color: lightblue;" |
| link to smolt profile
| style="background-color: lightblue;" |
| style="background-color: lightgreen;" | pass
| style="background-color: lightblue;" |
| style="background-color: lightgreen;" | pass
| style="background-color: lightblue;" |
| style="background-color: red;" | fail
| style="background-color: lightgreen;" | pass
|-
|-
| style="background-color: lightyellow;" |
| [[User:sample_user]]
| [[User:SampleUser]]
| link to smolt profile
| <!-- Smolt profile -->
| style="background-color: lightgreen;" | pass
| PASS
| style="background-color: red;" | fail
|  
| style="background-color: lightgreen;" | pass
| style="background-color: lightgreen;" | pass
|-
|-
| style="background-color: lightyellow;" |
| <!-- [[User:FasName]] -->
| [[User:SampleUser]]  
| <!-- [http://www.smolts.org/client/show/pub_uuid HW] -->
| <!-- Smolt profile -->  
| <!-- PASS || FAIL || INPROGRESS -->
| PASS
| <!-- PASS || FAIL || INPROGRESS -->
|  
| <!-- PASS || FAIL || INPROGRESS -->
| <!-- PASS || FAIL || INPROGRESS -->
|-
|-
| style="font-weight: bold;" | [https://fedoraproject.org/wiki/QA:TestCases/ext4_fs_on_LVM_LV ext4 on LVM]
! style="color:white; background-color:#5F94C9;" colspan="6" |iSCSI
| style="background-color: lightblue;" |
| style="background-color: lightblue;" |
| style="background-color: lightblue;" |
| style="background-color: lightblue;" |
|-
|-
| style="background-color: lightyellow;" |
| style="background-color: lightyellow;font-weight: bold;" | User
| [[User:SampleUser]]
| style="background-color: lightyellow;font-weight: bold;" | Smolt Profile
| <!-- Smolt profile -->
| style="background-color: lightyellow;font-weight: bold;" | AutoPart
| PASS
| style="background-color: lightyellow;font-weight: bold;" | LVM
|  
| style="background-color: lightyellow;font-weight: bold;" | Ext4
| style="background-color: lightyellow;font-weight: bold;" | EncryptFS
|-
|-
| style="background-color: lightyellow;" |
| [[User:sample_user]]
| [[User:SampleUser]]
| link to smolt profile
| <!-- Smolt profile -->
| style="background-color: lightgreen;" | pass
| PASS
| style="background-color: lightgreen;" | pass
|  
| style="background-color: red;" | fail
| style="background-color: lightgreen;" | pass
|-
|-
| style="font-weight: bold;" | [https://fedoraproject.org/wiki/QA/TestCases/PartitioningSwapOnLvmDevice swap on LVM]
| [[User:sample_user]]
| style="background-color: lightblue;" |
| link to smolt profile
| style="background-color: lightblue;" |
| style="background-color: lightgreen;" | pass
| style="background-color: lightblue;" |
| style="background-color: red;" | fail
| style="background-color: lightblue;" |
| style="background-color: lightgreen;" | pass
| style="background-color: lightgreen;" | pass
|-
|-
| style="background-color: lightyellow;" |
| <!-- [[User:FasName]] -->
| [[User:SampleUser]]  
| <!-- [http://www.smolts.org/client/show/pub_uuid HW] -->
| <!-- Smolt profile -->  
| <!-- PASS || FAIL || INPROGRESS -->
| PASS
| <!-- PASS || FAIL || INPROGRESS -->
|  
| <!-- PASS || FAIL || INPROGRESS -->
| <!-- PASS || FAIL || INPROGRESS -->
|-
|-
| style="background-color: lightyellow;" |
|}
| [[User:SampleUser]]
 
| <!-- Smolt profile -->
== Exploratory Testing ==
| PASS
|
|-
| style="font-weight: bold;" | [https://fedoraproject.org/wiki/QA:EXT_4_fs_encrypted ext4 on Encrypted LVM]
| style="background-color: lightblue;" |
| style="background-color: lightblue;" |
| style="background-color: lightblue;" |
| style="background-color: lightblue;" |
|-
| style="background-color: lightyellow;" |
| [[User:SampleUser]]
| <!-- Smolt profile -->
| PASS
|
|-
| style="background-color: lightyellow;" |
| [[User:SampleUser]]
| <!-- Smolt profile -->
| PASS
|
|-
| style="font-weight: bold;" | [https://fedoraproject.org/wiki/QA/TestCases/LUKS_Encrypted_LVM_VG%2C_all_LVs_encrypted Encrypted LVs (all LVs encrypted)]


| style="background-color: lightblue;" |
{|  
| style="background-color: lightblue;" |
! style="color:white; background-color:#5F94C9;" | User
| style="background-color: lightblue;" |
! style="color:white; background-color:#5F94C9;" | SMOLT profile
| style="background-color: lightblue;" |
! style="color:white; background-color:#5F94C9;" | Test Area (Native, RAID, iSCSI) 
|-
! style="color:white; background-color:#5F94C9;" | Function
| style="background-color: lightyellow;" |
! style="color:white; background-color:#5F94C9;" | How to Test
| [[User:SampleUser]]
! style="color:white; background-color:#5F94C9;" | Expected Results
| <!-- Smolt profile -->
! style="color:white; background-color:#5F94C9;" | Results
| PASS
|
|-
| style="background-color: lightyellow;" |
| [[User:SampleUser]]
| <!-- Smolt profile -->
| PASS
|
|-
| style="font-weight: bold;" | [https://fedoraproject.org/wiki/QA/TestCases/LUKS_Encrypted_RAID_partitions%2C_all_mds_encrypted Encrypted RAID (all mds encrypted)]
| style="background-color: lightblue;" |
| style="background-color: lightblue;" |
| style="background-color: lightblue;" |
| style="background-color: lightblue;" |
|-
| style="background-color: lightyellow;" |
| [[User:SampleUser]]
| <!-- Smolt profile -->
| PASS
|
|-
| style="background-color: lightyellow;" |
| [[User:SampleUser]]
| <!-- Smolt profile -->
| PASS
|
|-
|-
| style="font-weight: bold;" | ''my exploratory test''
| [[User:sample_user]]
| style="background-color: lightblue;" |
| linky
| style="background-color: lightblue;" |
| Native
| style="background-color: lightblue;" |
| Ext4 on EncryptFS
| style="background-color: lightblue;" |
| install using Ext4 format on Encrypted /home partition
| installation complete and all password prompts function as expected
| style="background-color: lightgreen;" | PASS
|-
|-
| style="background-color: lightyellow;" |
| [[User:sample_user]]
| [[User:SampleUser]]  
| linky
| <!-- Smolt profile -->
| RAID
| PASS
| Ext4 on EncryptFS
|  
| install using Ext4 format on Encrypted /home partition
|-
| installation complete and all password prompts function as expected
| style="font-weight: bold;" | ''my exploratory test''
| style="background-color: red;" | FAIL
| style="background-color: lightblue;" |
| style="background-color: lightblue;" |
| style="background-color: lightblue;" |
| style="background-color: lightblue;" |
|-
|-
| style="background-color: lightyellow;" |
| <!-- [[User:FasName]] -->
| [[User:SampleUser]]  
| <!-- [http://www.smolts.org/client/show/pub_uuid HW] -->
| <!-- Smolt profile -->  
| <!-- (Native, RAID, iSCSI) -->
| PASS
| <!-- Function -->
|  
| <!-- How to Test -->
| <!-- Expected Results -->
| <!-- PASS || FAIL || INPROGRESS -->
|-
|-
|}
|}
[[Category:Fedora 11 Test Days]]

Latest revision as of 19:46, 26 June 2015

What to test?[edit]

Today's instalment of Fedora Test Day will focus on:

Who's available[edit]

The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...

Prerequisite for Test Day[edit]

  • Rawhide fully updated (some tips below) with anaconda-11.5.0.24-3. Remember, Rawhide is an unsupported development branch: use an installation you don't mind getting broken.
  • FAS Account - you can create an account in 3 minutes if you don't have one
  • Selinux enabled. If you need to run in permissive mode please file a bug against selinux
  • (optional) - A link to your smolt profile page on Smolt

How to test[edit]

This testing effort will focus on improvements in the way in which anaconda interacts with block devices.

During this test we will focus on validation of code updates to anaconda using known good test cases. Any failures seen during this test day are especially important as they may indicate a regression in functionality from previous test results.

Test Areas[edit]

The following areas will be exercised during the execution of the defined test cases:

  • RAID
  • DMRAID
  • LVM
  • Encrypted Block Device

In addition to the baseline test cases in the table below, exploratory testing of anaconda and block devices is especially desirable.

Not Ready for Testing
Before exploring different test areas, please note that some components are known to be unstable for the test day. This list includes:
  • Multipath devices
  • Partition resize

Updates[edit]

All testing will start with rawhide. All changes for the day will be done using anaconda updates.img process. To test the latest storage fixes, you must boot with:

  • For all architectures - 
     updates=http://dlehman.fedorapeople.org/storage/testing/updates.img

Filing Bugs[edit]

Please file bugs against Anaconda. If manually filing a bug, please set the following attributes:

  • component - anaconda
  • version - rawhide
  • whiteboard - StorageRewrite

Or just click here to start a bug report.

Test Areas and Results[edit]

In order to improve on our ability to record test results and encourage exploratory testing with the community, we are trying a different format for this test day. Instead for specific test cases, which hit different scenarios we define, a few high level 'test areas' which exercise the desired functions.

For example, we now have 3 test areas which block device types are defined as ....

  1. - Native (think workstation or integrated hard disks)
  2. - iSCSI
  3. - RAID (both hardware and software)

The reason for these as the major test areas is that other things like autopart, encrypted fs and ext4 could be considered functions which are applied to those test areas and anaconda interacts with them in a direct manner (that is, with fewer layers or abstractions between).

Native
User Smolt Profile AutoPart LVM Ext4 EncryptFS
User:sample_user link to smolt profile pass pass fail pass
User:sample_user link to smolt profile pass fail pass pass
RAID
User Smolt Profile AutoPart LVM Ext4 EncryptFS
User:sample_user link to smolt profile pass pass fail pass
User:sample_user link to smolt profile pass fail pass pass
iSCSI
User Smolt Profile AutoPart LVM Ext4 EncryptFS
User:sample_user link to smolt profile pass pass fail pass
User:sample_user link to smolt profile pass fail pass pass

Exploratory Testing[edit]

User SMOLT profile Test Area (Native, RAID, iSCSI) Function How to Test Expected Results Results
User:sample_user linky Native Ext4 on EncryptFS install using Ext4 format on Encrypted /home partition installation complete and all password prompts function as expected PASS
User:sample_user linky RAID Ext4 on EncryptFS install using Ext4 format on Encrypted /home partition installation complete and all password prompts function as expected FAIL
Retrieved from "https://fedoraproject.org/w/index.php?title=Test_Day:2009-03-05_AnacondaStorageRewrite&oldid=416703"