m (Clean up exploratory table to provide an easy cut'n'paste for contributors) |
(Drop direct Test Days category membership) |
||
| (13 intermediate revisions by 4 users not shown) | |||
| Line 9: | Line 9: | ||
The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ... | The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ... | ||
* Development - [[User:dlehman|Dave Lehman]], [[User:clumens|Chris Lumens]], [[User:jgranados|Joel Granados]] | * Development - [[User:dlehman|Dave Lehman]], [[User:clumens|Chris Lumens]], [[User:jgranados|Joel Granados]] | ||
* Quality Assurance - [[User:robertmwilliams|Robert Williams]], [[User:jlaska|James Laska]], [[User:Adamwill|Adam Williamson]] | * Quality Assurance - [[User:robertmwilliams|Robert Williams]], [[User:jlaska|James Laska]], [[User:Adamwill|Adam Williamson]], [[User:wwoods|Will Woods]] | ||
== Prerequisite for Test Day == | == Prerequisite for Test Day == | ||
* [[Releases/Rawhide|Rawhide]] fully updated (some tips below). Remember, Rawhide is an unsupported development branch: use an installation you don't mind getting broken. | * [[Releases/Rawhide|Rawhide]] fully updated (some tips below) with anaconda-11.5.0.24-3. Remember, Rawhide is an unsupported development branch: use an installation you don't mind getting broken. | ||
* FAS Account - you can [https://admin.fedoraproject.org/accounts/ create] an account in 3 minutes if you don't have one | * FAS Account - you can [https://admin.fedoraproject.org/accounts/ create] an account in 3 minutes if you don't have one | ||
* Selinux enabled. If you need to run in permissive mode please file a [https://bugzilla.redhat.com bug] against selinux | * Selinux enabled. If you need to run in permissive mode please file a [https://bugzilla.redhat.com bug] against selinux | ||
| Line 36: | Line 36: | ||
In addition to the baseline test cases in the table below, [[QA/Exploratory_Testing|exploratory testing]] of anaconda and block devices is especially desirable. | In addition to the baseline test cases in the table below, [[QA/Exploratory_Testing|exploratory testing]] of anaconda and block devices is especially desirable. | ||
{{admon/caution|Not Ready for Testing|Before exploring different test areas, please note that some components are known to be unstable for the test day. This list includes: | |||
* Multipath devices | |||
* Partition resize | |||
}} | |||
=== Updates === | |||
All testing will start with [[Releases/Rawhide|rawhide]]. All changes for the day will be done using [[Anaconda/Updates|anaconda updates.img process]]. To test the latest storage fixes, you '''must''' boot with: | |||
* For all architectures - <pre> updates=http://dlehman.fedorapeople.org/storage/testing/updates.img </pre> | |||
=== Filing Bugs === | |||
Please file bugs against [[Anaconda]]. If manually filing a bug, please set the following attributes: | |||
* component - anaconda | |||
* version - rawhide | |||
* whiteboard - StorageRewrite | |||
Or just [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&component=anaconda&version=rawhide&short_desc=%5BStorageRewrite%5D&cf_whiteboard=StorageRewrite click here] to start a bug report. | |||
== Test Areas and Results == | == Test Areas and Results == | ||
| Line 179: | Line 198: | ||
|- | |- | ||
|} | |} | ||
[[Category:Fedora 11 Test Days]] | |||
Latest revision as of 19:46, 26 June 2015
What to test?[edit]
Today's instalment of Fedora Test Day will focus on:
Who's available[edit]
The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...
- Development - Dave Lehman, Chris Lumens, Joel Granados
- Quality Assurance - Robert Williams, James Laska, Adam Williamson, Will Woods
Prerequisite for Test Day[edit]
- Rawhide fully updated (some tips below) with anaconda-11.5.0.24-3. Remember, Rawhide is an unsupported development branch: use an installation you don't mind getting broken.
- FAS Account - you can create an account in 3 minutes if you don't have one
- Selinux enabled. If you need to run in permissive mode please file a bug against selinux
- (optional) - A link to your smolt profile page on Smolt
How to test[edit]
This testing effort will focus on improvements in the way in which anaconda interacts with block devices.
During this test we will focus on validation of code updates to anaconda using known good test cases. Any failures seen during this test day are especially important as they may indicate a regression in functionality from previous test results.
Test Areas[edit]
The following areas will be exercised during the execution of the defined test cases:
- RAID
- DMRAID
- LVM
- Encrypted Block Device
In addition to the baseline test cases in the table below, exploratory testing of anaconda and block devices is especially desirable.
.png){kind=small}
Before exploring different test areas, please note that some components are known to be unstable for the test day. This list includes:
- Multipath devices
- Partition resize
Updates[edit]
All testing will start with rawhide. All changes for the day will be done using anaconda updates.img process. To test the latest storage fixes, you must boot with:
- For all architectures -
updates=http://dlehman.fedorapeople.org/storage/testing/updates.img
Filing Bugs[edit]
Please file bugs against Anaconda. If manually filing a bug, please set the following attributes:
- component - anaconda
- version - rawhide
- whiteboard - StorageRewrite
Or just click here to start a bug report.
Test Areas and Results[edit]
In order to improve on our ability to record test results and encourage exploratory testing with the community, we are trying a different format for this test day. Instead for specific test cases, which hit different scenarios we define, a few high level 'test areas' which exercise the desired functions.
For example, we now have 3 test areas which block device types are defined as ....
- - Native (think workstation or integrated hard disks)
- - iSCSI
- - RAID (both hardware and software)
The reason for these as the major test areas is that other things like autopart, encrypted fs and ext4 could be considered functions which are applied to those test areas and anaconda interacts with them in a direct manner (that is, with fewer layers or abstractions between).
| Native | |||||
|---|---|---|---|---|---|
| User | Smolt Profile | AutoPart | LVM | Ext4 | EncryptFS |
| User:sample_user | link to smolt profile | pass | pass | fail | pass |
| User:sample_user | link to smolt profile | pass | fail | pass | pass |
| RAID | |||||
| User | Smolt Profile | AutoPart | LVM | Ext4 | EncryptFS |
| User:sample_user | link to smolt profile | pass | pass | fail | pass |
| User:sample_user | link to smolt profile | pass | fail | pass | pass |
| iSCSI | |||||
| User | Smolt Profile | AutoPart | LVM | Ext4 | EncryptFS |
| User:sample_user | link to smolt profile | pass | pass | fail | pass |
| User:sample_user | link to smolt profile | pass | fail | pass | pass |
Exploratory Testing[edit]
| User | SMOLT profile | Test Area (Native, RAID, iSCSI) | Function | How to Test | Expected Results | Results |
|---|---|---|---|---|---|---|
| User:sample_user | linky | Native | Ext4 on EncryptFS | install using Ext4 format on Encrypted /home partition | installation complete and all password prompts function as expected | PASS |
| User:sample_user | linky | RAID | Ext4 on EncryptFS | install using Ext4 format on Encrypted /home partition | installation complete and all password prompts function as expected | FAIL |