m (Clean up exploratory table to provide an easy cut'n'paste for contributors) |
m (Add updates image instructions) |
||
Line 36: | Line 36: | ||
In addition to the baseline test cases in the table below, [[QA/Exploratory_Testing|exploratory testing]] of anaconda and block devices is especially desirable. | In addition to the baseline test cases in the table below, [[QA/Exploratory_Testing|exploratory testing]] of anaconda and block devices is especially desirable. | ||
=== Updates === | |||
All testing will start with [[Releases/Rawhide|rawhide]]. All changes for the day will be done using anaconda updates.img [[Anaconda/Updates|process]]. To test the latest storage fixes, you '''must''' boot with: | |||
* For i386 - <pre> updates=http://jgranado.fedorapeople.org/storage/testing/updates-i586.img </pre> | |||
* For x86_64 - <pre> updates=http://jgranado.fedorapeople.org/storage/testing/updates-x86_64.img </pre> | |||
== Test Areas and Results == | == Test Areas and Results == |
Revision as of 14:40, 5 March 2009
What to test?
Today's instalment of Fedora Test Day will focus on:
Who's available
The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...
- Development - Dave Lehman, Chris Lumens, Joel Granados
- Quality Assurance - Robert Williams, James Laska, Adam Williamson
Prerequisite for Test Day
- Rawhide fully updated (some tips below). Remember, Rawhide is an unsupported development branch: use an installation you don't mind getting broken.
- FAS Account - you can create an account in 3 minutes if you don't have one
- Selinux enabled. If you need to run in permissive mode please file a bug against selinux
- (optional) - A link to your smolt profile page on Smolt
How to test
This testing effort will focus on improvements in the way in which anaconda interacts with block devices.
During this test we will focus on validation of code updates to anaconda using known good test cases. Any failures seen during this test day are especially important as they may indicate a regression in functionality from previous test results.
Test Areas
The following areas will be exercised during the execution of the defined test cases:
- RAID
- DMRAID
- LVM
- Encrypted Block Device
In addition to the baseline test cases in the table below, exploratory testing of anaconda and block devices is especially desirable.
Updates
All testing will start with rawhide. All changes for the day will be done using anaconda updates.img process. To test the latest storage fixes, you must boot with:
- For i386 -
updates=http://jgranado.fedorapeople.org/storage/testing/updates-i586.img
- For x86_64 -
updates=http://jgranado.fedorapeople.org/storage/testing/updates-x86_64.img
Test Areas and Results
In order to improve on our ability to record test results and encourage exploratory testing with the community, we are trying a different format for this test day. Instead for specific test cases, which hit different scenarios we define, a few high level 'test areas' which exercise the desired functions.
For example, we now have 3 test areas which block device types are defined as ....
- - Native (think workstation or integrated hard disks)
- - iSCSI
- - RAID (both hardware and software)
The reason for these as the major test areas is that other things like autopart, encrypted fs and ext4 could be considered functions which are applied to those test areas and anaconda interacts with them in a direct manner (that is, with fewer layers or abstractions between).
Native | |||||
---|---|---|---|---|---|
User | Smolt Profile | AutoPart | LVM | Ext4 | EncryptFS |
User:sample_user | link to smolt profile | pass | pass | fail | pass |
User:sample_user | link to smolt profile | pass | fail | pass | pass |
RAID | |||||
User | Smolt Profile | AutoPart | LVM | Ext4 | EncryptFS |
User:sample_user | link to smolt profile | pass | pass | fail | pass |
User:sample_user | link to smolt profile | pass | fail | pass | pass |
iSCSI | |||||
User | Smolt Profile | AutoPart | LVM | Ext4 | EncryptFS |
User:sample_user | link to smolt profile | pass | pass | fail | pass |
User:sample_user | link to smolt profile | pass | fail | pass | pass |
Exploratory Testing
User | SMOLT profile | Test Area (Native, RAID, iSCSI) | Function | How to Test | Expected Results | Results |
---|---|---|---|---|---|---|
User:sample_user | linky | Native | Ext4 on EncryptFS | install using Ext4 format on Encrypted /home partition | installation complete and all password prompts function as expected | PASS |
User:sample_user | linky | RAID | Ext4 on EncryptFS | install using Ext4 format on Encrypted /home partition | installation complete and all password prompts function as expected | FAIL |