Finish storage testing frameworks and put to use
Summary
Finalize storage testing frameworks and integrate in to a continual test system as well as QE's larger testing frameworks.
Owner
- Name: Chris Lumens
Current status
- Targeted release: Fedora 15
- Last updated: 2011-01-18
- Percentage of completion: 75%
Detailed Description
I have developed a test framework that can be hooked into autoqa and exercises the storage code external to the installer environment. Tests can be chained together so that the output of one test (a set of disks) is the input of another test. The entire framework runs under virtualization. This set of features means tests can be run completely without user intervention (making it perfect to run weekly, nightly, at build time, or even commit time though that would be very slow), from a known preexisting disk state (making failures reproducible), and without damaging existing hardware.
The real strength of this framework is first that we can automate the entirety of the storage section of the release test matrix, and second that we can develop regression tests from bug reports given enough detail. Making use of this strength requires writing a lot of tests, though.
Benefit to Fedora
Automated storage testing means we can catch storage problems faster, create regression tests, and reduce QA workload by getting them out of the storage testing business. This should directly result in a better installer (due to fewer bugs) and indirectly to better releases (due to QA being able to focus on other things).