From Fedora Project Wiki
m (Updated to adjust to rhe's latest draft)
(new idea)
Line 1: Line 1:
{{admon/note|DRAFT|This page is currently a draft.  It has not been finalized yet.  Stay tuned ...}}
{{draft}}


This page is intended to record [[QA:Fedora_14_Install_Test_Plan]] test results for the '''FIXME''' milestone.
= Currently available installer tests =
 
# {{filename|checkbot.sh}} - runs multiple tests
= Instructions =
## Build test - runs {{cmmand|./autogen.sh && ./configure.sh && make}}
 
## Pylint test - Runs {{command|tests/pylint/runpylint.sh}}
This page tracks test results against the Fedora 14 '''FIXME''' build.  Test results against other Fedora 14 milestones can be found at [[:Category:Fedora_14_Test_Results]].
# {{filename|tests/anaconda_storage}} - Storage unit testsuite in the <code>clumens</code> branch of [http://git.fedorahosted.org/git/?p=autoqa.git;a=tree;f=tests/anaconda_storage;h=0d06525d8bf0be410b5c67e15cf815a53e8b7f9f;hb=refs/heads/clumens autoqa.git]
 
# {{filename|scripts/buildinstall}} - Used by {{command|pungi}} when creating installable media (see [[How_to_build_a_Rawhide_ISO_image_for_testing|instructions]])
== What To Test ==
# {{filename|tests/rats_install/install.py}} - AutoQA test script that does a basic automated kickstart install
 
* Tests requiring ''physical media'' (e.g. DVD or CD images) -- [http://serverbeach1.fedoraproject.org/pub/alt/stage  download the required ISO images].
* Unless otherwise noted, you may use nightly Fedora 14 ''branch'' install images.  [[Releases/Branched|Review for information on downloading and installing Branched]].
* For testers with limited bandwidth, ''deltaiso'' images are available.  For more information on creating or using delta ISOs, please refer to [[Delta_ISOs]].
 
{{admon/tip|Save bandwidth|If you already downloaded previous ''physical media'' ISO images, you can save time by [http://thepiratebay.org/user/andre14965/ downloading delta ISO images].}}
 
== Who's available ==
 
The following cast of characters will be available testing, workarounds, bug fixes, general discussion ...
* IRC: [irc://irc.freenode.net/fedora-qa #fedora-qa] on irc.freenode.net
* Quality Assurance - [[User:jlaska]] , [[User:Rhe]], [[User:Liam]], [[User:Robatino]]
 
== Add or Remove a Test Case ==
 
# Please request review for your changes by publishing your test case for review to [https://admin.fedoraproject.org/mailman/listinfo/test test list].
# Once reviewed, make your changes to this document
# Finally, update [[QA:Fedora_14_Install_Results_Template]] with the same changes.
 
== Post Test Results  ==
 
Want to share information about something you tested?  Please click ''edit'' to add test results.  All test results are posted using the format specified [[Template:Result]].
 
== Key ==
 
See the table below for a sample format for test results.
 
{| class="wikitable collapsible" border="0" width="85%"
! colspan="3" style="background-color: grey;" | Test Results Format
|-
|-
! Test Result !! Explanation !! Code Entered
|-
| {{result|none}}
| ''Untested'' - This test has not been run, and is available for anyone to contribute feedback.
| <code><nowiki>{{result|none}}</nowiki></code>
|-
| {{result|pass|liam}}  
| ''Passed'' - The test has been run and the tester determine the test met the ''expected results''
| <code><nowiki>{{result|pass|liam}}</nowiki></code>
|-
| {{result|inprogress|adamwill}}
| ''Inprogress'' - An inprogress result is often used for tests that take a long time to execute.  Inprogress results should be temporary and change to pass, fail or warn.
| <code><nowiki>{{result|inprogress|adamwill}}</nowiki></code>
|-
| {{result|fail|jlaska|XYZ|ZXY}}  
| ''Failed'' - Indicates a failed test.  A link to a bug must be provided.  See [[Template:Result]] for details on providing bug information. <references/>
| <code><nowiki>{{result|fail|jlaska|XYZ|ZXY}}</nowiki></code>
|-
| {{result|warn|rhe}} <ref>Brief description about the warning status</ref>
| ''Warning'' - This test completed and met the ''expected results'' of the test, but other issues were encountered during testing that warrant attention.<references/>
| <code><nowiki>{{result|warn|rhe}} <ref>Brief description about the warning status</ref></nowiki></code>
|-
| {{result|pass|rhe}} {{result|warn|kparal}}
| ''Multiple results'' - More people can easily provide results to a single test case.
| <code><nowiki>{{result|pass|rhe}} {{result|warn|kparal}}</nowiki></code>
|-
| style="background:lightgrey;"| {{testresult/none}} {{result|none}}
| ''Unsupported'' - An unsupported test or configuration.  No testing is required.
|
|-
|}
 
== Priority ==
 
The explanation of test case priority is available at [[QA:Fedora_14_Install_Test_Plan#Test_Priority]].
 
= '''Test Matrix''' =
Please click ''[show]'' in each table to view the tests of each media installation, and click ''[edit]'' to post your test results using the syntax in [[#Key|Key Section]].  
 
=== Boot Iso ===
 
{| class="wikitable collapsible collapsed"  border="1" width="85%"
|-
! colspan="5" style="background-color: lightgreen;" | Boot.iso/Netinst.iso installation
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="20%"|Release Level !! width="15%"|Test Area !! width="45%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Size]]
| {{result|fail|rhe|12345}}
| {{result|fail|rhe|12345}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Checksums]]
| {{result|fail|rhe}} <ref name="54321">{{bz|54321}} - xxxx </ref>
| {{result|fail|rhe}} <ref name="54321" />
|-
| Alpha
| Boot Methods
| [[QA/TestCases/BootMethodsBootIso]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Install Source
| [[QA/TestCases/InstallSourceBootIso]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Repository
| [[QA:Testcase Additional Http Repository|QA:Testcase Http Repository]]
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
=== DVD ===
 
{| class="wikitable collapsible collapsed"  border="1" width="85%"
|-
! colspan="5" style="background-color: pink;" | DVD.iso installation
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="20%"|Release Level !! width="15%"|Test Area !! width="45%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Size]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Checksums]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_Repoclosure]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_FileConflicts]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Boot Methods
| [[QA/TestCases/BootMethodsDvd]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Install Source
| [[QA/TestCases/InstallSourceDvd]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Repository
| [[QA:Testcase_Additional_CDDVD_Repository|QA:Testcase_DVD_Repository]]
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
=== CD ===
 
{| class="wikitable collapsible collapsed"  border="1" width="85%"
|-
! colspan="5" style="background-color: yellow;" | CD.iso installation
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="20%"|Release Level !! width="15%"|Test Area !! width="45%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Size]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Checksums]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_Repoclosure]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_FileConflicts]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Boot Methods
| [[QA/TestCases/BootMethodsCdrom]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Install Source
| [[QA/TestCases/InstallSourceCdrom]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Repository
| [[QA:Testcase_Additional_CDDVD_Repository|QA:Testcase_CD_Repository]]
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
=== Live Image ===
 
{| class="wikitable collapsible collapsed"  border="1" width="85%"
|-
! colspan="5" style="background-color: orange;" | Live.iso installation
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="20%"|Release Level !! width="15%"|Test Area !! width="45%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Size]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Checksums]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_Repoclosure]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_FileConflicts]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Install Source
| [[QA:TestCases/Install Source Live Image]]
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
=== PXE Images ===
{| class="wikitable collapsible collapsed"  border="1" width="85%"
|-
! colspan="5" style="background-color: lightblue;" | Pxeboot installation
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="20%"|Release Level !! width="15%"|Test Area !! width="45%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Size]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Checksums]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Boot Methods
| [[QA/TestCases/BootMethodsPxeboot]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Install Source
| [[QA/TestCases/InstallSourceHttp]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Repository
| [[QA:Testcase_Additional_Mirrorlist_Repository|QA:Testcase_Mirrorlist_Repository]]
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
=== General Tests ===
{| class="wikitable collapsible collapsed"  border="1" width="85%"
|-
! colspan="5" style="background-color: lightgreen;" | Install Variations & General Tests
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="20%"|Release Level !! width="15%"|Test Area !! width="45%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64
|-
| Beta
| Boot Methods
| [[QA/TestCases/BootMethodsKVM]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Boot Methods
| [[QA/TestCases/BootMethodsXenParaVirt]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Boot Methods
| [[QA:Testcase_Boot_Methods_efidisk.img]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Memory Test
| [[memtest86+]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Graphical]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Text]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_VNC]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Cmdline]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_serial_console]]
| {{result|none}}
| {{result|none}}
|-
| Final
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Telnet]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Install Source
| [[QA/TestCases/InstallSourceNfs]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Install Source
| [[QA/TestCases/InstallSourceNfsIso]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Install Source
| [[QA/TestCases/InstallSourceFtpAnonymous]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Install Source
| [[QA/TestCases/InstallSourceFtpNonAnonymous]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Install Source
| [[QA/TestCases/InstallSourceHardDrive]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Partitioning
| [[QA/TestCases/PartitioningUninitializedDisks]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Partitioning
| [[QA:Testcase_Anaconda_autopart_install]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Partitioning
| [[QA:Testcase_Anaconda_autopart_(encrypted)_install]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Partitioning
| [[QA:Testcase_Anaconda_autopart_(shrink)_install]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Partitioning
| [[QA:Testcase_Anaconda_autopart_(use_free_space)_install]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Partitioning
| [[QA/TestCases/PartitioningExt4OnNativeDevice]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Partitioning
| [[QA/TestCases/PartitioningExt3OnNativeDevice]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Partitioning
| [[QA/TestCases/PartitioningExt2OnNativeDevice]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Partitioning
| [[QA/TestCases/PartitioningNoSwap]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Partitioning
| [[QA:Testcase_Partitioning_On_Software_RAID]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Repository
| [[QA:Testcase Additional Ftp Repository]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Repository
| [[QA:Testcase Additional Mirrorlist Repository]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Repository
| [[QA:Testcase Additional NFS Repository]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Package Set
| [[QA/TestCases/PackageSetsDefaultPackageInstall]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Package Set
| [[QA/TestCases/PackageSetsMinimalPackageInstall]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Kickstart Delivery
| [[QA/TestCases/KickstartKsHttpServerKsCfg]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Kickstart Delivery
| [[QA/TestCases/KickstartKsFilePathKsCfg]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Kickstart Delivery
| [[QA/TestCases/KickstartKsHdDevicePathKsCfg]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Kickstart Delivery
| [[QA/TestCases/KickstartKsNfsServerPathKsCfg]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Recovery
| [[QA:Testcase_Anaconda_rescue_mode]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Recovery
| [[QA:Testcase_Anaconda_updates.img_via_URL]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Recovery
| [[QA:Testcase_Anaconda_updates.img_via_installation_source]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Recovery
| [[QA:Testcase_Anaconda_updates.img_via_local_media]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Recovery
| [[QA:Testcase Anaconda save traceback to remote system]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Recovery
| [[QA:Testcase Anaconda save traceback to bugzilla]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Recovery
| [[QA:Testcase Anaconda save traceback to disk]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Recovery
| [[QA:Testcase Anaconda traceback debug mode]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Storage Devices
| [[QA:Testcase_install_to_SATA_device]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Storage Devices
| [[QA:Testcase_install_to_SCSI_device]]
| {{result|none}}
| {{result|none}}
|-
| Alpha
| Storage Devices
| [[QA:Testcase_install_to_PATA_device]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Storage Devices
| [[QA:Testcase_Install_to_BIOS_RAID]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Storage Devices
| [[QA:Testcase_Install_to_Hardware_RAID]]
| {{result|none}}
| {{result|none}}
|-
| Final
| Storage Devices
| [[QA:Testcase_Anaconda_ISCSI_No_Authentication]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Upgrade system
| [[QA:Testcase_Anaconda_Upgrade_New_Bootloader]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Upgrade system
| [[QA:Testcase_Anaconda_Upgrade_Skip_Bootloader]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Upgrade system
| [[QA:Testcase_Anaconda_Upgrade_Update_Bootloader]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Upgrade system
| [[QA:Testcase_Anaconda_Upgrade_Encrypted_Root]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Upgrade system
| [[QA:Testcase_Preupgrade]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| Upgrade system
| [[QA:Testcase_Preupgrade_low_/boot_disk_space_to_install]]
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
== References ==
 
<references/>

Revision as of 20:13, 12 November 2010

This page is a draft only
It is still under construction and content may change. Do not rely on the information on this page.

Currently available installer tests

  1. checkbot.sh - runs multiple tests
    1. Build test - runs Template:Cmmand
    2. Pylint test - Runs tests/pylint/runpylint.sh
  2. tests/anaconda_storage - Storage unit testsuite in the clumens branch of autoqa.git
  3. scripts/buildinstall - Used by pungi when creating installable media (see instructions)
  4. tests/rats_install/install.py - AutoQA test script that does a basic automated kickstart install
Retrieved from "https://fedoraproject.org/w/index.php?title=User:Jlaska/Draft&oldid=206969"