|
|
| Line 1: |
Line 1: |
| {{draft}} | | {{draft}} |
|
| |
|
| This page is intended to outline the current state of automated installer tests, identify possible short-term objects and identify task owners.
| | === DVD === |
|
| |
|
| == Existing Installer Tests == | | {| class="wikitable collapsible" border="1" width="85%" |
| This section lists tests or scripts that are used now during manual verification of the installer.
| | |- |
| | | ! colspan="5" style="background-color: pink;" | DVD.iso installation |
| # {{filename|checkbot.sh}} - runs multiple tests
| | |- |
| ## Build test - runs {{command|./autogen.sh && ./configure.sh && make}}
| | | |
| ## Pylint test - Runs {{command|tests/pylint/runpylint.sh}}
| | {| class="wikitable sortable" width=100% style="border: solid 2px white" |
| # {{filename|tests/anaconda_storage}} - Storage unit testsuite in the <code>clumens</code> branch of [http://git.fedorahosted.org/git/?p=autoqa.git;a=tree;f=tests/anaconda_storage;h=0d06525d8bf0be410b5c67e15cf815a53e8b7f9f;hb=refs/heads/clumens autoqa.git]
| | |- |
| # {{filename|compose-tree}} script - Script that creates a mock chroot and creates install images using {{command|pungi}} (see also [[How_to_build_a_Rawhide_ISO_image_for_testing|instructions]])
| | ! width="20%"|Release Level !! width="15%"|Test Area !! width="45%"|Test Case !! width="10%"|i386 !! width="10%"|x86_64 |
| # {{filename|tests/rats_install/install.py}} - AutoQA test script that does a basic automated kickstart install
| | |- |
| | | | Alpha |
| == Project Ideas ==
| | | Image Sanity |
| | | | [[QA:Testcase_Mediakit_ISO_Size]] |
| === Update AutoQA storage unit testsuite ===
| | | {{result|pass|robatino}} {{result|pass|kparal}} |
| | | | {{result|pass|robatino}} {{result|pass|kparal}} |
| ; Scope
| | |- |
| : The patchset in the ''clumens'' autoqa branch may need to be refreshed to ''master'' and re-run to check for proper operation. This idea involves rebasing the patch to ''master'', and re-running the tests to ensure they continue to work.
| | | Alpha |
| ; Skill Level
| | | Image Sanity |
| : <span style="color:red;font-weight:bold;">Advanced</span>
| | | [[QA:Testcase_Mediakit_ISO_Checksums]] |
| ; Owner
| | | {{result|pass}} |
| : ''unassigned'' | | | {{result|pass}} |
| | | |- |
| === Create a bugzilla query (or script) to identify storage unit testsuite candidates ===
| | | Alpha |
| | | | Image Sanity |
| ; Scope
| | | [[QA:Testcase_Mediakit_Repoclosure]] |
| : Work with anaconda-devel to identify a pattern to identify bug reports that may have traceback information that can be used to craft new storage unit tests. This task does not involve creating the tests, only identifying a bugzilla query or script that can query bugzilla for test candidates.
| | | {{result|pass|robatino}} {{result|pass|kparal}} |
| ; Skill Level
| | | {{result|pass}} {{result|pass}} |
| : <span style="color:green;font-weight:bold;">Beginner</span>
| | |- |
| ; Owner
| | | Alpha |
| : ''unassigned''
| | | Image Sanity |
| | | | [[QA:Testcase_Mediakit_FileConflicts]] |
| | | | {{result|pass}} {{result|warn}} |
| === Create AutoQA test based on {{filename|checkbot.sh}} script ===
| | | {{result|pass}} {{result|pass}} |
| | | |- |
| ; Scope
| | | Alpha |
| : Currently, anaconda-devel uses a script called {{filename|checkbot.sh}} to run {{command|pylint}} and {{command|make}} against anaconda source. This script would be pulled into [[AutoQA]] as a new test. Eventually, the test would be run after git commits, but in the short-term, could run on a nightly basis.
| | | Boot Methods |
| ; Skill Level
| | | [[QA/TestCases/BootMethodsDvd]] |
| : <span style="color:orange;font-weight:bold;">Moderate</span>
| | | {{result|pass|robatino}} {{result|pass|kparal}} |
| ; Owner
| | | {{result|pass|robatino}} {{result|pass|kparal}} |
| : ''unassigned''
| | |- |
| | | | Alpha |
| === Create AutoQA post-git-commit watcher ===
| | | Install Source |
| | | | [[QA/TestCases/InstallSourceDvd]] |
| ; Scope
| | | {{result|pass}} {{result|pass}} |
| : To support triggering tests based on git commits, create a new AutoQA watcher.
| | | {{result|pass}} {{result|pass}} |
| ; Skill Level
| | |- |
| : <span style="color:orange;font-weight:bold;">Moderate</span>
| | | Alpha |
| ; Owner
| | | Repository |
| : ''unassigned''
| | | [[QA:Testcase Additional Http Repository]] |
| | | | {{result|pass|jlaska}} |
| === Automate Installation test matrix ===
| | | {{result|pass|mkrizek}} |
| | | |- |
| ; Scope
| | | Alpha |
| : Automate installation test matrix (see [[Is_anaconda_broken_proposal]]). This is '''definitely''' not a short-term deliverable, and is dependent on several tasks already on this page. Open to additional suggestions/ideas on short-term tasks that are in line with this larger goal.
| | | Repository |
| ; Skill Level
| | | [[QA:Testcase Additional Ftp Repository]] |
| : <span style="color:red;font-weight:bold;">Advanced</span>
| | | {{result|fail}} |
| ; Owner
| | | {{result|warn}} |
| : ''unassigned''
| | |- |
| | | | Alpha |
| === Create AutoQA test based on {{filename|compose-tree}} script ===
| | | Repository |
| | | | [[QA:Testcase Additional Mirrorlist Repository]] |
| ; Scope
| | | {{result|pass|jlaska}} |
| : Create a new [[AutoQA]] test using the {{filename|compose-tree}} script that runs pungi inside a mock chroot. This test is intended to run after a koji build of {{package|anaconda}} or it's dependent packages.
| | | {{result|pass|mkrizek}} |
| ; Skill Level
| | |- |
| : <span style="color:orange;font-weight:bold;">Moderate</span>
| | | Beta |
| ; Owner
| | | Repository |
| : ''unassigned'' | | | [[QA:Testcase Additional NFS Repository]] |
| | | | {{result|pass|jlaska}} |
| === Verify {{bz|576439}} and integrate VirtIO into rats_install test ===
| | | {{result|pass|rhe}} |
| | | |- |
| ; Scope
| | |} |
| : With {{bz|576439}}, we now can monitor installation progress without requiring an active network to transmit logs using [http://git.fedorahosted.org/git/?p=autoqa.git;a=tree;f=tests/rats_install minimon]. Installing without networking allows test automation that more accurately mimics non-network installations. This task involves testing {{bz|576439}} to confirm that the required support exists as well as updating {{filename|rats_install/install.py}} to use virtio for installation progress monitoring.
| | |} |
| ; Skill Level
| |
| : <span style="color:orange;font-weight:bold;">Moderate</span>
| |
| ; Owner
| |
| : [[User:newgle1|newgle1]]
| |
