From Fedora Project Wiki

(add more tables to group tests a bit better, add client hbac test)
(drop a stray space from a link...)
 
(22 intermediate revisions by 3 users not shown)
Line 1: Line 1:
{{tempdoc}}<onlyinclude>
{{tempdoc}}<onlyinclude>
==== General tests ====
==== General tests ====
{| class="wikitable sortable collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
|-
|-
! Milestone !! Test Case !! x86 !! ARM
! Milestone !! Test Case !! x86_64 !! aarch64
|-
|-
| Alpha
| Basic
| [[QA:Testcase_kickstart_firewall]]
| [[QA:Testcase_kickstart_firewall_disabled]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Basic
| [[ QA:Testcase_Server_firewall_default]]
| [[QA:Testcase_kickstart_firewall_configured]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Basic
| [[QA:Testcase_Server_firewall_default]]
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[QA:Testcase_Server_cockpit_default]]
| [[QA:Testcase_Server_cockpit_default]]
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[QA:Testcase_Remote_Logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 22: Line 32:
| Beta
| Beta
| [[QA:Testcase_Server_cockpit_basic]]
| [[QA:Testcase_Server_cockpit_basic]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Server_filesystem_default]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 28: Line 43:
<references/>
<references/>


==== Domain joining tests ====
==== FreeIPA server installation and functionality tests ====
{| class="wikitable sortable collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
|-
|-
! Milestone !! Test Case !! x86 !! ARM
! Milestone !! Test Case !! x86_64 !! aarch64
|-
|-
| Alpha
| Basic
| [[QA:Testcase_realmd_join_kickstart]]
| [[QA:Testcase_freeipa_trust_server_installation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Basic
| [[QA:Testcase_realmd_join_server]]
| [[QA:Testcase_freeipa_trust_server_uninstallation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Alpha
| Beta
| [[QA:Testcase_FreeIPA_realmd_join]]
| [[QA:Testcase_FreeIPA_web_ui]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_FreeIPA_password_change]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_freeipa_replication]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_freeipa_replication_advanced]]
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
==== Domain joining tests: '''FreeIPA''' ====
{| class="wikitable sortable mw-collapsible" width=100%
|-
! Milestone !! Test Case !! Result
|-
| Basic
| [[QA:Testcase_realmd_join_kickstart]]
| {{result|none}}
|-
| Basic
| [[QA:Testcase_realmd_join_sssd]]
| {{result|none}}
| {{result|none}}
|-
|-
Line 51: Line 97:
| [[QA:Testcase_realmd_join_cockpit]]
| [[QA:Testcase_realmd_join_cockpit]]
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
==== Domain joining tests: '''Active Directory''' ====
{| class="wikitable sortable mw-collapsible" width=100%
|-
! Milestone !! Test Case !! Result
|-
| Basic
| [[QA:Testcase_realmd_join_kickstart]]
| {{result|none}}
|-
| Basic
| [[QA:Testcase_realmd_join_sssd]]
| {{result|none}}
|-
| Beta
| [[QA:Testcase_realmd_join_cockpit]]
| {{result|none}}
| {{result|none}}
|-
|-
Line 57: Line 122:


==== Domain client tests ====
==== Domain client tests ====
{| class="wikitable sortable collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
|-
|-
! Milestone !! Test Case !! x86 !! ARM
! Milestone !! Test Case !! Result
|-
|-
| Beta
| Beta
| [[QA:Testcase_domain_client_authenticate]]
| [[QA:Testcase_domain_client_authenticate]] (FreeIPA)
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Final
| Final
| [[QA:Testcase FreeIPA_realmd_login]]
| [[QA:Testcase_FreeIPA_realmd_login]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_domain_client_authenticate]] (Active Directory)
| {{result|none}}
| {{result|none}}
|}
|}
<references/>
<references/>


==== Release-blocking roles ====
==== PostgreSQL server installation and functionality tests ====
{{admon/note|Single test table|In all of these tests, the test case used is [[QA:Testcase Server role deploy]]. That is where the links point. The test must be run for each release-blocking role.}}
{| class="wikitable sortable mw-collapsible" width=100%
{| class="wikitable sortable collapsible" width=100%
|-
|-
! Milestone !! Test Case !! x86 !! ARM
! Milestone !! Test Case !! x86_64 !! aarch64
|-
| Basic
| [[QA:Testcase_postgresql_server_installation]]
| {{result|none}}
| {{result|none}}
|-
|-
| Beta
| Beta
| [[QA:Testcase_Server_role_deploy|Domain controller]]
| [[QA:Testcase_database_server_remote_client]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 87: Line 158:
<references/>
<references/>


==== Non-release-blocking roles ====
==== Upgrade tests ====
{{admon/note|Single test table|In all of these tests, the test case used is [[QA:Testcase Server role deploy]]. That is where the links point. The test may be run for each non-release-blocking role.}}
{| class="wikitable sortable mw-collapsible" width=100%
{| class="wikitable sortable collapsible" width=100%
|-
|-
! Milestone !! Test Case !! x86 !! ARM
! Milestone !! Test Case !! x86_64 !! aarch64
|-
|-
| Optional
| Beta
| [[QA:Testcase_Server_role_deploy|Database server]]
| [[QA:Testcase_upgrade_dnf_current_server_domain_controller]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_upgrade_dnf_previous_server_domain_controller]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}

Latest revision as of 23:09, 25 March 2020

Template documentation [edit]

This documentation is transcluded from Template:Server test matrix/doc. It will not be transcluded on pages that use this template.
Wikitcms core page
This page is a core component of the Wikitcms system for storing release validation testing results in the Fedora wiki. This system relies on specific expectations regarding page naming, contents, and categorization. Please take special care when editing this page, especially if you change any element of wiki syntax, especially templating elements. If you are at all unsure about the consequences of your planned change, please contact the QA group before applying it.
This template contains the Server 'test matrix' of test cases that are usually executed as part of release validation testing. It is pulled into release validation results pages using several nested templates, and can be used in other pages as appropriate. If all you need to do is add, remove or edit a Server validation test case, though, don't worry about that stuff, and put it in here.

General tests

Milestone Test Case x86_64 aarch64
Basic QA:Testcase_kickstart_firewall_disabled
none
none
Basic QA:Testcase_kickstart_firewall_configured
none
none
Basic QA:Testcase_Server_firewall_default
none
none
Basic QA:Testcase_Server_cockpit_default
none
none
Basic QA:Testcase_Remote_Logging
none
none
Beta QA:Testcase_Server_cockpit_basic
none
none
Beta QA:Testcase_Server_filesystem_default
none
none


FreeIPA server installation and functionality tests

Milestone Test Case x86_64 aarch64
Basic QA:Testcase_freeipa_trust_server_installation
none
none
Basic QA:Testcase_freeipa_trust_server_uninstallation
none
none
Beta QA:Testcase_FreeIPA_web_ui
none
none
Beta QA:Testcase_FreeIPA_password_change
none
none
Optional QA:Testcase_freeipa_replication
none
none
Optional QA:Testcase_freeipa_replication_advanced
none
none


Domain joining tests: FreeIPA

Milestone Test Case Result
Basic QA:Testcase_realmd_join_kickstart
none
Basic QA:Testcase_realmd_join_sssd
none
Beta QA:Testcase_realmd_join_cockpit
none


Domain joining tests: Active Directory

Milestone Test Case Result
Basic QA:Testcase_realmd_join_kickstart
none
Basic QA:Testcase_realmd_join_sssd
none
Beta QA:Testcase_realmd_join_cockpit
none


Domain client tests

Milestone Test Case Result
Beta QA:Testcase_domain_client_authenticate (FreeIPA)
none
Final QA:Testcase_FreeIPA_realmd_login
none
Optional QA:Testcase_domain_client_authenticate (Active Directory)
none


PostgreSQL server installation and functionality tests

Milestone Test Case x86_64 aarch64
Basic QA:Testcase_postgresql_server_installation
none
none
Beta QA:Testcase_database_server_remote_client
none
none


Upgrade tests

Milestone Test Case x86_64 aarch64
Beta QA:Testcase_upgrade_dnf_current_server_domain_controller
none
none
Beta QA:Testcase_upgrade_dnf_previous_server_domain_controller
none
none
Retrieved from "https://fedoraproject.org/w/index.php?title=Template:Server_test_matrix&oldid=569555"