From Fedora Project Wiki

(add reboot_unmount to other tables)
(swap KDE and Server column to make it consistent with the rest)
 
(20 intermediate revisions by 5 users not shown)
Line 1: Line 1:
{{tempdoc}}<onlyinclude>
{{tempdoc}}<onlyinclude>
{{admon/note|Cloud|The Cloud edition is not included on this page because all the same tests are present on the Cloud validation page.}}
==== Release-blocking environments (x86_64) ====
==== Release-blocking environments (x86_64) ====
{| class="wikitable sortable mw-collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! Workstation !! Server !! Cloud !! KDE
! Milestone !! Test Case  !! Workstation !! KDE !! Server
|-
|-
| Basic
| Basic/Final
| [[QA:Testcase_base_initial_setup]]
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| {{result|none}}
|-
|-
| Basic
| Basic
Line 15: Line 15:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| {{result|none}}
| {{result|none}}
|-
|-
Line 21: Line 20:
| [[QA:Testcase_base_reboot_unmount]]
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 27: Line 31:
| Basic
| Basic
| [[QA:Testcase_base_system_logging]]
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 34: Line 37:
| Basic
| Basic
| [[QA:Testcase_base_update_cli]]
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 40: Line 42:
|-
|-
| Basic / Beta
| Basic / Beta
| [[QA:Testcase package install remove]]
| [[QA:Testcase_package_install_remove]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 50: Line 51:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_toolbox]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
|-
| Final
| Final
| [[QA:Testcase_base_edition_self_identification]]
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 62: Line 67:
| Final
| Final
| [[QA:Testcase_base_services_start]]
| [[QA:Testcase_base_services_start]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 79: Line 76:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
|}
<references/>
<references/>


==== Release-blocking environments (ARM) ====
==== Release-blocking environments (aarch64) ====
{| class="wikitable sortable mw-collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! Xfce !! Minimal
! Milestone !! Test Case  !! Workstation !! KDE !! Server !! Minimal
|-
|-
| Basic
| Basic/Final
| [[QA:Testcase_base_initial_setup]]
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 95: Line 92:
| Basic
| Basic
| [[QA:Testcase_base_startup]]
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 100: Line 99:
| Basic
| Basic
| [[QA:Testcase_base_reboot_unmount]]
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 105: Line 113:
| Basic
| Basic
| [[QA:Testcase_base_system_logging]]
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 110: Line 120:
| Basic
| Basic
| [[QA:Testcase_base_update_cli]]
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Basic / Beta
| Basic / Beta
| [[QA:Testcase package install remove]]
| [[QA:Testcase_package_install_remove]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 122: Line 136:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_toolbox]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
| style="background:lightgrey;"|
|-
|-
| Final
| Final
| [[QA:Testcase_base_edition_self_identification]]
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 132: Line 157:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 142: Line 164:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
==== Modularity ====
{{admon/note|Environment|These tests should be run using DNF, in any release-blocking environment, on any release-blocking arch.}}
{| class="wikitable sortable mw-collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! Result
|-
| Beta
| [[QA:Testcase_Modularity_module_list]]
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Modularity_enable-disable_module]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Modularity_install_module]]
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Modularity_update_without_repos]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_Modularity_update_module]]
| {{result|none}}
|-
|}
|}
<references/>
<references/>


==== Non-blocking environments (x86_64) ====
==== RPM-based non-blocking environments (x86_64) ====
{| class="wikitable sortable mw-collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! Xfce !! Cinnamon !! MATE !! LXDE !! LXqt !! Sugar !! Silverblue
! Milestone !! Test Case  !! Xfce !! Cinnamon !! MATE !! LXDE !! LXqt !! Sugar
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_initial_setup]]
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 194: Line 184:
| Optional
| Optional
| [[QA:Testcase_base_startup]]
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 204: Line 193:
| Optional
| Optional
| [[QA:Testcase_base_reboot_unmount]]
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 214: Line 202:
| Optional
| Optional
| [[QA:Testcase_base_system_logging]]
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 224: Line 211:
| Optional
| Optional
| [[QA:Testcase_base_update_cli]]
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 233: Line 219:
|-
|-
| Optional
| Optional
| [[QA:Testcase package install remove]]
| [[QA:Testcase_package_install_remove]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 240: Line 226:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_artwork_release_identification]]
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 254: Line 238:
| Optional
| Optional
| [[QA:Testcase_base_edition_self_identification]]
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 264: Line 247:
| Optional
| Optional
| [[QA:Testcase_base_services_start]]
| [[QA:Testcase_base_services_start]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 274: Line 256:
| Optional
| Optional
| [[QA:Testcase_base_selinux]]
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 284: Line 265:
| Optional
| Optional
| [[QA:Testcase_base_service_manipulation]]
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 295: Line 275:
<references/>
<references/>


==== Non-blocking environments (ARM) ====
==== rpm-ostree-based non-blocking environments (x86_64) ====
{| class="wikitable sortable mw-collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! Workstation !! Server !! Cloud !! Cinnamon !! MATE !! LXDE !! LXqt !! Sugar
! Milestone !! Test Case  !! Silverblue !! Kinoite
|-
|-
| Optional
| Optional
Line 303: Line 283:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_startup]]
| [[QA:Testcase_RpmOstree_Rebase]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_RpmOstree_Package_Layering]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_toolbox]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_reboot_unmount]]
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_services_start]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
==== RPM-based non-blocking environments (ARM) ====
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case !! Xfce !! LXQt !! Sugar
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_system_logging]]
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 344: Line 359:
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_update_cli]]
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 355: Line 371:
|-
|-
| Optional
| Optional
| [[QA:Testcase package install remove]]
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_package_install_remove]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 367: Line 384:
| Optional
| Optional
| [[QA:Testcase_base_artwork_release_identification]]
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 378: Line 390:
| Optional
| Optional
| [[QA:Testcase_base_edition_self_identification]]
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 392: Line 399:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| {{result|none}}
| Optional
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 399: Line 407:
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_selinux]]
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/></onlyinclude>
==== rpm-ostree-based non-blocking environments (ARM) ====
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! Kinoite
|-
| Optional
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_RpmOstree_Rebase]]
| {{result|none}}
| {{result|none}}
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_service_manipulation]]
| [[QA:Testcase_RpmOstree_Package_Layering]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_toolbox]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_services_start]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
|-
|-
|}
|}
<references/></onlyinclude>
<references/>


[[Category:QA_test_matrix_templates|01]]
[[Category:QA_test_matrix_templates|01]]

Latest revision as of 10:55, 23 July 2024

Template documentation [edit]

This documentation is transcluded from Template:Base test matrix/doc. It will not be transcluded on pages that use this template.
Wikitcms core page
This page is a core component of the Wikitcms system for storing release validation testing results in the Fedora wiki. This system relies on specific expectations regarding page naming, contents, and categorization. Please take special care when editing this page, especially if you change any element of wiki syntax, especially templating elements. If you are at all unsure about the consequences of your planned change, please contact the QA group before applying it.
This template contains the Base 'test matrix' of test cases that are usually executed as part of release validation testing. It is pulled into release validation results pages using several nested templates, and can be used in other pages as appropriate. If all you need to do is add, remove or edit a Base validation test case, though, don't worry about that stuff, and put it in here.
Cloud
The Cloud edition is not included on this page because all the same tests are present on the Cloud validation page.

Release-blocking environments (x86_64)

Milestone Test Case Workstation KDE Server
Basic/Final QA:Testcase_base_initial_setup
none
none
Basic QA:Testcase_base_startup
none
none
none
Basic QA:Testcase_base_reboot_unmount
none
none
none
Basic QA:Testcase_base_selinux
none
none
none
Basic QA:Testcase_base_system_logging
none
none
none
Basic QA:Testcase_base_update_cli
none
none
none
Basic / Beta QA:Testcase_package_install_remove
none
none
none
Basic / Final QA:Testcase_base_artwork_release_identification
none
none
none
Beta QA:Testcase_toolbox
none
none
Final QA:Testcase_base_edition_self_identification
none
none
none
Final QA:Testcase_base_services_start
none
none
none
Final QA:Testcase_base_service_manipulation
none
none
none


Release-blocking environments (aarch64)

Milestone Test Case Workstation KDE Server Minimal
Basic/Final QA:Testcase_base_initial_setup
none
none
none
none
Basic QA:Testcase_base_startup
none
none
none
none
Basic QA:Testcase_base_reboot_unmount
none
none
none
none
Basic QA:Testcase_base_selinux
none
none
none
none
Basic QA:Testcase_base_system_logging
none
none
none
none
Basic QA:Testcase_base_update_cli
none
none
none
none
Basic / Beta QA:Testcase_package_install_remove
none
none
none
none
Basic / Final QA:Testcase_base_artwork_release_identification
none
none
none
none
Beta QA:Testcase_toolbox
none
none
Final QA:Testcase_base_edition_self_identification
none
none
none
none
Final QA:Testcase_base_services_start
none
none
none
none
Final QA:Testcase_base_service_manipulation
none
none
none
none


RPM-based non-blocking environments (x86_64)

Milestone Test Case Xfce Cinnamon MATE LXDE LXqt Sugar
Optional QA:Testcase_base_initial_setup
none
none
none
none
none
none
Optional QA:Testcase_base_startup
none
none
none
none
none
none
Optional QA:Testcase_base_reboot_unmount
none
none
none
none
none
none
Optional QA:Testcase_base_system_logging
none
none
none
none
none
none
Optional QA:Testcase_base_update_cli
none
none
none
none
none
none
Optional QA:Testcase_package_install_remove
none
none
none
none
none
none
Optional QA:Testcase_base_artwork_release_identification
none
none
none
none
none
none
Optional QA:Testcase_base_edition_self_identification
none
none
none
none
none
none
Optional QA:Testcase_base_services_start
none
none
none
none
none
none
Optional QA:Testcase_base_selinux
none
none
none
none
none
none
Optional QA:Testcase_base_service_manipulation
none
none
none
none
none
none


rpm-ostree-based non-blocking environments (x86_64)

Milestone Test Case Silverblue Kinoite
Optional QA:Testcase_base_initial_setup
none
none
Optional QA:Testcase_base_startup
none
none
Optional QA:Testcase_base_reboot_unmount
none
none
Optional QA:Testcase_base_system_logging
none
none
Optional QA:Testcase_RpmOstree_Rebase
none
none
Optional QA:Testcase_RpmOstree_Package_Layering
none
none
Optional QA:Testcase_base_artwork_release_identification
none
none
Optional QA:Testcase_toolbox
none
none
Optional QA:Testcase_base_edition_self_identification
none
none
Optional QA:Testcase_base_services_start
none
none
Optional QA:Testcase_base_selinux
none
none
Optional QA:Testcase_base_service_manipulation
none
none


RPM-based non-blocking environments (ARM)

Milestone Test Case Xfce LXQt Sugar
Optional QA:Testcase_base_initial_setup
none
none
none
Optional QA:Testcase_base_startup
none
none
none
Optional QA:Testcase_base_reboot_unmount
none
none
none
Optional QA:Testcase_base_system_logging
none
none
none
Optional QA:Testcase_base_update_cli
none
none
none
Optional QA:Testcase_package_install_remove
none
none
none
Optional QA:Testcase_base_artwork_release_identification
none
none
none
Optional QA:Testcase_base_edition_self_identification
none
none
none
Optional QA:Testcase_base_services_start
none
none
none
Optional QA:Testcase_base_selinux
none
none
none
Optional QA:Testcase_base_service_manipulation
none
none
none


rpm-ostree-based non-blocking environments (ARM)

Milestone Test Case Kinoite
Optional QA:Testcase_base_initial_setup
none
Optional QA:Testcase_base_startup
none
Optional QA:Testcase_base_reboot_unmount
none
Optional QA:Testcase_base_system_logging
none
Optional QA:Testcase_RpmOstree_Rebase
none
Optional QA:Testcase_RpmOstree_Package_Layering
none
Optional QA:Testcase_base_artwork_release_identification
none
Optional QA:Testcase_toolbox
none
Optional QA:Testcase_base_edition_self_identification
none
Optional QA:Testcase_base_services_start
none
Optional QA:Testcase_base_selinux
none
Optional QA:Testcase_base_service_manipulation
none
Retrieved from "https://fedoraproject.org/w/index.php?title=Template:Base_test_matrix&oldid=715281"