Template:Desktop test matrix: Difference between revisions

Latest revision as of 15:27, 24 October 2024

Template documentation [edit]

This documentation is transcluded from Template:Desktop test matrix/doc. It will not be transcluded on pages that use this template.

Wikitcms core page
This page is a core component of the Wikitcms system for storing release validation testing results in the Fedora wiki. This system relies on specific expectations regarding page naming, contents, and categorization. Please take special care when editing this page, especially if you change any element of wiki syntax, especially templating elements. If you are at all unsure about the consequences of your planned change, please contact the QA group before applying it.

This template contains the Desktop 'test matrix' of test cases that are usually executed as part of release validation testing. It is pulled into release validation results pages using several nested templates, and can be used in other pages as appropriate. If all you need to do is add, remove or edit a Desktop validation test case, though, don't worry about that stuff, and put it in here.

Release-blocking desktops: x86 / x86_64

Milestone	Test Case	Workstation	KDE
Basic	QA:Testcase window manager	none	none
Basic	QA:Testcase_desktop_browser	none	none
Basic	QA:Testcase_desktop_app_basic - terminal emulator	none	none
Beta	QA:Testcase_desktop_login	none	none
Beta	QA:Testcase_audio_basic	none	none
Beta	QA:Testcase_desktop_panel_basic	none	none
Beta	QA:Testcase_desktop_automount	none	none
Beta	QA:Testcase_workstation_core_applications	none
Beta	QA:Testcase_desktop_update_graphical	none	none
Beta/Final	QA:Testcase_Printing_New_Printer - real printer	none	none
Final	QA:Testcase_Printing_PDF	none	none
Final	QA:Testcase_desktop_update_notification	none	none
Final	QA:Testcase_desktop_error_checks	none	none
Final	QA:Testcase_desktop_panel_advanced	none	none
Final	QA:Testcase_desktop_keyring	none	none
Final	QA:Testcase_desktop_user_switching	none	none
Final	QA:Testcase_desktop_app_basic - file manager	none	none
Final	QA:Testcase_desktop_app_basic - package manager	none	none
Final	QA:Testcase_desktop_app_basic - image viewer	none	none
Final	QA:Testcase_desktop_app_basic - document viewer	none	none
Final	QA:Testcase_desktop_app_basic - text editor	none	none
Final	QA:Testcase_desktop_app_basic - archive manager	none	none
Final	QA:Testcase_desktop_app_basic - problem reporter	none	none
Final	QA:Testcase_desktop_app_basic - help viewer	none	none
Final	QA:Testcase_desktop_app_basic - system settings	none	none
Final/Optional	QA:Testcase_desktop_app_basic_others	none	none
Optional	QA:Testcase_desktop_menus	none	none
Optional	QA:Testcase_workstation_theming	none
Optional	QA:Testcase_Printing_New_Printer - virtual printer	none	none
Optional	QA:Testcase_bluetooth_headset	none	none

Release-blocking desktops: aarch64

Milestone	Test Case	Workstation	KDE
Basic	QA:Testcase window manager	none	none
Basic	QA:Testcase_desktop_browser	none	none
Basic	QA:Testcase_desktop_app_basic - terminal emulator	none	none
Beta	QA:Testcase_desktop_login	none	none
Beta	QA:Testcase_audio_basic	none	none
Beta	QA:Testcase_desktop_panel_basic	none	none
Beta	QA:Testcase_desktop_automount	none	none
Beta	QA:Testcase_workstation_core_applications	none
Beta	QA:Testcase_desktop_update_graphical	none	none
Beta/Final	QA:Testcase_Printing_New_Printer - real printer	none	none
Final	QA:Testcase_Printing_PDF	none	none
Final	QA:Testcase_desktop_update_notification	none	none
Final	QA:Testcase_desktop_error_checks	none	none
Final	QA:Testcase_desktop_panel_advanced	none	none
Final	QA:Testcase_desktop_keyring	none	none
Final	QA:Testcase_desktop_user_switching	none	none
Final	QA:Testcase_desktop_app_basic - file manager	none	none
Final	QA:Testcase_desktop_app_basic - package manager	none	none
Final	QA:Testcase_desktop_app_basic - image viewer	none	none
Final	QA:Testcase_desktop_app_basic - document viewer	none	none
Final	QA:Testcase_desktop_app_basic - text editor	none	none
Final	QA:Testcase_desktop_app_basic - archive manager	none	none
Final	QA:Testcase_desktop_app_basic - problem reporter	none	none
Final	QA:Testcase_desktop_app_basic - help viewer	none	none
Final	QA:Testcase_desktop_app_basic - system settings	none	none
Optional	QA:Testcase_desktop_app_basic_others	none	none
Optional	QA:Testcase_desktop_menus	none	none
Optional	QA:Testcase_workstation_theming	none
Optional	QA:Testcase_Printing_New_Printer - virtual printer	none	none
Optional	QA:Testcase_bluetooth_headset	none	none

Non release-blocking desktops: x86 / x86_64

Milestone	Test Case	Xfce	LXQt	LXDE	MATE	Cinnamon	GNOME Classic	Silverblue
Basic	QA:Testcase window manager	none	none	none	none	none	none	none
Basic	QA:Testcase_desktop_browser	none	none	none	none	none	none	none
Basic	QA:Testcase_desktop_app_basic - terminal emulator	none	none	none	none	none	none	none
Beta	QA:Testcase_desktop_login	none	none	none	none	none	none	none
Beta	QA:Testcase_audio_basic	none	none	none	none	none	none	none
Beta	QA:Testcase_desktop_panel_basic	none	none	none	none	none	none	none
Beta	QA:Testcase_desktop_automount	none	none	none	none	none	none	none
Beta	QA:Testcase_workstation_core_applications							none
Beta	QA:Testcase_desktop_update_graphical	none	none	none	none	none	none	none
Beta/Final	QA:Testcase_Printing_New_Printer - real printer	none	none	none	none	none	none	none
Final	QA:Testcase_Printing_PDF	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_update_notification	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_error_checks	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_panel_advanced	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_keyring	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_user_switching	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - file manager	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - package manager	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - image viewer	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - document viewer	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - text editor	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - archive manager	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - problem reporter	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - help viewer	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - system settings	none	none	none	none	none	none	none
Final/Optional	QA:Testcase_desktop_app_basic_others	none	none	none	none	none	none	none
Optional	QA:Testcase_desktop_menus	none	none	none	none	none	none	none
Optional	QA:Testcase_workstation_theming							none
Optional	QA:Testcase_Printing_New_Printer - virtual printer	none	none	none	none	none	none	none
Optional	QA:Testcase_bluetooth_headset	none	none	none	none	none	none	none

Non release-blocking desktops: aarch64

Milestone	Test Case	Xfce	Cinnamon	GNOME Classic	Silverblue
Basic	QA:Testcase window manager	none	none	none	none
Basic	QA:Testcase_desktop_browser	none	none	none	none
Basic	QA:Testcase_desktop_app_basic - terminal emulator	none	none	none	none
Beta	QA:Testcase_desktop_login	none	none	none	none
Beta	QA:Testcase_audio_basic	none	none	none	none
Beta	QA:Testcase_desktop_panel_basic	none	none	none	none
Beta	QA:Testcase_desktop_automount	none	none	none	none
Beta	QA:Testcase_workstation_core_applications				none
Beta	QA:Testcase_desktop_update_graphical	none	none	none	none
Beta/Final	QA:Testcase_Printing_New_Printer - real printer	none	none	none	none
Final	QA:Testcase_Printing_PDF	none	none	none	none
Final	QA:Testcase_desktop_update_notification	none	none	none	none
Final	QA:Testcase_desktop_error_checks	none	none	none	none
Final	QA:Testcase_desktop_panel_advanced	none	none	none	none
Final	QA:Testcase_desktop_keyring	none	none	none	none
Final	QA:Testcase_desktop_user_switching	none	none	none	none
Final	QA:Testcase_desktop_app_basic - file manager	none	none	none	none
Final	QA:Testcase_desktop_app_basic - package manager	none	none	none	none
Final	QA:Testcase_desktop_app_basic - image viewer	none	none	none	none
Final	QA:Testcase_desktop_app_basic - document viewer	none	none	none	none
Final	QA:Testcase_desktop_app_basic - text editor	none	none	none	none
Final	QA:Testcase_desktop_app_basic - archive manager	none	none	none	none
Final	QA:Testcase_desktop_app_basic - problem reporter	none	none	none	none
Final	QA:Testcase_desktop_app_basic - help viewer	none	none	none	none
Final	QA:Testcase_desktop_app_basic - system settings	none	none	none	none
Final/Optional	QA:Testcase_desktop_app_basic_others	none	none	none	none
Optional	QA:Testcase_desktop_menus	none	none	none	none
Optional	QA:Testcase_workstation_theming				none
Optional	QA:Testcase_Printing_New_Printer - virtual printer	none	none	none	none
Optional	QA:Testcase_bluetooth_headset	none	none	none	none

Sugar (non-blocking, all arches)

Sugar test cases
The Sugar desktop differs significantly from a typical desktop, so it gets its own test cases. At present these live on the Sugar wiki.

Test Case	x86	ARM
QA:Testcase_SoaS boots to the (name) selection screen	none	none
QA:Testcase_SoaS installed to hard disk with liveinst from root terminal	none	none
QA:Testcase_Jabber.sugarlabs.org should connect and display XO "Buddies"	none	none
QA:Testcase_When a USB storage device is inserted, it should show up in the Frame	none	none
QA:Testcase_Functions in My Settings (Sugar control panel)	none	none
QA:Testcase_Applications in the Home Screen	none	none
QA:Testcase_Sugar-desktop installed in another Desktop	none	none

@@ Line 55: / Line 55: @@
 | {{result|none}}
 |-
-| Beta/Final
+| Final
 | [[QA:Testcase_Printing_PDF]]
 | {{result|none}}
@@ Line 147: / Line 147: @@
 | Optional
 | [[QA:Testcase_Printing_New_Printer]] - virtual printer
+| {{result|none}}
+| {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_bluetooth_headset]]
 | {{result|none}}
 | {{result|none}}
@@ Line 156: / Line 161: @@
 {| class="wikitable sortable mw-collapsible" width=100%
-! Milestone !! Test Case  !! [[Workstation]]
+! Milestone !! Test Case  !! [[Workstation]] !! [[KDE]]
 |-
 | Basic
 | [[QA:Testcase window manager]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Basic
 | [[QA:Testcase_desktop_browser]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Basic
 | [[QA:Testcase_desktop_app_basic]] - terminal emulator
+| {{result|none}}
 | {{result|none}}
 |-
 | Beta
 | [[QA:Testcase_desktop_login]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Beta
 | [[QA:Testcase_audio_basic]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Beta
 | [[QA:Testcase_desktop_panel_basic]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Beta
 | [[QA:Testcase_desktop_automount]]
+| {{result|none}}
 | {{result|none}}
 |-
@@ Line 189: / Line 201: @@
 | [[QA:Testcase_workstation_core_applications]]
 | {{result|none}}
+| style="background:lightgrey;"|
 |-
 | Beta
 | [[QA:Testcase_desktop_update_graphical]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Beta/Final
 | [[QA:Testcase_Printing_New_Printer]] - real printer
+| {{result|none}}
 | {{result|none}}
 |-
-| Beta/Final
+| Final
 | [[QA:Testcase_Printing_PDF]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_update_notification]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_error_checks]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_panel_advanced]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_keyring]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_user_switching]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - file manager
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - package manager
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - image viewer
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - document viewer
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - text editor
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - archive manager
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - problem reporter
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - help viewer
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - system settings
+| {{result|none}}
 | {{result|none}}
 |-
-| Final/Optional
+| Optional
 | [[QA:Testcase_desktop_app_basic_others]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Optional
 | [[QA:Testcase_desktop_menus]]
+| {{result|none}}
 | {{result|none}}
 |-
@@ Line 269: / Line 301: @@
 | [[QA:Testcase_workstation_theming]]
 | {{result|none}}
+| style="background:lightgrey;"|
 |-
 | Optional
 | [[QA:Testcase_Printing_New_Printer]] - virtual printer
+| {{result|none}}
+| {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_bluetooth_headset]]
+| {{result|none}}
 | {{result|none}}
 |-
@@ Line 382: / Line 421: @@
 | {{result|none}}
 |-
-| Beta/Final
+| Final
 | [[QA:Testcase_Printing_PDF]]
 | {{result|none}}
@@ Line 564: / Line 603: @@
 | Optional
 | [[QA:Testcase_Printing_New_Printer]] - virtual printer
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_bluetooth_headset]]
 | {{result|none}}
 | {{result|none}}
@@ Line 578: / Line 627: @@
 {| class="wikitable sortable mw-collapsible" width=100%
-! Milestone !! Test Case !! [[KDE]] !! [[Xfce]] !! Cinnamon !! GNOME Classic !! Silverblue
+! Milestone !! Test Case !! [[Xfce]] !! Cinnamon !! GNOME Classic !! Silverblue
 |-
 | Basic
 | [[QA:Testcase window manager]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 590: / Line 638: @@
 | Basic
 | [[QA:Testcase_desktop_browser]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 598: / Line 645: @@
 | Basic
 | [[QA:Testcase_desktop_app_basic]] - terminal emulator
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 606: / Line 652: @@
 | Beta
 | [[QA:Testcase_desktop_login]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 614: / Line 659: @@
 | Beta
 | [[QA:Testcase_audio_basic]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 622: / Line 666: @@
 | Beta
 | [[QA:Testcase_desktop_panel_basic]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 630: / Line 673: @@
 | Beta
 | [[QA:Testcase_desktop_automount]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 638: / Line 680: @@
 | Beta
 | [[QA:Testcase_workstation_core_applications]]
-| style="background:lightgrey;"|
 | style="background:lightgrey;"|
 | style="background:lightgrey;"|
@@ Line 646: / Line 687: @@
 | Beta
 | [[QA:Testcase_desktop_update_graphical]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 654: / Line 694: @@
 | Beta/Final
 | [[QA:Testcase_Printing_New_Printer]] - real printer
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 660: / Line 699: @@
 | {{result|none}}
 |-
-| Beta/Final
+| Final
 | [[QA:Testcase_Printing_PDF]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 670: / Line 708: @@
 | Final
 | [[QA:Testcase_desktop_update_notification]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 678: / Line 715: @@
 | Final
 | [[QA:Testcase_desktop_error_checks]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 686: / Line 722: @@
 | Final
 | [[QA:Testcase_desktop_panel_advanced]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 694: / Line 729: @@
 | Final
 | [[QA:Testcase_desktop_keyring]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 702: / Line 736: @@
 | Final
 | [[QA:Testcase_desktop_user_switching]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 710: / Line 743: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - file manager
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 718: / Line 750: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - package manager
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 726: / Line 757: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - image viewer
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 734: / Line 764: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - document viewer
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 742: / Line 771: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - text editor
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 750: / Line 778: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - archive manager
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 758: / Line 785: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - problem reporter
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 766: / Line 792: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - help viewer
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 774: / Line 799: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - system settings
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 782: / Line 806: @@
 | Final/Optional
 | [[QA:Testcase_desktop_app_basic_others]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 790: / Line 813: @@
 | Optional
 | [[QA:Testcase_desktop_menus]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 798: / Line 820: @@
 | Optional
 | [[QA:Testcase_workstation_theming]]
-| style="background:lightgrey;"|
 | style="background:lightgrey;"|
 | style="background:lightgrey;"|
@@ Line 807: / Line 828: @@
 | [[QA:Testcase_Printing_New_Printer]] - virtual printer
 | {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_bluetooth_headset]]
 | {{result|none}}
 | {{result|none}}

Search