Template:Desktop test matrix: Difference between revisions

Latest revision as of 15:27, 24 October 2024

Template documentation [edit]

This documentation is transcluded from Template:Desktop test matrix/doc. It will not be transcluded on pages that use this template.

Wikitcms core page
This page is a core component of the Wikitcms system for storing release validation testing results in the Fedora wiki. This system relies on specific expectations regarding page naming, contents, and categorization. Please take special care when editing this page, especially if you change any element of wiki syntax, especially templating elements. If you are at all unsure about the consequences of your planned change, please contact the QA group before applying it.

This template contains the Desktop 'test matrix' of test cases that are usually executed as part of release validation testing. It is pulled into release validation results pages using several nested templates, and can be used in other pages as appropriate. If all you need to do is add, remove or edit a Desktop validation test case, though, don't worry about that stuff, and put it in here.

Release-blocking desktops: x86 / x86_64

Milestone	Test Case	Workstation	KDE
Basic	QA:Testcase window manager	none	none
Basic	QA:Testcase_desktop_browser	none	none
Basic	QA:Testcase_desktop_app_basic - terminal emulator	none	none
Beta	QA:Testcase_desktop_login	none	none
Beta	QA:Testcase_audio_basic	none	none
Beta	QA:Testcase_desktop_panel_basic	none	none
Beta	QA:Testcase_desktop_automount	none	none
Beta	QA:Testcase_workstation_core_applications	none
Beta	QA:Testcase_desktop_update_graphical	none	none
Beta/Final	QA:Testcase_Printing_New_Printer - real printer	none	none
Final	QA:Testcase_Printing_PDF	none	none
Final	QA:Testcase_desktop_update_notification	none	none
Final	QA:Testcase_desktop_error_checks	none	none
Final	QA:Testcase_desktop_panel_advanced	none	none
Final	QA:Testcase_desktop_keyring	none	none
Final	QA:Testcase_desktop_user_switching	none	none
Final	QA:Testcase_desktop_app_basic - file manager	none	none
Final	QA:Testcase_desktop_app_basic - package manager	none	none
Final	QA:Testcase_desktop_app_basic - image viewer	none	none
Final	QA:Testcase_desktop_app_basic - document viewer	none	none
Final	QA:Testcase_desktop_app_basic - text editor	none	none
Final	QA:Testcase_desktop_app_basic - archive manager	none	none
Final	QA:Testcase_desktop_app_basic - problem reporter	none	none
Final	QA:Testcase_desktop_app_basic - help viewer	none	none
Final	QA:Testcase_desktop_app_basic - system settings	none	none
Final/Optional	QA:Testcase_desktop_app_basic_others	none	none
Optional	QA:Testcase_desktop_menus	none	none
Optional	QA:Testcase_workstation_theming	none
Optional	QA:Testcase_Printing_New_Printer - virtual printer	none	none
Optional	QA:Testcase_bluetooth_headset	none	none

Release-blocking desktops: aarch64

Milestone	Test Case	Workstation	KDE
Basic	QA:Testcase window manager	none	none
Basic	QA:Testcase_desktop_browser	none	none
Basic	QA:Testcase_desktop_app_basic - terminal emulator	none	none
Beta	QA:Testcase_desktop_login	none	none
Beta	QA:Testcase_audio_basic	none	none
Beta	QA:Testcase_desktop_panel_basic	none	none
Beta	QA:Testcase_desktop_automount	none	none
Beta	QA:Testcase_workstation_core_applications	none
Beta	QA:Testcase_desktop_update_graphical	none	none
Beta/Final	QA:Testcase_Printing_New_Printer - real printer	none	none
Final	QA:Testcase_Printing_PDF	none	none
Final	QA:Testcase_desktop_update_notification	none	none
Final	QA:Testcase_desktop_error_checks	none	none
Final	QA:Testcase_desktop_panel_advanced	none	none
Final	QA:Testcase_desktop_keyring	none	none
Final	QA:Testcase_desktop_user_switching	none	none
Final	QA:Testcase_desktop_app_basic - file manager	none	none
Final	QA:Testcase_desktop_app_basic - package manager	none	none
Final	QA:Testcase_desktop_app_basic - image viewer	none	none
Final	QA:Testcase_desktop_app_basic - document viewer	none	none
Final	QA:Testcase_desktop_app_basic - text editor	none	none
Final	QA:Testcase_desktop_app_basic - archive manager	none	none
Final	QA:Testcase_desktop_app_basic - problem reporter	none	none
Final	QA:Testcase_desktop_app_basic - help viewer	none	none
Final	QA:Testcase_desktop_app_basic - system settings	none	none
Optional	QA:Testcase_desktop_app_basic_others	none	none
Optional	QA:Testcase_desktop_menus	none	none
Optional	QA:Testcase_workstation_theming	none
Optional	QA:Testcase_Printing_New_Printer - virtual printer	none	none
Optional	QA:Testcase_bluetooth_headset	none	none

Non release-blocking desktops: x86 / x86_64

Milestone	Test Case	Xfce	LXQt	LXDE	MATE	Cinnamon	GNOME Classic	Silverblue
Basic	QA:Testcase window manager	none	none	none	none	none	none	none
Basic	QA:Testcase_desktop_browser	none	none	none	none	none	none	none
Basic	QA:Testcase_desktop_app_basic - terminal emulator	none	none	none	none	none	none	none
Beta	QA:Testcase_desktop_login	none	none	none	none	none	none	none
Beta	QA:Testcase_audio_basic	none	none	none	none	none	none	none
Beta	QA:Testcase_desktop_panel_basic	none	none	none	none	none	none	none
Beta	QA:Testcase_desktop_automount	none	none	none	none	none	none	none
Beta	QA:Testcase_workstation_core_applications							none
Beta	QA:Testcase_desktop_update_graphical	none	none	none	none	none	none	none
Beta/Final	QA:Testcase_Printing_New_Printer - real printer	none	none	none	none	none	none	none
Final	QA:Testcase_Printing_PDF	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_update_notification	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_error_checks	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_panel_advanced	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_keyring	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_user_switching	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - file manager	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - package manager	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - image viewer	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - document viewer	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - text editor	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - archive manager	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - problem reporter	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - help viewer	none	none	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - system settings	none	none	none	none	none	none	none
Final/Optional	QA:Testcase_desktop_app_basic_others	none	none	none	none	none	none	none
Optional	QA:Testcase_desktop_menus	none	none	none	none	none	none	none
Optional	QA:Testcase_workstation_theming							none
Optional	QA:Testcase_Printing_New_Printer - virtual printer	none	none	none	none	none	none	none
Optional	QA:Testcase_bluetooth_headset	none	none	none	none	none	none	none

Non release-blocking desktops: aarch64

Milestone	Test Case	Xfce	Cinnamon	GNOME Classic	Silverblue
Basic	QA:Testcase window manager	none	none	none	none
Basic	QA:Testcase_desktop_browser	none	none	none	none
Basic	QA:Testcase_desktop_app_basic - terminal emulator	none	none	none	none
Beta	QA:Testcase_desktop_login	none	none	none	none
Beta	QA:Testcase_audio_basic	none	none	none	none
Beta	QA:Testcase_desktop_panel_basic	none	none	none	none
Beta	QA:Testcase_desktop_automount	none	none	none	none
Beta	QA:Testcase_workstation_core_applications				none
Beta	QA:Testcase_desktop_update_graphical	none	none	none	none
Beta/Final	QA:Testcase_Printing_New_Printer - real printer	none	none	none	none
Final	QA:Testcase_Printing_PDF	none	none	none	none
Final	QA:Testcase_desktop_update_notification	none	none	none	none
Final	QA:Testcase_desktop_error_checks	none	none	none	none
Final	QA:Testcase_desktop_panel_advanced	none	none	none	none
Final	QA:Testcase_desktop_keyring	none	none	none	none
Final	QA:Testcase_desktop_user_switching	none	none	none	none
Final	QA:Testcase_desktop_app_basic - file manager	none	none	none	none
Final	QA:Testcase_desktop_app_basic - package manager	none	none	none	none
Final	QA:Testcase_desktop_app_basic - image viewer	none	none	none	none
Final	QA:Testcase_desktop_app_basic - document viewer	none	none	none	none
Final	QA:Testcase_desktop_app_basic - text editor	none	none	none	none
Final	QA:Testcase_desktop_app_basic - archive manager	none	none	none	none
Final	QA:Testcase_desktop_app_basic - problem reporter	none	none	none	none
Final	QA:Testcase_desktop_app_basic - help viewer	none	none	none	none
Final	QA:Testcase_desktop_app_basic - system settings	none	none	none	none
Final/Optional	QA:Testcase_desktop_app_basic_others	none	none	none	none
Optional	QA:Testcase_desktop_menus	none	none	none	none
Optional	QA:Testcase_workstation_theming				none
Optional	QA:Testcase_Printing_New_Printer - virtual printer	none	none	none	none
Optional	QA:Testcase_bluetooth_headset	none	none	none	none

Sugar (non-blocking, all arches)

Sugar test cases
The Sugar desktop differs significantly from a typical desktop, so it gets its own test cases. At present these live on the Sugar wiki.

Test Case	x86	ARM
QA:Testcase_SoaS boots to the (name) selection screen	none	none
QA:Testcase_SoaS installed to hard disk with liveinst from root terminal	none	none
QA:Testcase_Jabber.sugarlabs.org should connect and display XO "Buddies"	none	none
QA:Testcase_When a USB storage device is inserted, it should show up in the Frame	none	none
QA:Testcase_Functions in My Settings (Sugar control panel)	none	none
QA:Testcase_Applications in the Home Screen	none	none
QA:Testcase_Sugar-desktop installed in another Desktop	none	none

@@ Line 4: / Line 4: @@
 {| class="wikitable sortable mw-collapsible" width=100%
 ! Milestone !! Test Case  !! [[Workstation]] !! [[KDE]]
+|-
+| Basic
+| [[QA:Testcase window manager]]
+| {{result|none}}
+| {{result|none}}
 |-
 | Basic
@@ Line 45: / Line 50: @@
 | {{result|none}}
 |-
-| Beta
+| Beta/Final
 | [[QA:Testcase_Printing_New_Printer]] - real printer
 | {{result|none}}
 | {{result|none}}
 |-
-| Beta
+| Final
 | [[QA:Testcase_Printing_PDF]]
 | {{result|none}}
@@ Line 142: / Line 147: @@
 | Optional
 | [[QA:Testcase_Printing_New_Printer]] - virtual printer
+| {{result|none}}
+| {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_bluetooth_headset]]
 | {{result|none}}
 | {{result|none}}
@@ Line 151: / Line 161: @@
 {| class="wikitable sortable mw-collapsible" width=100%
-! Milestone !! Test Case  !! [[Workstation]]
+! Milestone !! Test Case  !! [[Workstation]] !! [[KDE]]
+|-
+| Basic
+| [[QA:Testcase window manager]]
+| {{result|none}}
+| {{result|none}}
 |-
 | Basic
 | [[QA:Testcase_desktop_browser]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Basic
 | [[QA:Testcase_desktop_app_basic]] - terminal emulator
+| {{result|none}}
 | {{result|none}}
 |-
 | Beta
 | [[QA:Testcase_desktop_login]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Beta
 | [[QA:Testcase_audio_basic]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Beta
 | [[QA:Testcase_desktop_panel_basic]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Beta
 | [[QA:Testcase_desktop_automount]]
+| {{result|none}}
 | {{result|none}}
 |-
@@ Line 180: / Line 201: @@
 | [[QA:Testcase_workstation_core_applications]]
 | {{result|none}}
+| style="background:lightgrey;"|
 |-
 | Beta
 | [[QA:Testcase_desktop_update_graphical]]
+| {{result|none}}
 | {{result|none}}
 |-
-| Beta
+| Beta/Final
 | [[QA:Testcase_Printing_New_Printer]] - real printer
+| {{result|none}}
 | {{result|none}}
 |-
-| Beta
+| Final
 | [[QA:Testcase_Printing_PDF]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_update_notification]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_error_checks]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_panel_advanced]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_keyring]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_user_switching]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - file manager
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - package manager
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - image viewer
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - document viewer
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - text editor
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - archive manager
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - problem reporter
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - help viewer
+| {{result|none}}
 | {{result|none}}
 |-
 | Final
 | [[QA:Testcase_desktop_app_basic]] - system settings
+| {{result|none}}
 | {{result|none}}
 |-
-| Final/Optional
+| Optional
 | [[QA:Testcase_desktop_app_basic_others]]
+| {{result|none}}
 | {{result|none}}
 |-
 | Optional
 | [[QA:Testcase_desktop_menus]]
+| {{result|none}}
 | {{result|none}}
 |-
@@ Line 260: / Line 301: @@
 | [[QA:Testcase_workstation_theming]]
 | {{result|none}}
+| style="background:lightgrey;"|
 |-
 | Optional
 | [[QA:Testcase_Printing_New_Printer]] - virtual printer
+| {{result|none}}
+| {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_bluetooth_headset]]
+| {{result|none}}
 | {{result|none}}
 |-
@@ Line 272: / Line 320: @@
 {| class="wikitable sortable mw-collapsible" width=100%
 ! Milestone !! Test Case !! [[Xfce]] !! [[LXQt_SIG|LXQt]] !! [[LXDE]] !! MATE !! Cinnamon !! GNOME Classic !! Silverblue
+|-
+| Basic
+| [[QA:Testcase window manager]]
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
 |-
 | Basic
@@ Line 353: / Line 411: @@
 | {{result|none}}
 |-
-| Beta
+| Beta/Final
 | [[QA:Testcase_Printing_New_Printer]] - real printer
 | {{result|none}}
@@ Line 363: / Line 421: @@
 | {{result|none}}
 |-
-| Beta
+| Final
 | [[QA:Testcase_Printing_PDF]]
 | {{result|none}}
@@ Line 545: / Line 603: @@
 | Optional
 | [[QA:Testcase_Printing_New_Printer]] - virtual printer
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_bluetooth_headset]]
 | {{result|none}}
 | {{result|none}}
@@ Line 559: / Line 627: @@
 {| class="wikitable sortable mw-collapsible" width=100%
-! Milestone !! Test Case !! [[KDE]] !! [[Xfce]] !! Cinnamon !! GNOME Classic !! Silverblue
+! Milestone !! Test Case !! [[Xfce]] !! Cinnamon !! GNOME Classic !! Silverblue
+|-
+| Basic
+| [[QA:Testcase window manager]]
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
 |-
 | Basic
 | [[QA:Testcase_desktop_browser]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 571: / Line 645: @@
 | Basic
 | [[QA:Testcase_desktop_app_basic]] - terminal emulator
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 579: / Line 652: @@
 | Beta
 | [[QA:Testcase_desktop_login]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 587: / Line 659: @@
 | Beta
 | [[QA:Testcase_audio_basic]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 595: / Line 666: @@
 | Beta
 | [[QA:Testcase_desktop_panel_basic]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 603: / Line 673: @@
 | Beta
 | [[QA:Testcase_desktop_automount]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 611: / Line 680: @@
 | Beta
 | [[QA:Testcase_workstation_core_applications]]
-| style="background:lightgrey;"|
 | style="background:lightgrey;"|
 | style="background:lightgrey;"|
@@ Line 619: / Line 687: @@
 | Beta
 | [[QA:Testcase_desktop_update_graphical]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 625: / Line 692: @@
 | {{result|none}}
 |-
-| Beta
+| Beta/Final
 | [[QA:Testcase_Printing_New_Printer]] - real printer
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 633: / Line 699: @@
 | {{result|none}}
 |-
-| Beta
+| Final
 | [[QA:Testcase_Printing_PDF]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 643: / Line 708: @@
 | Final
 | [[QA:Testcase_desktop_update_notification]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 651: / Line 715: @@
 | Final
 | [[QA:Testcase_desktop_error_checks]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 659: / Line 722: @@
 | Final
 | [[QA:Testcase_desktop_panel_advanced]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 667: / Line 729: @@
 | Final
 | [[QA:Testcase_desktop_keyring]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 675: / Line 736: @@
 | Final
 | [[QA:Testcase_desktop_user_switching]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 683: / Line 743: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - file manager
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 691: / Line 750: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - package manager
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 699: / Line 757: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - image viewer
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 707: / Line 764: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - document viewer
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 715: / Line 771: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - text editor
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 723: / Line 778: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - archive manager
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 731: / Line 785: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - problem reporter
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 739: / Line 792: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - help viewer
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 747: / Line 799: @@
 | Final
 | [[QA:Testcase_desktop_app_basic]] - system settings
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 755: / Line 806: @@
 | Final/Optional
 | [[QA:Testcase_desktop_app_basic_others]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 763: / Line 813: @@
 | Optional
 | [[QA:Testcase_desktop_menus]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 771: / Line 820: @@
 | Optional
 | [[QA:Testcase_workstation_theming]]
-| style="background:lightgrey;"|
 | style="background:lightgrey;"|
 | style="background:lightgrey;"|
@@ Line 780: / Line 828: @@
 | [[QA:Testcase_Printing_New_Printer]] - virtual printer
 | {{result|none}}
+| {{result|none}}
+| {{result|none}}
+| {{result|none}}
+|-
+| Optional
+| [[QA:Testcase_bluetooth_headset]]
 | {{result|none}}
 | {{result|none}}

Search