Test Results:Fedora 36 Branched 20220415.n.0 Desktop: Difference between revisions

Latest revision as of 09:26, 20 April 2022

No longer current
The compose for which this page contains results is no longer the current one. This page contains the results for the current compose.

This page records Desktop validation testing test results for the Fedora 36 20220415.n.0 nightly compose.

Which tests to run[edit]

Test coverage page
This page provides information about test coverage for the tests on this page across all the composes for the current release: it can help you see which test cases most need to be run.

Tests with a Milestone of Basic, Beta or Final are the most important. Optional tests are less so, but still useful to run. The milestone indicates that for that milestone release or a later one to be approved for release, the test must have been run against the release candidate build (so at Beta, all Basic and Beta tests must have been run, for instance). However, it is important to run the tests for all milestones as early and often as possible. Please refer to the test coverage page linked above and try to find and run tests which have not been run at all, or not run recently, for the current release.

How to test[edit]

1. Download one or more media for testing:

Image	aarch64	armhfp	ppc64le	s390x	x86_64
Everything boot	Download	Download	Download	Download	Download
Workstation live	Download		Download		Download
Server dvd	Download	Download	Download	Download	Download
Server boot	Download	Download	Download	Download	Download
Cloud_Base qcow2	Download			Download	Download
Cloud_Base raw-xz	Download			Download	Download
Cloud_Base tar-gz					Download
Cloud_Base vagrant-libvirt					Download
Cloud_Base vagrant-virtualbox					Download
KDE live	Download				Download
Xfce live					Download
SoaS live					Download
Mate live					Download
Cinnamon live					Download
LXDE live					Download
Container_Base docker	Download	Download		Download	Download
Container_Minimal_Base docker	Download	Download		Download	Download
Kinoite dvd-ostree	Download		Download		Download
Python_Classroom vagrant-libvirt					Download
Python_Classroom vagrant-virtualbox					Download
Scientific vagrant-libvirt					Download
Scientific vagrant-virtualbox					Download
Astronomy_KDE live					Download
Comp_Neuro live					Download
Design_suite live					Download
Games live					Download
Jam_KDE live					Download
Python_Classroom live					Download
Robotics live					Download
Scientific_KDE live					Download
Security live					Download
Silverblue dvd-ostree	Download		Download		Download
LXQt live					Download
i3 live					Download
Workstation raw-xz	Download	Download
Server raw-xz	Download	Download
KDE raw-xz	Download	Download
Minimal raw-xz	Download	Download
Xfce raw-xz	Download	Download
SoaS raw-xz	Download	Download
Python_Classroom raw-xz	Download

2. Perform one or more of the test cases and add your results to the table below

You can submit results by editing the page directly, or by using relval, with the relval report-results command. It provides a simple text interface for reporting test results.

3. If a test fails, file a bug report. You may propose the bug as a release blocker or freeze exception bug for the appropriate release - see blocker bug process and freeze exception bug process.

Some tests must be run against particular Products or images - for example, the #Default boot and install tests. If no particular product or image is specified either in this page or the test case page, you can use any appropriate image. For example, you can run most of the #General Tests with the Workstation live image, or either of the Server install images.

If you notice a problem during a test which does not constitute a complete failure of the test, you should still file a bug report, but it may not be appropriate to propose it as a release blocker bug. Use your judgment in deciding this, with reference to the Fedora_Release_Criteria, which these tests are intended to verify. If you are unsure, err on the side of proposing the bug as a blocker.

Don't install updates
Don't install updates before performing any of the tests, as when you are testing pre-releases, available updates are not part of the proposed released package set.

Virtual machine testing
In most cases, testing in a virtual machine is OK. You can test UEFI (including SecureBoot) in VMs as well.

Results summary page[edit]

The Test Results:Fedora 36 Branched 20220415.n.0 Summary page contains the results from this page and all the other validation pages for the same compose listed together to provide an overview.

Add, Modify or Remove a Test Case[edit]

Please request review for your changes by publishing your test case for review to the test mailing list and/or the appropriate working group mailing list (e.g. server, cloud, or desktop).
Once reviewed, make your changes to any current documents that use the template (e.g. Test_Results:Current_Desktop_Test).
Lastly, update Template:Desktop_test_matrix with the same changes.

Key[edit]

See the table below for a sample format for test results. All test results are posted using the result template.

Test Result	Explanation	Code Entered
none	Untested - This test has not been run, and is available for anyone to contribute feedback.	`{{result\|none}}`
pass robatino	Passed - The test has been run and the tester determine the test met the expected results	`{{result\|pass\|robatino}}`
inprogress adamwill	Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn.	`{{result\|inprogress\|adamwill}}`
fail jlaska ^[1] ^[2]	Failed - Indicates a failed test. A link to a bug must be provided. See Template:Result for details on providing bug information. ↑ RHBZ #XYZ ↑ RHBZ #ZXY	`{{result\|fail\|jlaska\|XYZ\|ZXY}}`
warn rhe ^[1]	Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention. ↑ Brief description about the warning status	`{{result\|warn\|rhe}} <ref>Brief description about the warning status</ref>`
pass hongqing warn kparal	Multiple results - More people can easily provide results to a single test case.	`{{result\|pass\|hongqing}} {{result\|warn\|kparal}}`
fail pboy ^[1] ^[2]	Failed - Same issue with LVM again ↑ RHBZ #2246871 ↑ RHBZ #'2244305	`{{result\|fail\|pboy\|2246871\|2244305}}`
pass previous <build> run	Result from previous test run - This test result is directly moved from the test run of previous <build>.	`{{result\|pass\|previous <build> run}}`
	Unsupported - An unsupported test or configuration. No testing is required.

Test Matrix[edit]

Release-blocking desktops: x86 / x86_64[edit]

Milestone	Test Case	Workstation	KDE
Basic	QA:Testcase_desktop_browser	pass coconut	pass coconut
Basic	QA:Testcase_desktop_app_basic - terminal emulator	pass coconut	pass coconut
Beta	QA:Testcase_desktop_login	pass coconut	pass lruzicka
Beta	QA:Testcase_audio_basic	pass lruzicka	pass lruzicka
Beta	QA:Testcase_desktop_panel_basic	pass lruzicka	pass lruzicka
Beta	QA:Testcase_desktop_automount	pass lruzicka	pass lruzicka
Beta	QA:Testcase_workstation_core_applications	pass coconut
Beta	QA:Testcase_desktop_update_graphical	pass coconut	pass coconut
Beta/Final	QA:Testcase_Printing_New_Printer - real printer	pass lruzicka	none
Beta/Final	QA:Testcase_Printing_PDF	pass coconut	pass coconut
Final	QA:Testcase_desktop_update_notification	pass coconut	pass coconut
Final	QA:Testcase_desktop_error_checks	pass coconut	pass coconut
Final	QA:Testcase_desktop_panel_advanced	pass lruzicka	fail lruzicka ^[1]
Final	QA:Testcase_desktop_keyring	pass lruzicka	pass lruzicka
Final	QA:Testcase_desktop_user_switching	pass lruzicka
Final	QA:Testcase_desktop_app_basic - file manager	pass lruzicka	pass lruzicka
Final	QA:Testcase_desktop_app_basic - package manager	pass lruzicka	pass lruzicka
Final	QA:Testcase_desktop_app_basic - image viewer	pass coconut	pass lruzicka
Final	QA:Testcase_desktop_app_basic - document viewer	pass coconut	pass lruzicka
Final	QA:Testcase_desktop_app_basic - text editor	pass lruzicka	pass lruzicka
Final	QA:Testcase_desktop_app_basic - archive manager	pass lruzicka	pass lruzicka
Final	QA:Testcase_desktop_app_basic - problem reporter	pass lruzicka	pass lruzicka
Final	QA:Testcase_desktop_app_basic - help viewer	pass lruzicka	pass lruzicka
Final	QA:Testcase_desktop_app_basic - system settings	pass lruzicka	pass lruzicka
Final/Optional	QA:Testcase_desktop_app_basic_others	none	none
Optional	QA:Testcase_desktop_menus	none	none
Optional	QA:Testcase_workstation_theming	none
Optional	QA:Testcase_Printing_New_Printer - virtual printer	pass coconut	pass coconut

↑ RHBZ #2076596

Release-blocking desktops: aarch64[edit]

Milestone	Test Case	Workstation
Basic	QA:Testcase_desktop_browser	pass coconut
Basic	QA:Testcase_desktop_app_basic - terminal emulator	pass coconut
Beta	QA:Testcase_desktop_login	none
Beta	QA:Testcase_audio_basic	none
Beta	QA:Testcase_desktop_panel_basic	none
Beta	QA:Testcase_desktop_automount	none
Beta	QA:Testcase_workstation_core_applications	none
Beta	QA:Testcase_desktop_update_graphical	pass coconut
Beta/Final	QA:Testcase_Printing_New_Printer - real printer	none
Beta/Final	QA:Testcase_Printing_PDF	none
Final	QA:Testcase_desktop_update_notification	none
Final	QA:Testcase_desktop_error_checks	none
Final	QA:Testcase_desktop_panel_advanced	none
Final	QA:Testcase_desktop_keyring	none
Final	QA:Testcase_desktop_user_switching	none
Final	QA:Testcase_desktop_app_basic - file manager	none
Final	QA:Testcase_desktop_app_basic - package manager	none
Final	QA:Testcase_desktop_app_basic - image viewer	pass coconut
Final	QA:Testcase_desktop_app_basic - document viewer	pass coconut
Final	QA:Testcase_desktop_app_basic - text editor	none
Final	QA:Testcase_desktop_app_basic - archive manager	none
Final	QA:Testcase_desktop_app_basic - problem reporter	none
Final	QA:Testcase_desktop_app_basic - help viewer	none
Final	QA:Testcase_desktop_app_basic - system settings	none
Final/Optional	QA:Testcase_desktop_app_basic_others	none
Optional	QA:Testcase_desktop_menus	none
Optional	QA:Testcase_workstation_theming	none
Optional	QA:Testcase_Printing_New_Printer - virtual printer	pass coconut

Non release-blocking desktops: x86 / x86_64[edit]

Milestone	Test Case	Xfce	LXQt	LXDE	MATE	Cinnamon	GNOME Classic	Silverblue
Basic	QA:Testcase_desktop_browser	pass nixuser	none	none	pass nixuser	pass nixuser	none	pass coconut
Basic	QA:Testcase_desktop_app_basic - terminal emulator	pass nixuser	pass nixuser	none	warn nixuser ^[1]	pass nixuser	none	pass coconut
Beta	QA:Testcase_desktop_login	pass nixuser	none	none	pass nixuser	pass nixuser	none	none
Beta	QA:Testcase_audio_basic	pass nixuser	pass nixuser	none	pass nixuser	pass nixuser	none	none
Beta	QA:Testcase_desktop_panel_basic	pass nixuser	pass nixuser	none	pass nixuser	pass nixuser	none	none
Beta	QA:Testcase_desktop_automount	pass nixuser ^[2]	none	none	pass nixuser	pass nixuser	none	none
Beta	QA:Testcase_workstation_core_applications							none
Beta	QA:Testcase_desktop_update_graphical	pass nixuser	pass nixuser	none	pass nixuser	pass nixuser	none	none
Beta/Final	QA:Testcase_Printing_New_Printer - real printer	none	none	none	none	none	none	none
Beta/Final	QA:Testcase_Printing_PDF	pass nixuser	pass nixuser	none	pass nixuser	pass nixuser	none	none
Final	QA:Testcase_desktop_update_notification	pass nixuser	none	none	pass nixuser	pass nixuser	none	none
Final	QA:Testcase_desktop_error_checks	pass nixuser	pass nixuser	none	pass nixuser	fail nixuser ^[3]	none	none
Final	QA:Testcase_desktop_panel_advanced	pass nixuser	none	none	pass nixuser	pass nixuser	none	none
Final	QA:Testcase_desktop_keyring	pass nixuser ^[4]	none	none	pass nixuser	pass nixuser	none	none
Final	QA:Testcase_desktop_user_switching	pass nixuser	none	none	pass nixuser	pass nixuser	none	none
Final	QA:Testcase_desktop_app_basic - file manager	pass nixuser	pass nixuser	none	pass nixuser	pass nixuser	none	none
Final	QA:Testcase_desktop_app_basic - package manager	pass nixuser	none	none	pass nixuser	pass nixuser	none	none
Final	QA:Testcase_desktop_app_basic - image viewer	pass nixuser	pass nixuser	none	pass nixuser	pass nixuser	none	pass coconut
Final	QA:Testcase_desktop_app_basic - document viewer	pass nixuser	fail nixuser ^[5]	none	pass nixuser	pass nixuser	none	pass coconut
Final	QA:Testcase_desktop_app_basic - text editor	pass nixuser	fail nixuser ^[6]	none	pass nixuser	pass nixuser	none	pass coconut
Final	QA:Testcase_desktop_app_basic - archive manager	pass nixuser	pass nixuser	none	pass nixuser	pass nixuser	none	none
Final	QA:Testcase_desktop_app_basic - problem reporter	none	none	none	none	warn nixuser ^[7]	none	none
Final	QA:Testcase_desktop_app_basic - help viewer	warn nixuser ^[8] ^[9]	warn nixuser ^[8]	none	pass nixuser	warn nixuser ^[8]	none	none
Final	QA:Testcase_desktop_app_basic - system settings	pass nixuser	none	none	pass nixuser	pass nixuser	none	none
Final/Optional	QA:Testcase_desktop_app_basic_others	pass nixuser	none	none	pass nixuser	pass nixuser ^[10]	none	none
Optional	QA:Testcase_desktop_menus	pass nixuser	warn nixuser ^[11]	none	pass nixuser	pass nixuser	none	none
Optional	QA:Testcase_workstation_theming							none
Optional	QA:Testcase_Printing_New_Printer - virtual printer	none	none	none	none	none	none	none

↑ Works but right clicking in MATE Terminal results in an unexpected font in the right click menu.
↑ Automount is off by default in Xfce, but when enabled via the advanced tab in Thunar, automounting works fine.
↑ RHBZ #2063483
↑ gnome-keyring-daemon is running by default, but oddly in "Session and Startup" it is not shown as active by default.
↑ No document viewer installed from the Live ISO.
↑ RHBZ #2066026
↑ During testing I somehow crashed webkit2gtk3, but generating the backtrace seemed like an endless loop, I ended up having to kill it.
↑ ^8.0 ^8.1 ^8.2 RHBZ #2066111
↑ yelp is installed but you have no way to get to it because the launcher has "OnlyShowIn=GNOME;Unity;" in it. If you edit the launcher and comment that line out, it's all good and working fine. This is a bug, why install yelp in a way that you cannot use it?
↑ Calculator didn't seem to respect current dark theme preference.
↑ pavucontrol and pavucontrol-qt are both installed and have identical names in "Sound and Video". One should be identified as "QT" if it is intentional having both. Also pavucontrol is missing icons.

Non release-blocking desktops: aarch64[edit]

Milestone	Test Case	KDE	Xfce	Cinnamon	GNOME Classic	Silverblue
Basic	QA:Testcase_desktop_browser	none	none	none	none	none
Basic	QA:Testcase_desktop_app_basic - terminal emulator	none	none	none	none	none
Beta	QA:Testcase_desktop_login	none	none	none	none	none
Beta	QA:Testcase_audio_basic	none	none	none	none	none
Beta	QA:Testcase_desktop_panel_basic	none	none	none	none	none
Beta	QA:Testcase_desktop_automount	none	none	none	none	none
Beta	QA:Testcase_workstation_core_applications					none
Beta	QA:Testcase_desktop_update_graphical	none	none	none	none	none
Beta/Final	QA:Testcase_Printing_New_Printer - real printer	none	none	none	none	none
Beta/Final	QA:Testcase_Printing_PDF	none	none	none	none	none
Final	QA:Testcase_desktop_update_notification	none	none	none	none	none
Final	QA:Testcase_desktop_error_checks	none	none	none	none	none
Final	QA:Testcase_desktop_panel_advanced	none	none	none	none	none
Final	QA:Testcase_desktop_keyring	none	none	none	none	none
Final	QA:Testcase_desktop_user_switching	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - file manager	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - package manager	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - image viewer	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - document viewer	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - text editor	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - archive manager	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - problem reporter	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - help viewer	none	none	none	none	none
Final	QA:Testcase_desktop_app_basic - system settings	none	none	none	none	none
Final/Optional	QA:Testcase_desktop_app_basic_others	none	none	none	none	none
Optional	QA:Testcase_desktop_menus	none	none	none	none	none
Optional	QA:Testcase_workstation_theming					none
Optional	QA:Testcase_Printing_New_Printer - virtual printer	none	none	none	none	none

Sugar (non-blocking, all arches)[edit]

Sugar test cases
The Sugar desktop differs significantly from a typical desktop, so it gets its own test cases. At present these live on the Sugar wiki.

Test Case	x86	ARM
QA:Testcase_SoaS boots to the (name) selection screen	none	none
QA:Testcase_SoaS installed to hard disk with liveinst from root terminal	none	none
QA:Testcase_Jabber.sugarlabs.org should connect and display XO "Buddies"	none	none
QA:Testcase_When a USB storage device is inserted, it should show up in the Frame	none	none
QA:Testcase_Functions in My Settings (Sugar control panel)	none	none
QA:Testcase_Applications in the Home Screen	none	none
QA:Testcase_Sugar-desktop installed in another Desktop	none	none

[bzXYZ-1] RHBZ #XYZ

[bzZXY-2] RHBZ #ZXY

[3] Brief description about the warning status

[bz''2246871''-4] RHBZ #2246871

[bz'2244305''-5] RHBZ #'2244305

[bz2076596-6] RHBZ #2076596

[7] Works but right clicking in MATE Terminal results in an unexpected font in the right click menu.

[8] Automount is off by default in Xfce, but when enabled via the advanced tab in Thunar, automounting works fine.

[bz2063483-9] RHBZ #2063483

[10] -keyring-daemon is running by default, but oddly in "Session and Startup" it is not shown as active by default.

[11] No document viewer installed from the Live ISO.

[bz2066026-12] RHBZ #2066026

[13] During testing I somehow crashed webkit2gtk3, but generating the backtrace seemed like an endless loop, I ended up having to kill it.

[bz2066111-14] 8.0 ^8.1 ^8.2 RHBZ #2066111

[15] yelp is installed but you have no way to get to it because the launcher has "OnlyShowIn=GNOME;Unity;" in it. If you edit the launcher and comment that line out, it's all good and working fine. This is a bug, why install yelp in a way that you cannot use it?

[16] Calculator didn't seem to respect current dark theme preference.

[17] vucontrol and pavucontrol-qt are both installed and have identical names in "Sound and Video". One should be identified as "QT" if it is intentional having both. Also pavucontrol is missing icons.

[1]

[2]

[1]

[1]

[2]

[1]

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

Search