From Fedora Project Wiki

(add terminal test case to the matrix)
(obsoletion notice)
 
(9 intermediate revisions by 3 users not shown)
Line 1: Line 1:
This page records [[QA:Desktop_validation_testing|desktop validation testing]] test results for the Fedora '''(VERSION) (PRE-RELEASE)''' release.
{{admon/important|Obsolete|This page is now obsolete. Use [[Template:Validation_results]] instead. See the [[QA/SOP_Release_Validation_Test_Event|SOP]] for more details and instructions on generating results pages.}}
 
== How to test ==
 
<!--If there are live images built for the pre-release being tested, change the link in the first step to point to the appropriate subdirectory of http://dl.fedoraproject.org/pub/alt/stage/-->
 
# Download the ISO images for testing: please use either the [https://dl.fedoraproject.org/pub/alt/stage/ DVD installer image], or the [https://dl.fedoraproject.org/pub/alt/nightly-composes nightly live image] for the desktop you wish to test. Testing for all four major desktop environments is required for each test point. [[Delta_ISOs]] for installer images are also available [http://dl.fedoraproject.org/pub/alt/stage/deltaisos/ here].
# Install, if appropriate (some tests may be intended to test the un-installed live environment).
# Perform one or more of the [[:Category:Desktop_Acceptance_Test_Cases|test cases]] and add your results to the table below.
# If a test fails, [https://bugzilla.redhat.com/enter_bug.cgi file a bug report]. If the bug is in the default desktop, propose the bug as a blocker for the appropriate release (see [[QA:SOP_blocker_bug_process|blocker bug process]]). If the bug is in any other desktop, propose it as a freeze exception bug for the appropriate release (see [[QA:SOP_freeze_exception_bug_process|freeze exception bug process]]).
# Don't install updates before performing any of the tests, as the updates available come from updates-testing and are not part of the proposed released package set. For this reason, we recommend leaving the update installation test for last.
 
{{admon/note|Virtual machine testing|In most cases, testing in a virtual machine is OK.}}
 
== Add or Remove a Test Case ==
# Please request review for your changes by publishing your test case for review to [mailto:test@lists.fedoraproject.org test@lists.fedoraproject.org]. {{#ifeq: {{FULLPAGENAME}} | QA:Desktop validation results template ||
# Once reviewed, make your changes to any current documents that use this template (e.g. {{FULLPAGENAME}}) }}
# Lastly, update [[QA:Desktop validation results template]] with the same changes.
 
== Key ==
 
See the table below for a sample format for test results. All test results are posted using the format specified [[Template:Result]].
 
 
{| class="wikitable sortable" border="0"
! Test Result !! Explanation !! Code Entered
|-
| {{result|none}}
| ''Untested'' - This test has not been run, and is available for anyone to contribute feedback.
| <code><nowiki>{{result|none}}</nowiki></code>
|-
| {{result|pass|robatino}}
| ''Passed'' - The test has been run and the tester determine the test met the ''expected results''
| <code><nowiki>{{result|pass|robatino}}</nowiki></code>
|-
| {{result|inprogress|adamwill}}
| ''Inprogress'' - An inprogress result is often used for tests that take a long time to execute.  Inprogress results should be temporary and change to pass, fail or warn.
| <code><nowiki>{{result|inprogress|adamwill}}</nowiki></code>
|-
| {{result|fail|jlaska|XYZ|ZXY}}
| ''Failed'' - Indicates a failed test.  A link to a bug must be provided.  See [[Template:Result]] for details on providing bug information. <references/>
| <code><nowiki>{{result|fail|jlaska|XYZ|ZXY}}</nowiki></code>
|-
| {{result|warn|rhe}} <ref>Brief description about the warning status</ref>
| ''Warning'' - This test completed and met the ''expected results'' of the test, but other issues were encountered during testing that warrant attention.<references/>
| <code><nowiki>{{result|warn|rhe}} <ref>Brief description about the warning status</ref></nowiki></code>
|-
| {{result|pass|hongqing}} {{result|warn|kparal}}
| ''Multiple results'' - More people can easily provide results to a single test case.
| <code><nowiki>{{result|pass|hongqing}} {{result|warn|kparal}}</nowiki></code>
|-
| {{result|pass|previous <build> run}}
| ''Result from previous test run'' - This test result is directly moved from the test run of previous ''<build>''.<references/>
| <code><nowiki>{{result|pass|previous <build> run}}</nowiki></code>
|-
| style="background:lightgrey;"|
| ''Unsupported'' - An unsupported test or configuration.  No testing is required.
|
|-
|}
 
== '''Test Matrices''' ==
 
=== Release-blocking desktops: '''x86 / x86_64''' ===
 
{| class="wikitable sortable" border="1"
! Release Level !! Test Case  !! [[Desktop|Desktop (GNOME)]] !! [[KDE]] !! References
|-
| Alpha
| [[QA:Testcase_desktop_browser]]
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Alpha
| [[QA:Testcase_desktop_updates]] (installation)
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_login]]
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_audio_basic]]
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_panel_basic]]
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_automount]]
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_updates]] (notification)
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_error_checks]]
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_menus]]
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_panel_advanced]]
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_keyring]]
| {{result|none}}
| {{result|none}}
| <references/>
|-
|}
 
=== Release-blocking desktops: '''ARM''' ===
 
{| class="wikitable sortable" border="1"
! Release Level !! Test Case  !! [[KDE]] !! References
|-
| Alpha
| [[QA:Testcase_desktop_browser]]
| {{result|none}}
| <references/>
|-
| Alpha
| [[QA:Testcase_desktop_terminal]]
| {{result|none}}
| <references/>
|-
| Alpha
| [[QA:Testcase_desktop_updates]] (installation)
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_login]]
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_audio_basic]]
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_panel_basic]]
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_automount]]
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_updates]] (notification)
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_error_checks]]
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_menus]]
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_panel_advanced]]
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_keyring]]
| {{result|none}}
| <references/>
|-
|}
 
=== Non release-blocking desktops: '''x86 / x86_64''' ===
 
{| class="wikitable sortable" border="1"
! Release Level !! Test Case !! [[Xfce]] !! [[LXDE]] !! MATE !! Cinnamon !! GNOME Classic !! References
|-
| Alpha
| [[QA:Testcase_desktop_browser]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Alpha
| [[QA:Testcase_desktop_updates]] (installation)
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_login]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_audio_basic]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_panel_basic]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_automount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_updates]] (notification)
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_error_checks]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_menus]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_panel_advanced]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_keyring]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
|}
 
=== Non release-blocking desktops: '''ARM''' ===
 
{| class="wikitable sortable" border="1"
! Release Level !! Test Case !! [[Desktop|Desktop (GNOME)]] !! [[Xfce]] !! [[LXDE]] !! MATE !! Cinnamon !! GNOME Classic !! References
|-
| Alpha
| [[QA:Testcase_desktop_browser]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Alpha
| [[QA:Testcase_desktop_updates]] (installation)
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_login]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_audio_basic]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_panel_basic]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_automount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Beta
| [[QA:Testcase_desktop_updates]] (notification)
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_error_checks]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_menus]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_panel_advanced]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| Final
| [[QA:Testcase_desktop_keyring]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
|}
 
=== Sugar (non-blocking, all arches) ===
 
The Sugar desktop differs significantly from a typical desktop, so it gets its own test cases.
 
At present these live [http://wiki.sugarlabs.org/go/Fedora/Sugar_test_cases on the Sugar wiki].
 
{| class="wikitable sortable" border="1"
! Test Case !! x86 !! ARM !! References
|-
| QA:Testcase_[http://wiki.sugarlabs.org/go/Fedora/Sugar_test_cases#1_-_SoaS_boots_to_the_.28name.29_selection_screen. SoaS boots to the (name) selection screen]
| {{result|none}}
| {{result|none}}
| <references/>
|-
|QA:Testcase_[http://wiki.sugarlabs.org/go/Fedora/Sugar_test_cases#2_-_SoaS_installed_to_hard_disk_with_liveinst_from_root_terminal.2C SoaS installed to hard disk with {{Code|liveinst}} from root terminal]
| {{result|none}}
| {{result|none}}
| <references/>
|-
|QA:Testcase_[http://wiki.sugarlabs.org/go/Fedora/Sugar_test_cases#3_-_Jabber.sugarlabs.org_should_connect_and_display_XO_.22Buddies.22 Jabber.sugarlabs.org should connect and display XO "Buddies"]
| {{result|none}}
| {{result|none}}
| <references/>
|-
|QA:Testcase_[http://wiki.sugarlabs.org/go/Fedora/Sugar_test_cases#4_-_When_a_USB_storage_device_is_inserted.2C_it_should_show_up_in_the_Frame. When a USB storage device is inserted, it should show up in the Frame]
| {{result|none}}
| {{result|none}}
| <references/> 
|-
|QA:Testcase_[http://wiki.sugarlabs.org/go/Fedora/Sugar_test_cases#5_-Functions_in_My_Settings_.28Sugar_control_panel.29. Functions in My Settings (Sugar control panel)]
| {{result|none}}
| {{result|none}}
| <references/>
|-
|QA:Testcase_[http://wiki.sugarlabs.org/go/Fedora/Sugar_test_cases#6_-_Applications_in_the_Home_Screen Applications in the ''Home Screen'']
| {{result|none}}
| {{result|none}}
| <references/>
|-
|QA:Testcase_[http://wiki.sugarlabs.org/go/Fedora/Sugar_test_cases#7_-Sugar-desktop_installed_in_another_Desktop Sugar-desktop installed in another Desktop]
| {{result|none}}
| {{result|none}}
| <references/>
|-
|}
 
[[Category:Desktop validation testing]]
 
[[Category:QA Templates]]
 
<!--In real event, you need to change above category to:
[[Category: Fedora {19,20,21} {Alpha,Beta,Final} {TC,RC} Test Results|D]]
-->

Latest revision as of 02:27, 23 September 2014

Obsolete
This page is now obsolete. Use Template:Validation_results instead. See the SOP for more details and instructions on generating results pages.