From Fedora Project Wiki

No edit summary
(Drop direct Test Days category membership)
 
(53 intermediate revisions by 12 users not shown)
Line 1: Line 1:
{{Infobox_group
{{Infobox_group
| name = Fedora 21 Server Test Day
| name = Fedora 21 Server Test Day
| image = [[File:Echo-testing-48px.png|link=QA/Fedora_19_test_days]]
| image = [[File:Echo-testing-48px.png|link=QA/Test_Days]]
| caption = [[FIXME|FIXME]]
| date = November 7th, 2014
| date = November 7th, 2014
| time = all day
| time = all day
| website = [[QA/Fedora_21_test_days]]
| website = [[QA/Test_Days]]
| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
| fedora_mailing_list = test
| fedora_mailing_list = test
Line 14: Line 13:
== What to test? ==
== What to test? ==
   
   
Today will be focusing on features of Rolekit, freeIPA, cockpit, and openLMI. We will be also testing for basic functionality. Please submit your findings to the table below.
Today will be focusing on the major Server features: [[Changes/FrameworkForServerRoleDeployment|Rolekit]], [[Changes/DomainControllerServerRole|FreeIPA]] (the 'Domain Controller role'), [[Changes/CockpitManagementConsole|Cockpit]], and [http://www.openlmi.org/ OpenLMI]. We will be also testing for basic functionality. Please submit your findings to the table below.


== Who's available ==
== Who's available ==


The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
* Development - [[User:Developer1|Developer1]] (irc_nick1), [[User:Developer2|Developer2]] (irc_nick2)
* Development - [[User:Sgallagh|Stephen Gallagher]] (sgallagh)
* Quality Assurance - [[User:dmossor|Dan Mossor]] (danofsatx), [[User:Tester2|Tester2]] (irc_nick4), [[User:Tester3|Tester3]] (irc_nick5)
* Quality Assurance - [[User:dmossor|Dan Mossor]] (danofsatx)
* General Help - [[User:Simo|Simo Sorce]] (simo)
* Test Day Organizer and Tester - [[User:Junland|John Unland]] (junland)  


== Prerequisite for Test Day ==  
== Requirements for testing ==  


* Extra Hard Disk Space
* A disposable test system (hardware or a virtual machine) with Fedora 21 Server (see  below for image downloads)
* Virtualbox, QEMU, or VMWare Player
* IRC Client (optional)
* IRC Client (Optional)
* Enable the Fedora Server Test Day COPR containing updated packages that haven't yet been pushed to the updates-testing repository.
* x86 / x86-64 / ARM Hardware (Optional)
** https://copr.fedoraproject.org/coprs/sgallagh/fedora-server-test-day/
 
=== Getting the test image ===
 
We are using the Fedora 21 Final TC1 images as the reference testing images. You can find them here:
 
* [https://dl.fedoraproject.org/pub/alt/stage/21_TC1/Server/x86_64/iso/ x86_64]
* [https://dl.fedoraproject.org/pub/alt/stage/21_TC1/Server/i386/iso/ i686]
* [https://dl.fedoraproject.org/pub/alt/stage/21_TC1/Server/armhfp/iso/ ARM]


== How to test? ==
== How to test? ==


* Download Image for your particular Architecture.
* Download the image for your architecture
* Verify image through MD5 or SHA256 SUM. (VERY IMPORTANT)
* Verify the download using the CHECKSUM file in the download directory
* Install Image on USB / DVD if you are testing on physical hardware.
* Install the image to your test system (refer to the [https://docs.fedoraproject.org/en-US/Fedora/20/html/Installation_Guide/index.html Installation Guide] for installation instructions)
* Install image in a Virtual Machine or Physical Hardware.
* Run the test cases linked in the result table below
* Run through test cases.
* File bug reports for any bugs you encounter
* Submit bugs / results in the table below.
* Add your results to the table
 
== What to test? ==


=== '''Testing Image''' ===
For this Test Day, we will be running the test cases found in the following categories:


Testing image can be found here: [https://dl.fedoraproject.org/pub/alt/stage/21_Beta_TC4/Server/ Fedora 21 Server Beta TC4]
# [[:Category:Base_Acceptance_Test_Cases|Base Test Cases]]
# [[QA:Testcase_Server_role_deploy|Rolekit Test Case]]
# [[:Category:FreeIPA_Test_Cases|FreeIPA Test Cases]]
# [[:Category:Realmd_Test_Cases|Realmd Test Cases]]
# [[QA:Testcase_Docker_Base_Setup|Docker Base Setup Test Case]]
# [https://fedoraproject.org/wiki/Test_Day:2014-09-16_Cockpit Cockpit Test Cases] (TC's Derived from Cockpit's Test Day)


== Test Cases ==


* 1. [https://fedoraproject.org/wiki/Category:Base_Acceptance_Test_Cases Base Test Cases]
{{admon/warning | FreeIPA installation issue|Be aware of [https://fedorahosted.org/freeipa/ticket/4705 a bug which causes FreeIPA 4.1.1 to fail to install in SELinux enforcing mode]}}
* 2. [https://fedoraproject.org/wiki/QA:Testcase_Server_role_deploy Rolekit Test Case]
* 3. [https://fedoraproject.org/wiki/Category:FreeIPA_Test_Cases FreeIPA Test Cases]
* 4. [https://fedoraproject.org/wiki/Category:Realmd_Test_Cases Realmd Test Cases]


== Test Results ==
== Test Results ==


Construct a table or list to allow testers to post results. Each column should be a test case or configuration, and each row should consist of test results. Include some instructions on how to report bugs, and any special instructions. Here's an example, from a Palimpsest test day:
If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla] usually for the relevant component - e.g. [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=21&component=cockpit cockpit], or [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=21&component=rolekit rolekit].
 
If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line.


If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla] usually for the component [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=13&component=udisks udisks], or [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=13&component=gnome-disk-utility gnome-disk-utility] for bugs in the Palimpsest graphical front end itself. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line.
FreeIPA_Test_Cases|FreeIPA Test Cases
{|
{|
! User
! User
! [[QA:Testcase_sample_1|Sample test 1]]
! [[:Category:Base_Acceptance_Test_Cases|Base Test Cases]]
! [[QA:Testcase_sample_2|Sample test 2]]
! [[QA:Testcase_Server_role_deploy|Rolekit Test Case]]
! [[QA:Testcase_sample_3|Sample test 3]]
! [[:Category:FreeIPA_Test_Cases|FreeIPA Test Cases]]
! [[QA:Testcase_sample_4|Sample test 4]]
! [[:Category:Realmd_Test_Cases|Realmd Test Cases]]
! References
! [[QA:Testcase_Docker_Base_Setup|Docker Base Setup]]
! [https://fedoraproject.org/wiki/Test_Day:2014-09-16_Cockpit Cockpit Test Cases]
! References <references/>
|-
|-
| [[User:SampleUser|Sample User]]
| [[User:SampleUser|Sample User]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|warn||54321}}
| {{result|fail||12345}}
| <references/>
|-
| [[User:New]]<ref>Copy/Paste this row to create a new one</ref>
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| [[User:satellit]]
| {{result|pass}} <ref>base initial setup -netinstall req root pswd setup in anaconda to finish * login to root - No firstboot </ref>
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| [[User:potty]]
| {{result|pass}}<ref>No problems.</ref>
| {{result|warn}}<ref>First deployment ended with "Error: COMMAND_FAILED: 256". Then, I decommission and deploy it again. After that, no problems.</ref>
| {{result|none}}
| {{result|none}}
| {{result|pass}}<ref>No problems.</ref>
| {{result|pass}}<ref>No problems.</ref>
| <references/>
|-
| [[User:junland]]
| {{result|pass}}<ref>All base tests went smoothly</ref>
| {{result|none}}  
| {{result|none}}  
| {{result|none}}
| {{result|none}}
| {{result|pass}}<ref>Did a basic run through the steps, downloaded multiple images and ran them. All seemed to be going well.</ref>
| {{result|pass}}<ref>Used Firefox on a another VM to access Cockpit and do tests. Made a RAID5 Array, VLAN, New User, Bonding interfaces and other tests.</ref>
| <references/>
|-
| [[User:Roshi]]
| {{result|pass}}
| {{result|warn}}<ref group="long">First run ended with "Error: COMMAND_FAILED: 256" and after decommissioning and deploying again, 'rolectl list instances' reports: Error: The name :1.161 was not provided by any .service files' </ref>
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| [[User:pwhalen|pwhalen]]
| {{result|pass}}
| {{result|pass}}
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
| {{result|fail||1153746}}<ref>As noted, first run 'Error: COMMAND_FAILED: 256' , when trying to redeploy 'Error: UNKNOWN_SETTING: admin_password'</ref> 
| {{result|fail}} <ref>{{bz|12345}}</ref>
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|warn}}<ref group="long">Cockpit reports storage incorrectly (web interface reports 4.1G, actual 9.9G total size). Network bonding not possible on device. Docker not suported.</ref>
| <references/>
| <references/>
|-
|-
|}
|}
== Long comments ==
<references group="long" />


[[Category:Fedora_21_Test_Days]]
[[Category:Fedora_21_Test_Days]]

Latest revision as of 20:54, 26 June 2015

Fedora 21 Server Test Day
Date November 7th, 2014
Time all day
Website QA/Test_Days
IRC #fedora-test-day (webirc)
Mailing list test


Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?[edit]

Today will be focusing on the major Server features: Rolekit, FreeIPA (the 'Domain Controller role'), Cockpit, and OpenLMI. We will be also testing for basic functionality. Please submit your findings to the table below.

Who's available[edit]

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

Requirements for testing[edit]

Getting the test image[edit]

We are using the Fedora 21 Final TC1 images as the reference testing images. You can find them here:

How to test?[edit]

  • Download the image for your architecture
  • Verify the download using the CHECKSUM file in the download directory
  • Install the image to your test system (refer to the Installation Guide for installation instructions)
  • Run the test cases linked in the result table below
  • File bug reports for any bugs you encounter
  • Add your results to the table

What to test?[edit]

For this Test Day, we will be running the test cases found in the following categories:

  1. Base Test Cases
  2. Rolekit Test Case
  3. FreeIPA Test Cases
  4. Realmd Test Cases
  5. Docker Base Setup Test Case
  6. Cockpit Test Cases (TC's Derived from Cockpit's Test Day)


Test Results[edit]

If you have problems with any of the tests, report a bug to Bugzilla usually for the relevant component - e.g. cockpit, or rolekit.

If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the result template to enter your result, as shown in the example result line.

User Base Test Cases Rolekit Test Case FreeIPA Test Cases Realmd Test Cases Docker Base Setup Cockpit Test Cases References
Sample User
none
none
none
Pass pass
Warning warn [1]
Fail fail [2]
  1. ↑ RHBZ #54321
  2. ↑ RHBZ #12345
User:New[1]
none
none
none
none
none
none
  1. ↑ Copy/Paste this row to create a new one
User:satellit
Pass pass
[1]
none
none
none
none
none
  1. ↑ base initial setup -netinstall req root pswd setup in anaconda to finish * login to root - No firstboot
User:potty
Pass pass
[1]
Warning warn
[2]
none
none
Pass pass
[3]
Pass pass
[4]
  1. ↑ No problems.
  2. ↑ First deployment ended with "Error: COMMAND_FAILED: 256". Then, I decommission and deploy it again. After that, no problems.
  3. ↑ No problems.
  4. ↑ No problems.
User:junland
Pass pass
[1]
none
none
none
Pass pass
[2]
Pass pass
[3]
  1. ↑ All base tests went smoothly
  2. ↑ Did a basic run through the steps, downloaded multiple images and ran them. All seemed to be going well.
  3. ↑ Used Firefox on a another VM to access Cockpit and do tests. Made a RAID5 Array, VLAN, New User, Bonding interfaces and other tests.
User:Roshi
Pass pass
Warning warn
[long 1]
none
none
none
none
pwhalen
Pass pass
Fail fail [1]
[2]
none
none
none
Warning warn
[long 2]
  1. ↑ RHBZ #1153746
  2. ↑ As noted, first run 'Error: COMMAND_FAILED: 256' , when trying to redeploy 'Error: UNKNOWN_SETTING: admin_password'

Long comments[edit]

  1. ↑ First run ended with "Error: COMMAND_FAILED: 256" and after decommissioning and deploying again, 'rolectl list instances' reports: Error: The name :1.161 was not provided by any .service files'
  2. ↑ Cockpit reports storage incorrectly (web interface reports 4.1G, actual 9.9G total size). Network bonding not possible on device. Docker not suported.
Retrieved from "https://fedoraproject.org/w/index.php?title=Test_Day:2014-11-07_Server&oldid=416720"