From Fedora Project Wiki

No edit summary
(Drop direct Test Days category membership)
 
(97 intermediate revisions by 13 users not shown)
Line 1: Line 1:
{{Infobox_group
{{Infobox_group
| name = Fedora Test Days
| name = Fedora Test Days
Line 10: Line 11:
}}
}}


{{admon/important|Usability feedback submitted after the Test Day is still valuable|You don't have to test everything in one day. Feedback from Usablility Testing is being collected until <b>Sunday, May 26th 2013</b> (inclusive). Feel free to submit your feedback anytime before this date.}}
{{admon/note | Can't make the date? | If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at [http://bugzilla.redhat.com Bugzilla], and add your results to the results section. If this page is more than a month old when you arrive here, please check the [[QA/Test_Days|current schedule]] and see if a similar but more recent Test Day is planned or has already happened.}}
{{admon/note | Can't make the date? | If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at [http://bugzilla.redhat.com Bugzilla], and add your results to the results section. If this page is more than a month old when you arrive here, please check the [[QA/Test_Days|current schedule]] and see if a similar but more recent Test Day is planned or has already happened.}}


== What to test? ==
== What to test? ==


Today's instalment of Fedora Test Day will focus on new installer features delivered based on recent activities in [Features/AnacondaNewUI_Followup] Fedora 19 Feature.
Today's instalment of Fedora Test Day will focus on new installer features delivered based on recent activities in [[Features/AnacondaNewUI_Followup]] Fedora 19 Feature. This event covers the advanced storage setup as well as several important usability test scenarios.
 
If you'll decide to participate in both Usability Testing as well as in Advanced Storage Testing it would be better to start with Usability test cases.


== Who's available ==
== Who's available ==
Line 26: Line 30:
{{admon/important|Risk of data loss|This test day covers installation testing. Hard drives will be formatted during testing and all data on that drive(s) will be lost}}
{{admon/important|Risk of data loss|This test day covers installation testing. Hard drives will be formatted during testing and all data on that drive(s) will be lost}}


* Recent installation media.
* Recent installation media [http://dl.fedoraproject.org/pub/alt/stage/19-Beta-RC2/Fedora/x86_64/iso/Fedora-19-Beta-x86_64-netinst.iso Netinst CD (313M)] or full [http://alt.fedoraproject.org/pub/alt/stage/19-Beta-RC2/Fedora/x86_64/iso/Fedora-19-Beta-x86_64-DVD.iso DVD (4.2G)].
* Machine for testing installations. '''All data will/may be lost on this machine!'''. Virtual machine is acceptable.
* Machine for testing installations. '''All data will/may be lost on this machine!'''. Virtual machine is acceptable.
* Machine providing iSCSI target. Procedure how to setup software iSCSI target in Fedora is included in relevant test case.
* Machine providing iSCSI target. Procedure how to setup software iSCSI target in Fedora is included in relevant test case.
Line 33: Line 37:


== How to test? ==
== How to test? ==
The result table is the
 
All the testing will be driven by result tables below. Just pick up a test case from some table, finish it and report result back to table. If necessary also report bug to bugzilla as mentioned Test Results chapter.


=== Initial setup ===
=== Initial setup ===
* Prepare installation media available at {URL} according to instructions from [http://docs.fedoraproject.org/en-US/Fedora/18/html/Installation_Guide/sn-making-media.html Installation Guide]
* Prepare installation media [http://dl.fedoraproject.org/pub/alt/stage/19-Beta-RC2/Fedora/x86_64/iso/Fedora-19-Beta-x86_64-netinst.iso Netinst CD (313M)] or full [http://alt.fedoraproject.org/pub/alt/stage/19-Beta-RC2/Fedora/x86_64/iso/Fedora-19-Beta-x86_64-DVD.iso DVD (4.2G)] according to instructions from [http://docs.fedoraproject.org/en-US/Fedora/18/html/Installation_Guide/sn-making-media.html Installation Guide]
* Optionally install virtualization support in Fedora:
* Optionally install virtualization support in Fedora:
<pre>
<pre>
Line 56: Line 61:


All test cases are located at [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan]].
All test cases are located at [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan]].
Test cases for usability test day are located at [[QA:2013-05-21_Anaconda_usability_Test_Plan]].


You can use result table(s) below to access particular test case directly.
You can use result table(s) below to access particular test case directly.
Line 62: Line 69:


If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla]. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line.
If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla]. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line.
=== Anaconda usability ===
{|
!
! Test Case
! Participants <br> Please fill in only participant nick/name. For the results use [https://docs.google.com/forms/d/1fNJdWyi1dnpkfpUf_t4wxDPgx3nyeu3CYfnk1K6FYeY/viewform]
|-
| 1.
| [[QA:2013-05-21_Anaconda_usability_Test_Plan#Text_mode_installation_.28anaconda-text-1.29|Text mode installation (anaconda-text-1)]]
| {{result|none}} {{result|warn|mbanas|965460|965477|965498}}{{result|warn|mbanas|965509|965526|965543}}{{result|warn|mbanas|965561|965571}} {{result|pass|pkotvan}} {{result|pass|pholica}} {{result|pass|lnovy}} {{result|warn|mganisin|965580|965592}}{{result|pass|nonamedotc}} {{result|pass|jbastian|965774}}
|-
| 2.
| [[QA:2013-05-21_Anaconda_usability_Test_Plan#Create_multiple_Volume_Groups_.28anaconda-lvm-1.29| Create multiple Volume Groups (anaconda-lvm-1)]]
| {{result|none}} {{result|fail|pkotvan}} {{result|none|mbanas}} {{result|warn|lnovy|965623|965660}} {{result|none|mganisin}} {{result|pass|jbastian}} {{result|pass|pholica|965805}}
|-
| 3.
| [[QA:2013-05-21_Anaconda_usability_Test_Plan#iSCSI_target_is_part_of_LVM_Volume_Group_.28anaconda-lvm-2.29|iSCSI target is part of LVM Volume Group (anaconda-lvm-2)]]
| {{result|none}} {{result|none|mbanas}} {{result|none|mganisin}} {{result|pass|pkotvan}} {{result|warn|jbastian|966282|962012}}
|-
| 4.
| [[QA:2013-05-21_Anaconda_usability_Test_Plan#LVM_on_top_of_RAID_.28anaconda-lvm-3.29|LVM on top of RAID (anaconda-lvm-3)]]
| {{result|pass|pkotvan}} {{result|fail|pholica}} {{result|none|mbanas}} {{result|pass|lnovy}} {{result|fail|jbastian|966285|966286|966289}}
|-
| 5.
| [[QA:2013-05-21_Anaconda_usability_Test_Plan#CHAP_authentication_against_iSCSI_target_.28anaconda-iscsi-1.29|CHAP authentication against iSCSI target (anaconda-iscsi-1)]]
| {{result|none|mbanas}} {{result|pass|pkotvan}} {{result|warn|jbastian|966282}}
|-
| 6.
| [[QA:2013-05-21_Anaconda_usability_Test_Plan#Search_for_specific_device_.28anaconda-storage-1.29|Search for specific device (anaconda-storage-1)]]
| {{result|none|mbanas}} {{result|pass|pkotvan}} {{result|pass|jbastian}}
|}
<references />


=== Advanced Storage ===
=== Advanced Storage ===
{{admon/note | Feedback about Usability is Welcome | There are also special usability oriented test cases above, however you can fill usability report also for following test cases. If you would like to share your experience, please do it in this [https://docs.google.com/forms/d/1fNJdWyi1dnpkfpUf_t4wxDPgx3nyeu3CYfnk1K6FYeY/viewform form] once you'll complete a test case.}}
{|
{|
!
!
Line 71: Line 111:
| 1.
| 1.
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Installation_on_bios.2Ffirmware_RAID|Installation on bios/firmware RAID]]
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Installation_on_bios.2Ffirmware_RAID|Installation on bios/firmware RAID]]
| {{result|none}}
| {{result|none}}  
|-
|-
| 2.
| 2.
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Installation_on_iSCSI|Installation on iSCSI]]
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Installation_on_iSCSI|Installation on iSCSI]]
| {{result|none}}
| {{result|pass|mbanas}} {{result|pass|pkotvan}}{{result|warn|mganisin|965736|965703}} {{result|fail|jscotka|966874}}
|-
|-
| 3.
| 3.
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Default_LVM_with_encryption|Default LVM with encryption]]
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Default_LVM_with_encryption|Default LVM with encryption]]
| {{result|none}}
| {{result|pass|nonamedotc}} {{result|pass|mbanas}} {{result|pass|pkotvan}} {{result|pass|mganisin}}  
|-
|-
| 4.  
| 4.  
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Reuse_.2Fhome_on_LVM|Reuse /home on LVM]]
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Reuse_.2Fhome_on_LVM|Reuse /home on LVM]]
| {{result|none}}
| {{result|pass|nonamedotc}} {{result|pass|mbanas}} {{result|pass|pkotvan}}
|-
|-
| 5.
| 5.
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#More_disks|More disks]]
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#More_disks|More disks]]
| {{result|none}}
| {{result|none}} {{result|pass|mbanas}} {{result|pass|pkotvan}}
|-
|-
| 6.
| 6.
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Separate_mountpoints|Separate mountpoints]]
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Separate_mountpoints|Separate mountpoints]]
| {{result|none}}
| {{result|pass|nonamedotc}} {{result|pass|mbanas}} {{result|warn|mganisin|965746|965730}} {{result|pass|pkotvan}}
|-
|-
| 7.
| 7.
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Reuse_existing_VG|Reuse existing VG]]
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Reuse_existing_VG|Reuse existing VG]]
| {{result|none}}
| {{result|warn|mbanas|965752}}
|-
|-
| 8.
| 8.
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#LVM_on_top_of_sw_RAID|LVM on top of sw RAID]]
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#LVM_on_top_of_sw_RAID|LVM on top of sw RAID]]
| {{result|none}}
| {{result|pass|mbanas}} {{result|pass|pkotvan}}
|-
|-
| 9.
| 9.
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Reuse_encrypted_partitions|Reuse encrypted partitions]]
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Reuse_encrypted_partitions|Reuse encrypted partitions]]
| {{result|none}}
| {{result|warn|mbanas|965754}} {{result|pass|pkotvan}}
|-
|-
| 10.
| 10.
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Create_multiple_VGs|Create multiple VGs]]
| [[QA:AnacondaNewUI_Advanced_Storage_Test_Plan#Create_multiple_VGs|Create multiple VGs]]
| {{result|none}}
| {{result|pass|mbanas}} {{result|warn|jstodola|965755}} {{result|warn|mganisin|965709}} {{result|pass|pkotvan}}
|-
|
| Just An Example
| {{result|pass|john doe}} {{result|inprogress|j.doe}} {{result|fail|jane doe|1|1}} {{result|warn|jdoe}} <ref>Brief description about the warning status</ref>
|}
|}
<references/>
<references/>


[[Category:Test Days]]
  [[Category:Fedora 19 Test Days]]

Latest revision as of 19:40, 26 June 2015

Fedora Test Days
AnacondaNewUI Followup

Date 2013-05-21
Time all day

Website QA/Fedora_19_test_days
IRC #fedora-test-day (webirc)
Mailing list test


Usability feedback submitted after the Test Day is still valuable
You don't have to test everything in one day. Feedback from Usablility Testing is being collected until Sunday, May 26th 2013 (inclusive). Feel free to submit your feedback anytime before this date.
Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?[edit]

Today's instalment of Fedora Test Day will focus on new installer features delivered based on recent activities in Features/AnacondaNewUI_Followup Fedora 19 Feature. This event covers the advanced storage setup as well as several important usability test scenarios.

If you'll decide to participate in both Usability Testing as well as in Advanced Storage Testing it would be better to start with Usability test cases.

Who's available[edit]

The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...

  • Quality Assurance - Marian Ganisin (mganisin), Ladislav Jozsa (ljozsa)

Prerequisite for Test Day[edit]

Risk of data loss
This test day covers installation testing. Hard drives will be formatted during testing and all data on that drive(s) will be lost
  • Recent installation media Netinst CD (313M) or full DVD (4.2G).
  • Machine for testing installations. All data will/may be lost on this machine!. Virtual machine is acceptable.
  • Machine providing iSCSI target. Procedure how to setup software iSCSI target in Fedora is included in relevant test case.
  • Multiple disks in test machine for several test cases. Again, virtual machine with more disk images will work.
  • Test machine with BIOS/firmware RAID and few hard drives connected into relevant controller.

How to test?[edit]

All the testing will be driven by result tables below. Just pick up a test case from some table, finish it and report result back to table. If necessary also report bug to bugzilla as mentioned Test Results chapter.

Initial setup[edit]

# yum -y install @virtualization
# service libvirtd start
# cp $FEDORA_ISO /var/lib/libvirt/images/Fedora.iso
  • To start virtual machine you can use this command:
# virt-install --accelerate -n test-machine101 -r 1024 -f /var/lib/libvirt/images/test-machine101.img -s 21 -c /var/lib/libvirt/images/Fedora.iso
  • You can destroy virtual machine right after execution of a test case with these commands:
# virsh destroy test-machine101
# virsh undefine --remove-all-storage test-machine101

Test Cases[edit]

All test cases are located at QA:AnacondaNewUI_Advanced_Storage_Test_Plan.

Test cases for usability test day are located at QA:2013-05-21_Anaconda_usability_Test_Plan.

You can use result table(s) below to access particular test case directly.

Test Results[edit]

If you have problems with any of the tests, report a bug to Bugzilla. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the result template to enter your result, as shown in the example result line.

Anaconda usability[edit]

Test Case Participants
Please fill in only participant nick/name. For the results use [1]
1. Text mode installation (anaconda-text-1)
none
Warning warn mbanas [1] [2] [3]
Warning warn mbanas [4] [5] [6]
Warning warn mbanas [7] [8]
Pass pass pkotvan
Pass pass pholica
Pass pass lnovy
Warning warn mganisin [9] [10]
Pass pass nonamedotc
Pass pass jbastian [11]
2. Create multiple Volume Groups (anaconda-lvm-1)
none
Fail fail pkotvan
none mbanas
Warning warn lnovy [12] [13]
none mganisin
Pass pass jbastian
Pass pass pholica [14]
3. iSCSI target is part of LVM Volume Group (anaconda-lvm-2)
none
none mbanas
none mganisin
Pass pass pkotvan
4. LVM on top of RAID (anaconda-lvm-3)
Pass pass pkotvan
Fail fail pholica
none mbanas
Pass pass lnovy
5. CHAP authentication against iSCSI target (anaconda-iscsi-1)
none mbanas
Pass pass pkotvan
Warning warn jbastian [15]
6. Search for specific device (anaconda-storage-1)
none mbanas
Pass pass pkotvan
Pass pass jbastian
  1. RHBZ #965460
  2. RHBZ #965477
  3. RHBZ #965498
  4. RHBZ #965509
  5. RHBZ #965526
  6. RHBZ #965543
  7. RHBZ #965561
  8. RHBZ #965571
  9. RHBZ #965580
  10. RHBZ #965592
  11. RHBZ #965774
  12. RHBZ #965623
  13. RHBZ #965660
  14. RHBZ #965805
  15. 15.0 15.1 RHBZ #966282
  16. RHBZ #962012
  17. RHBZ #966285
  18. RHBZ #966286
  19. RHBZ #966289

Advanced Storage[edit]

Feedback about Usability is Welcome
There are also special usability oriented test cases above, however you can fill usability report also for following test cases. If you would like to share your experience, please do it in this form once you'll complete a test case.
Test Case Tester(s)/Results
1. Installation on bios/firmware RAID
none
2. Installation on iSCSI
Pass pass mbanas
Pass pass pkotvan
Warning warn mganisin [1] [2]
Fail fail jscotka [3]
3. Default LVM with encryption
Pass pass nonamedotc
Pass pass mbanas
Pass pass pkotvan
Pass pass mganisin
4. Reuse /home on LVM
Pass pass nonamedotc
Pass pass mbanas
Pass pass pkotvan
5. More disks
none
Pass pass mbanas
Pass pass pkotvan
6. Separate mountpoints
Pass pass nonamedotc
Pass pass mbanas
Warning warn mganisin [4] [5]
Pass pass pkotvan
7. Reuse existing VG
Warning warn mbanas [6]
8. LVM on top of sw RAID
Pass pass mbanas
Pass pass pkotvan
9. Reuse encrypted partitions
Warning warn mbanas [7]
Pass pass pkotvan
10. Create multiple VGs
Pass pass mbanas
Warning warn jstodola [8]
Warning warn mganisin [9]
Pass pass pkotvan
  1. RHBZ #965736
  2. RHBZ #965703
  3. RHBZ #966874
  4. RHBZ #965746
  5. RHBZ #965730
  6. RHBZ #965752
  7. RHBZ #965754
  8. RHBZ #965755
  9. RHBZ #965709