From Fedora Project Wiki
m (internal link cleaning)
 
(52 intermediate revisions by 16 users not shown)
Line 14: Line 14:
== What to test? ==
== What to test? ==


Today's instalment of Fedora Test Day will focus on '''Fedora Atomic Host'''
Today's installment of Fedora Test Day will focus on '''Fedora Atomic Host'''


== Who's available ==
== Who's available ==
Line 21: Line 21:
* Cloud SIG - [[user:dustymabe|Dusty Mabe]] (dustymabe),
* Cloud SIG - [[user:dustymabe|Dusty Mabe]] (dustymabe),
* Quality Assurance - [[User:Roshi|Roshi]] (roshi)
* Quality Assurance - [[User:Roshi|Roshi]] (roshi)
 
* Cloud / Infra - [[user:oddshocks|David Gay]] (oddshocks)


== Prerequisite for Test Day ==  
== Prerequisite for Test Day ==  
Line 31: Line 31:
* Run [http://github.com/Rorosha/testCloud testCloud] locally
* Run [http://github.com/Rorosha/testCloud testCloud] locally


* An updated [https://kojipkgs.fedoraproject.org//work/tasks/8904/8118904/Fedora-Cloud-Atomic-20141112-21.x86_64.qcow2 test image], or later nightly live image if one is released before 20 November.
* A Beta RC3 image (TC1 builds failed so must use Beta RC3):
** 64 bit qcow2 [http://download.fedoraproject.org/pub/fedora/linux/releases/test/22_Beta/Cloud/x86_64/Images/Fedora-Cloud-Atomic-22_Beta-20150415.x86_64.qcow2]   
** 64 bit raw.xz [http://download.fedoraproject.org/pub/fedora/linux/releases/test/22_Beta/Cloud/x86_64/Images/Fedora-Cloud-Atomic-22_Beta-20150415.x86_64.raw.xz]


== Links for "how to setup" for the Test Day ==  
== Links for "how to setup" for the Test Day ==  
Line 46: Line 48:
|-
|-
|us-east-1       
|us-east-1       
|ami-XXXXXXXXX
|ami-76cef41e
|-
|-
|us-west-1
|us-west-1
|ami-XXXXXXXXX
|ami-6919fb2d
|-
|-
|us-west-2       
|us-west-2       
|ami-XXXXXXXXX
|ami-2580aa15
|-
|-
|eu-west-1       
|eu-west-1       
|ami-XXXXXXXXX
|ami-817b1bf6
|-
|-
|eu-central-1     
|eu-central-1     
|ami-XXXXXXXXX
|ami-82c7fb9f
|-
|-
|ap-southeast-1   
|ap-southeast-1   
|ami-XXXXXXXXX
|ami-a6714cf4
|-
|-
|ap-northeast-1   
|ap-northeast-1   
|ami-XXXXXXXXX
|ami-f6a164f6
|-
|-
|ap-southeast-2   
|ap-southeast-2   
|ami-XXXXXXXXX
|ami-a97a0793
|-
|-
|sa-east-1       
|sa-east-1       
|ami-XXXXXXXXX
|ami-b79a1faa
|}
|}


Line 86: Line 88:
=== '''Grab the Image''' ===
=== '''Grab the Image''' ===


To test Fedora Atomic, we're going to use a Koji build located here: [https://kojipkgs.fedoraproject.org//work/tasks/8904/8118904/Fedora-Cloud-Atomic-20141112-21.x86_64.qcow2]. You can also use one of the AMIs if you would prefer to do your testing on Amazon Web Services.
To test Fedora Atomic, we're going to use a beta image located here: [http://download.fedoraproject.org/pub/fedora/linux/releases/test/22_Beta/Cloud/x86_64/Images/Fedora-Cloud-Atomic-22_Beta-20150415.x86_64.qcow2]. You can also use one of the AMIs if you would prefer to do your testing on Amazon Web Services.


== Test Cases ==
== Test Cases ==
Line 93: Line 95:


For better worded test steps please refer to Mike's pages: [[User:Roshi/QA/AtomicTests]]
For better worded test steps please refer to Mike's pages: [[User:Roshi/QA/AtomicTests]]
Additionally, many of the tests that are written for Cloud Base also apply to atomic. The tests are located [[Template:Cloud_test_matrix|here]]. If you don't know if the test applies to Atomic or not then feel free to ask in #fedora-cloud on freenode.


== Test Results ==
== Test Results ==


=== Atomic Tests ===
If you are unsure about exactly how to file a bug report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the appropriate table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line.
 
 
=== Atomic Basic Cloud Tests ===


{|
{|
! User
! User
! Hardware
! Hardware
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Image_Boots Image Boots]
! [[QA:Testcase_base_startup|Startup]]
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Upgrade Upgrade Works]
! [[QA:Testcase_base_system_logging|System Logging]]
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Rollback Rollback Works]
! [[QA:Testcase_Services_start|Services Start]]
! [[QA:Testcase_base_selinux|SELinux]]
! [[QA:Testcase_base_service_manipulation|Service Manipulation]]
! References
! References
|-
|-
| [[User:dustymabe|dustymabe]]
| [[User:dustymabe|dustymabe]]
| Openstack Juno on F21
| Openstack Juno on F21
| {{result|pass}}   
| {{result|pass|dustymabe}}
| {{result|pass}}   
| {{result|pass|dustymabe}} 
| {{result|pass}}   
| {{result|fail|dustymabe}} <ref>Hit [https://bugzilla.redhat.com/show_bug.cgi?id=1216151 BZ#1216151]</ref>
| {{result|pass|dustymabe}}
| {{result|pass|dustymabe}}
| <references/>
|-
| [[User:guohua|guohua]]
| HP workstation with Fedora 22
| {{result|-}} 
| {{result|-}} 
| {{result|-}}
| {{result|-}} 
| {{result|-}} 
| <references/>
|-
| [[User:maxamillion|maxamillion]]
| ThinkPad T440s with Fedora Rawhide (KVM)
| {{result|pass|maxamillion}}   
| {{result|pass|maxamillion}}   
| {{result|pass|maxamillion}}
| {{result|pass|maxamillion}}   
| {{result|pass|maxamillion}} 
| <references/>
|-
| [[User:rtnpro|rtnpro]]
| ThinkPad T440p with Fedora 21 (Vagrant: libvirt/KVM)
| {{result|pass|rtnpro}} 
| {{result|pass|rtnpro}} 
| {{result|pass|rtnpro}} 
| {{result|pass|rtnpro}} 
| {{result|pass|rtnpro}} 
| <references/>
|-
| [[User:caiqian|CAI Qian]]
| ThinkPad T540p with Fedora 21 (KVM)
| {{result|pass|caiqian}} 
| {{result|pass|caiqian}} 
| {{result|pass|caiqian}}
| {{result|pass|caiqian}} 
| {{result|pass|caiqian}} 
| <references/>
| <references/>
|-
|-
| [[User:oddshocks|oddshocks]]
| AWS EC2
| {{result|pass|oddshocks}}
| {{result|pass|oddshocks}}
| {{result|fail|oddshocks}} <ref>Hit [https://bugzilla.redhat.com/show_bug.cgi?id=1216151 BZ#1210419]</ref>
| {{result|pass|oddshocks}}
| {{result|pass|oddshocks}}
| <references/>
|}
|}


=== Docker Tests ===
=== Atomic Host Tests ===
 
For the Atomic Tests, download the latest image from [http://download.fedoraproject.org/pub/fedora/linux/releases/test/22_Beta/Cloud/x86_64/Images/Fedora-Cloud-Atomic-22_Beta-20150415.x86_64.qcow2 here]


{|
{|
! User
! User
! Hardware
! Hardware
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Docker_Storage_Setup docker-storage-setup]
! [[User:Roshi/QA/AtomicTests/Atomic_Image_Boots|Image Boots]]
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Docker_Lifecycle Docker Lifecycle]
! [[User:Roshi/QA/AtomicTests/Atomic_Upgrade|Upgrade Works]]
! [[User:Roshi/QA/AtomicTests/Atomic_Rollback|Rollback Works]]
! References
! References
|-
|-
| [[User:larsks|larsks]]
| [[User:dustymabe|dustymabe]]
| openstack
| Openstack Juno on F21
| {{result|pass}} <ref>Appears to have run automatically (and successfully).</ref>
| {{result|pass|dustymabe}}
| {{result|pass}}  <ref>Started/interacted with/stopped fedora and ubuntu containers.</ref>
| {{result|pass|dustymabe}}
| {{result|pass|dustymabe}}
| <references/>
|-
| [[User:rtnpro|rtnpro]]
| ThinkPad T440p with Fedora 21 (Vagrant-libvirt/KVM)
| {{result|pass|rtnpro}} 
| {{result|pass|rtnpro}}   
| {{result|pass|rtnpro}}
| <references/>
| <references/>
|-
|-
| [[User:amrithajij|amrithajij]]
| [[User:guohua|guohua]]
| KVM
| HP workstation with Fedora 22
| {{result|warn}}  <ref>Manually expanded the qcow2 image fron host and then ran journalctl -o cat --unit docker-storage-setup.service.</ref>
| {{result|-}}   
| {{result|pass}}
| {{result|-}} 
| {{result|-}}  
| <references/>
| <references/>
|-
|-
| [[User:roshi|roshi]]
| [[User:maxamillion|maxamillion]]
| KVM
| ThinkPad T440s with Fedora Rawhide (KVM)
| {{result|pass}}   
| {{result|pass|maxamillion}}   
| {{result|pass}}   
| {{result|pass|maxamillion}}   
| {{result|pass|maxamillion}}
| <references/>
| <references/>
|-
|-
| [[User:sinnykumari|sinnykumari]]
| [[User:mmicene|mmicene]]
| KVM
| Dell Latitude E6440 with Fedora 21 KVM
| {{result|warn}}  <ref>In test case https://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Docker_Storage_Setup
| {{result|pass|mmicene}}   
 
| {{result|pass|mmicene}} 
changes get reflected after rebooting VM</ref>
| {{result|pass|mmicene}}   
|  
| <references/>
|-
| [[User:oystercatcher|oystercatcher]]
| Intel dual core desktop  fc22  kvm
| {{result|pass|oystercatcher}}
| {{result|pass|oystercatcher}}
| {{result|pass|oystercatcher}}
| <references/>
| <references/>
|-
|-
| [[User:sten|sten]]
| [[User:royboy626|royboy626]]
| openstack RHOSP5 x64
| ...Atomic-20141203-21 on Fedora 21
| {{result|pass}}
| {{result|pass|royboy626}} <ref>See references Atomic Docker Tests</ref>
| {{result|pass||1164058}}
| {{result|pass|royboy626}} <ref>All listed User Roshi tests passed</ref>  
 
| {{result|pass|royboy626}}
That confused me, but just using "sudo docker foo" works. </ref>
| <references/>
| <references/>
|-
|-
| [[User:jzb|jzb]]
| [[User:caiqian|CAI Qian]]
| KVM
| ThinkPad T540p with Fedora 21 (KVM)
| {{result|pass}} <ref>Works a treat.</ref>
| {{result|pass|caiqian}}
| {{result|pass}} <ref>All good here.</ref>
| {{result|pass|caiqian}} <ref>That docker run command could hang like forever until I interrupted it, it might because of slow network here. Other time it could run successfully.</ref>  
| {{result|pass|caiqian}} 
| <references/>
| <references/>
|}
=== Atomic Docker Tests ===
For the Atomic Tests, download the latest image from [http://download.fedoraproject.org/pub/fedora/linux/releases/test/22_Beta/Cloud/x86_64/Images/Fedora-Cloud-Atomic-22_Beta-20150415.x86_64.qcow2 here]
{|
! User
! Hardware
! [[User:Roshi/QA/AtomicTests/Atomic_Docker_Storage_Setup|docker-storage-setup]]
! [[User:Roshi/QA/AtomicTests/Atomic_Docker_Lifecycle|Docker Lifecycle]]
! [[User:Roshi/QA/AtomicTests/Atomic_Docker_ImageTest|Docker Image Test]]
! References
|-
|-
| [[User:dustymabe|dustymabe]]
| [[User:dustymabe|dustymabe]]
| Openstack Juno on F21
| Openstack Juno on F21
| {{result|pass}}
| {{result|pass|dustymabe}}
| {{result|pass}}
| {{result|warn|dustymabe}} <ref>Hit [https://bugzilla.redhat.com/show_bug.cgi?id=1205454 BZ#1205454]</ref>
| {{result|pass|dustymabe}}
| <references/>
| <references/>
|-
|-
| [[User:lalatendu|lalatendu]]
| [[User:maxamillion|maxamillion]]
| VM on virt-manager
| ThinkPad T440s with Fedora Rawhide (KVM)
| {{result|pass}}
| {{result|pass|maxamillion}}
</ref>
| {{result|pass|maxamillion}}
| {{result|pass}}
| {{result|pass|maxamillion}}
| <references/>
| <references/>
|-
|-
| [[User:nkhare|nkhare]]
| [[User:mmicene|mmicene]]
| vm
| Dell Latitude E6440 with Fedora 21 KVM
|  
| {{result|pass|mmicene}} 
| {{result|pass}}   
| {{result|pass|mmicene}}   
| {{result|pass|mmicene}}   
| <references/>
| <references/>
|-
|-
| [[User:oystercatcher|oystercatcher]]
| Intel dual core desktop  fc22  kvm
| {{result|pass|oystercatcher}}
| {{result|pass|oystercatcher}}
| {{result|pass|oystercatcher}}
| <references/>
|-
| [[User:rtnpro|rtnpro]]
| ThinkPad T440p with Fedora 21 (Vagrant-libvirt/KVM)
| {{result|pass|rtnpro}}
| {{result|pass|rtnpro}}
| {{result|pass|rtnpro}}
| <references/>
|-
| [[User:royboy626|royboy626]]
| ...Atomic-20141203-21 on Fedora 21
| {{result|pass|royboy626}} <ref> Got here too early, downloaded file was 20141203-21</ref>
| {{result|pass|royboy626}} <ref> SeLinux caused virt net problem. is preventing /usr/bin/qemu-system-x86_64 from using the execmem \
Boot base metal host with selinux=0 on linux line cured.</ref>
| {{result|pass|royboy626}}
| <references/>
|-
| [[User:caiqian|CAI Qian]]
| ThinkPad T540p with Fedora 21 (KVM)
| {{result|pass|caiqian}} 
| {{result|pass|caiqian}} 
| {{result|pass|caiqian}} 
| <references/>
|}
|}


=== Bugs filled during Test Day (7th May 2015) ===
=== Bugs filled during Test Day (7th May 2015) ===
[https://bugzilla.redhat.com/show_bug.cgi?id=1166073 1166073]
[https://bugzilla.redhat.com/show_bug.cgi?id=1219700 BZ#1219700]
[https://bugzilla.redhat.com/show_bug.cgi?id=1166082 1166082]


=== Other Common Bugs ===
=== Other Common Bugs ===
[https://bugzilla.redhat.com/show_bug.cgi?id=1164058 1164058]
 
* [https://bugzilla.redhat.com/show_bug.cgi?id=1216151 BZ#1216151]
* [https://bugzilla.redhat.com/show_bug.cgi?id=1205454 BZ#1205454] Workaround: Use "docker run -it --rm busybox sleep 15" or another longer running command instead of "docker run -it --rm busybox true" for testing


== Long comments ==
== Long comments ==
<references group="long" />
<references group="long" />


[[Category:Fedora 22 Test Days]]
[[Category:Fedora 22 Test Days]]

Latest revision as of 21:43, 19 September 2016

Fedora Test Days
Easily deploy and manage your Docker containers
Date 07 May 2015
Time all day
Website QA/Fedora_22_test_days
IRC #atomic (webirc)
Mailing list cloud


Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?[edit]

Today's installment of Fedora Test Day will focus on Fedora Atomic Host

Who's available[edit]

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

Prerequisite for Test Day[edit]

You'll need to either have an AWS account or a system that's capable of running one of the Atomic images for KVM/OpenStack.

  • OpenStack installation [outside the scope of test day to set up!]
  • Virt-Manager or KVM setup to run the qcow2 image.
  • Run testCloud locally
  • A Beta RC3 image (TC1 builds failed so must use Beta RC3):
    • 64 bit qcow2 [1]
    • 64 bit raw.xz [2]

Links for "how to setup" for the Test Day[edit]

AMIs for Test Day[edit]

Region AMI name
us-east-1 ami-76cef41e
us-west-1 ami-6919fb2d
us-west-2 ami-2580aa15
eu-west-1 ami-817b1bf6
eu-central-1 ami-82c7fb9f
ap-southeast-1 ami-a6714cf4
ap-northeast-1 ami-f6a164f6
ap-southeast-2 ami-a97a0793
sa-east-1 ami-b79a1faa

How to test?[edit]

We need to test several things on the Fedora Atomic release before Fedora 22 Final.

  • Test with a variety of Docker images. We do want to test the Fedora images in particular, but also we need to test a wide variety of images to see if there are any hidden bugs or problems we might not have noticed yet.
  • Test Cockpit to make sure that managing Docker images and connecting multiple hosts works.
  • Try out Kubernetes and make sure those packages are working.
  • Test out the rpm-ostree/atomic update/rollback commands and other functions.
  • Try out docker-storage-config.
  • What is the image/package set missing? What is unnecessary?

Grab the Image[edit]

To test Fedora Atomic, we're going to use a beta image located here: [3]. You can also use one of the AMIs if you would prefer to do your testing on Amazon Web Services.

Test Cases[edit]

Fedora Cloud Working Group member Dusty Mabe has quite a few tests on this Gist. For other examples, see Category:Test_Cases.

For better worded test steps please refer to Mike's pages: User:Roshi/QA/AtomicTests

Additionally, many of the tests that are written for Cloud Base also apply to atomic. The tests are located here. If you don't know if the test applies to Atomic or not then feel free to ask in #fedora-cloud on freenode.

Test Results[edit]

If you are unsure about exactly how to file a bug report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the appropriate table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the result template to enter your result, as shown in the example result line.


Atomic Basic Cloud Tests[edit]

User Hardware Startup System Logging Services Start SELinux Service Manipulation References
dustymabe Openstack Juno on F21
Pass pass dustymabe
Pass pass dustymabe
Fail fail dustymabe
[1]
Pass pass dustymabe
Pass pass dustymabe
  1. ↑ Hit BZ#1216151
guohua HP workstation with Fedora 22
-
-
-
-
-
maxamillion ThinkPad T440s with Fedora Rawhide (KVM)
rtnpro ThinkPad T440p with Fedora 21 (Vagrant: libvirt/KVM)
Pass pass rtnpro
Pass pass rtnpro
Pass pass rtnpro
Pass pass rtnpro
Pass pass rtnpro
CAI Qian ThinkPad T540p with Fedora 21 (KVM)
Pass pass caiqian
Pass pass caiqian
Pass pass caiqian
Pass pass caiqian
Pass pass caiqian
oddshocks AWS EC2
Pass pass oddshocks
Pass pass oddshocks
Fail fail oddshocks
[1]
Pass pass oddshocks
Pass pass oddshocks
  1. ↑ Hit BZ#1210419

Atomic Host Tests[edit]

For the Atomic Tests, download the latest image from here

User Hardware Image Boots Upgrade Works Rollback Works References
dustymabe Openstack Juno on F21
Pass pass dustymabe
Pass pass dustymabe
Pass pass dustymabe
rtnpro ThinkPad T440p with Fedora 21 (Vagrant-libvirt/KVM)
Pass pass rtnpro
Pass pass rtnpro
Pass pass rtnpro
guohua HP workstation with Fedora 22
-
-
-
maxamillion ThinkPad T440s with Fedora Rawhide (KVM)
mmicene Dell Latitude E6440 with Fedora 21 KVM
Pass pass mmicene
Pass pass mmicene
Pass pass mmicene
oystercatcher Intel dual core desktop fc22 kvm
Pass pass oystercatcher
Pass pass oystercatcher
Pass pass oystercatcher
royboy626 ...Atomic-20141203-21 on Fedora 21
Pass pass royboy626
[1]
Pass pass royboy626
[2]
Pass pass royboy626
  1. ↑ See references Atomic Docker Tests
  2. ↑ All listed User Roshi tests passed
CAI Qian ThinkPad T540p with Fedora 21 (KVM)
Pass pass caiqian
Pass pass caiqian
[1]
Pass pass caiqian
  1. ↑ That docker run command could hang like forever until I interrupted it, it might because of slow network here. Other time it could run successfully.

Atomic Docker Tests[edit]

For the Atomic Tests, download the latest image from here

User Hardware docker-storage-setup Docker Lifecycle Docker Image Test References
dustymabe Openstack Juno on F21
Pass pass dustymabe
Warning warn dustymabe
[1]
Pass pass dustymabe
  1. ↑ Hit BZ#1205454
maxamillion ThinkPad T440s with Fedora Rawhide (KVM)
mmicene Dell Latitude E6440 with Fedora 21 KVM
Pass pass mmicene
Pass pass mmicene
Pass pass mmicene
oystercatcher Intel dual core desktop fc22 kvm
Pass pass oystercatcher
Pass pass oystercatcher
Pass pass oystercatcher
rtnpro ThinkPad T440p with Fedora 21 (Vagrant-libvirt/KVM)
Pass pass rtnpro
Pass pass rtnpro
Pass pass rtnpro
royboy626 ...Atomic-20141203-21 on Fedora 21
Pass pass royboy626
[1]
Pass pass royboy626
[2]
Pass pass royboy626
  1. ↑ Got here too early, downloaded file was 20141203-21
  2. ↑ SeLinux caused virt net problem. is preventing /usr/bin/qemu-system-x86_64 from using the execmem \ Boot base metal host with selinux=0 on linux line cured.
CAI Qian ThinkPad T540p with Fedora 21 (KVM)
Pass pass caiqian
Pass pass caiqian
Pass pass caiqian

Bugs filled during Test Day (7th May 2015)[edit]

BZ#1219700

Other Common Bugs[edit]

  • BZ#1216151
  • BZ#1205454 Workaround: Use "docker run -it --rm busybox sleep 15" or another longer running command instead of "docker run -it --rm busybox true" for testing

Long comments[edit]

Retrieved from "https://fedoraproject.org/w/index.php?title=Test_Day:2015-05-07_Atomic&oldid=474235"