Test Day:2016 05 10 Cloud: Difference between revisions

Revision as of 15:41, 18 September 2016

Fedora Test Day

Fedora Cloud Test day

Date	2016-05-10
Time	all day

Website	QA/Test Days
IRC	#fedora-test-day (webirc)
Mailing list	test

Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?

Today's installment of Fedora Test Day will focus on Cloud, Atomic Host images for Fedora 24.

Who's available

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

Development - Kushal (kushal)
Quality Assurance - Lukas Brabec (lbrabec), Petr Schindler (pschindl)

Prerequisite for Test Day

You will require at least a system with libvirt/kvm installed. Having access to any Openstack or other Cloud IAAS system where you can upload an image will be even better.

Download the images from below links

List of AMIs

Image Name	AMI id	Destination	Virt type	Vol type
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-639de403	EC2 (us-west-1)	paravirtual	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-d6d7fbb5	EC2 (ap-southeast-2)	hvm	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-7c31dc11	EC2 (us-east-1)	hvm	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-f9d1fd9a	EC2 (ap-southeast-2)	hvm	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-5d9be23d	EC2 (us-west-1)	hvm	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-2bfa074b	EC2 (us-west-2)	paravirtual	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-36855355	EC2 (ap-southeast-1)	paravirtual	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-6d36db00	EC2 (us-east-1)	hvm	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-12c4297d	EC2 (eu-central-1)	paravirtual	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-a307e3c2	EC2 (ap-northeast-1)	paravirtual	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-bb9de4db	EC2 (us-west-1)	hvm	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-643db408	EC2 (sa-east-1)	paravirtual	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-5e27ae32	EC2 (sa-east-1)	hvm	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-7f00e41e	EC2 (ap-northeast-1)	hvm	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-4fe76d3c	EC2 (eu-west-1)	paravirtual	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-42835521	EC2 (ap-southeast-1)	hvm	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-45815726	EC2 (ap-southeast-1)	hvm	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-fcd0fc9f	EC2 (ap-southeast-2)	paravirtual	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-a237dacf	EC2 (us-east-1)	paravirtual	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-3636db5b	EC2 (us-east-1)	paravirtual	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-2398e143	EC2 (us-west-1)	paravirtual	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-863fdbe7	EC2 (ap-northeast-1)	paravirtual	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-3b38b157	EC2 (sa-east-1)	paravirtual	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-18fa706b	EC2 (eu-west-1)	hvm	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-f2c62b9d	EC2 (eu-central-1)	hvm	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-c9e16bba	EC2 (eu-west-1)	paravirtual	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-5c27ae30	EC2 (sa-east-1)	hvm	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-f3c72a9c	EC2 (eu-central-1)	hvm	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-8ed2feed	EC2 (ap-southeast-2)	paravirtual	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-823edae3	EC2 (ap-northeast-1)	hvm	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-a5f508c5	EC2 (us-west-2)	paravirtual	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-fce66c8f	EC2 (eu-west-1)	hvm	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-2e82544d	EC2 (ap-southeast-1)	paravirtual	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-9dfa07fd	EC2 (us-west-2)	hvm	gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-27c62b48	EC2 (eu-central-1)	paravirtual	standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64	ami-a4fa07c4	EC2 (us-west-2)	hvm	standard

Here's a chunk which is commonly used for most Test Days. Replace XX with whatever Fedora release is pending:

An updated Fedora 24 nightly Cloud/Atomic Host image

How to test?

Boot the images on a cloud system, or on Vagrant or using testcloud on a local system.
Execute the tests.

Run the tests

Visit the result page and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the Enter result button for the test.

Exploratory testing

If you run out of test cases, congratulations! But that's not the end! You can still help out by playing around with the tool in whatever ways you can think of: try out all the things you can find, and try writing different Fedora images with it. If you have systems with different Windows versions, try running the tool on all of them. Get creative! Any problems you find please file a bug, or report to the IRC channel.

Reporting bugs

If you have problems with any of the tests, report a bug to Bugzilla. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you.

IRC Channel name: #fedora-cloud, #fedora-test-day
Server: Freenode

Test Results

Please enter your results on the result page. The results will be transferred here after the Test Day is finished.

Basic Tests

User	Profile	Base startup	System logging	Services start	SELinux	Service manipulation	References
ashutoshbhakare	Openstack	pass ^[1] pass pass		fail ^[2]	pass ^[3]		↑ Cloud Image ↑ RHBZ #1335149 Cloud Image failed ↑ Cloud Base Image
chandankumar	OpenStack [ OS1 public ]	pass ^[1]	pass ^[2]	pass ^[3]	pass ^[4]	pass ^[5]	↑ [1.] Fedora Cloud Image ↑ [2.] Fedora Cloud Image ↑ [3.] Fedora Cloud Image ↑ [4.] Fedora Cloud Image ↑ [5.] Fedora Cloud Image
coremodule	Base Install	pass
coremodule	testcloud	pass ^[1]					↑ [1]Cloud Image
dustymabe	EC2 m3.medium ami-6d36db00	pass	pass	pass	pass	pass
ganeshkadam	local kvm/libvirt	pass ^[1] pass ^[2]	pass ^[3] pass ^[4]	pass ^[5] pass ^[6]	pass ^[7] pass ^[8]	pass ^[9] pass ^[10]	↑ Fedora-Atomic image ↑ Cloud-Base image ↑ Atomic-image ↑ Cloud-Based image ↑ Atomic-image ↑ Cloud-Based image ↑ Atomic-image ↑ Cloud-Based image ↑ Atomic-image ↑ Cloud-Based image
jberkus	jberkus	pass ^[1]	pass ^[2]	fail ^[3]	pass ^[4]	pass ^[5]	↑ Atomic Host image running on AWS us-west-2 ↑ Atomic Host image running on AWS us-west-2 ↑ Atomic Host running on AWS us-west-2 Two services failed to start: UNIT LOAD ACTIVE SUB DESCRIPTION var-lib-nfs-rpc_pipefs.mount loaded failed failed RPC Pipe File System kube-controller-manager.service loaded failed failed Kubernetes Controller Manager While the second is an Atomic test, the first is not. ↑ Atomic Host on AWS us-west-2 ↑ Atomic Host on AWS us-west-2
jsedlak		pass ^[1]	pass ^[2]	pass ^[3]	pass ^[4]	pass ^[5]	↑ Atomic image ↑ Atomic image ↑ Atomic image ↑ Atomic image ↑ Atomic image
kushal	Openstack (Fedora Infra)	pass ^[1] pass ^[2] pass	pass ^[3] pass ^[4]	pass ^[5] pass ^[6]	pass ^[7] pass ^[8]	pass ^[9] pass ^[10]	↑ Cloud base image ↑ Atomic image ↑ Cloud base image ↑ Atomic image ↑ Cloud base image ↑ Atomic image ↑ Cloud base image ↑ Atomic image ↑ Cloud base image ↑ Atomic image
lbrabec	testcloud	pass ^[1]	pass ^[2]	pass ^[3]	pass ^[4]	pass ^[5]	↑ cloud and atomic ↑ cloud and atomic ↑ cloud and atomic ↑ cloud and atomic ↑ cloud and atomic
satya4ever	Openstack	pass ^[1] pass ^[2]	pass ^[3] pass ^[4]	pass ^[5] pass ^[6]	pass ^[7] pass ^[8]	pass ^[9] pass ^[10]	↑ Atomic Host Image ↑ Cloud Image QCOW2 ↑ Atomic image ↑ Cloud base image ↑ Cloud base image ↑ Atomic image ↑ Atomic image ↑ Cloud base image ↑ Atomic image ↑ Cloud base image
sumantrom	testcloud	pass ^[1]	pass ^[2]	pass ^[3]	pass ^[4]	pass ^[5]	↑ Cloud base Image ↑ Cloud base image ↑ Cloud base ↑ Cloud base ↑ Cloud base
suraj353	Openstack	pass ^[1] pass ^[2]	pass ^[3] pass ^[4]	pass ^[5] pass ^[6]	pass ^[7] pass ^[8]	pass ^[9] pass ^[10]	↑ 2. Atomic image ↑ Cloud base image ↑ Cloud base image ↑ Atomic image ↑ Atomic image ↑ Cloud base image ↑ Cloud base image ↑ Atomic image ↑ Atomic image ↑ Cloud base image

Atomic Tests

User	Profile	Image boots	Upgrade works	References
jberkus	jberkus	pass ^[1]		↑ Atomic Host on AWS us-west-2
jsedlak		pass	fail ^[1]	↑ RHBZ #1330318
kushal	Openstack (Fedora Infra)	pass ^[1]	fail ^[2]	↑ Atomic image ↑ RHBZ #1330318 Atomic image (known issue)
lbrabec	testcloud	pass	fail ^[1]	↑ RHBZ #1330318
satya4ever	Openstack	pass ^[1]	fail ^[2]	↑ Atomic image ↑ RHBZ #1330318 #1330318
suraj353	Openstack	pass ^[1]	fail ^[2]	↑ Atomic image ↑ #1330318

Docker tests

User	Profile	Docker install	Docker storage setup	Docker daemon	References
ganeshkadam	local kvm/libvirt	pass ^[1]	pass ^[2]		↑ Atomic-image ↑ Atomic-image
kushal	Openstack (Fedora Infra)	pass ^[1] pass ^[2]	pass ^[3] pass ^[4]	pass ^[5] pass ^[6]	↑ Cloud base image ↑ Atomic image ↑ Atomic image ↑ Atomic image ↑ Cloud base image ↑ Atomic image
lbrabec	testcloud	pass ^[1]	pass ^[2]	pass ^[3]	↑ cloud and atomic ↑ cloud and atomic ↑ cloud and atomic
satya4ever	Openstack	pass ^[1] pass ^[2]	pass ^[3] pass ^[4]	pass ^[5] pass ^[6]	↑ Cloud base image ↑ Atomic image ↑ Cloud base image ↑ Atomic image ↑ Cloud base image ↑ Atomic image
sumantrom	testcloud	pass ^[1]	pass ^[2]	pass ^[3]	↑ Cloud base Image ↑ Cloud Base ↑ Cloud Base Image
suraj353	Openstack	pass ^[1] pass ^[2]	pass ^[3] pass ^[4]	pass ^[5] pass ^[6]	↑ Cloud base image ↑ Atomic image ↑ Cloud base image ↑ Atomic image ↑ Cloud base image ↑ Atomic image

More Atomic related tests

User	Profile	Atomic command	Atomic read only mounts	Atomic tmp mount	Atomic tmp writable	Atomic journal written	References
ganeshkadam	local kvm/libvirt	fail ^[1]	pass ^[2]	pass ^[3]	pass ^[4]	pass ^[5]	↑ Atomic-image ↑ Atomic-image ↑ Atomic-image ↑ Atomic-image ↑ Atomic-image
kushal	Openstack (Fedora Infra)	fail ^[1]	pass ^[2]	pass ^[3]	pass ^[4]	pass ^[5]	↑ RHBZ #1334588 Atomic image, it is failing with a system error. ↑ Atomic image ↑ Atomic image ↑ Atomic image ↑ Atomic image
lbrabec	testcloud	fail ^[1]	pass	pass	pass	pass	↑ RHBZ #1334588
suraj353	Openstack	fail ^[1]	pass ^[2]	pass ^[3]	pass ^[4]	pass ^[5]	↑ #1334588, ↑ Atomic image ↑ Atomic image ↑ Atomic image ↑ Atomic image

Vagrant test

User	Profile	eth0 naming	References

[1] Cloud Image

[2] RHBZ #1335149 Cloud Image failed

[3] Cloud Base Image

[4] [1.] Fedora Cloud Image

[5] [2.] Fedora Cloud Image

[6] [3.] Fedora Cloud Image

[7] [4.] Fedora Cloud Image

[8] [5.] Fedora Cloud Image

[9] [1]Cloud Image

[10] Fedora-Atomic image

[11] Cloud-Base image

[12] Atomic-image

[13] Cloud-Based image

[14] Atomic-image

[15] Cloud-Based image

[16] Atomic-image

[17] Cloud-Based image

[18] Atomic-image

[19] Cloud-Based image

[20] Atomic Host image running on AWS us-west-2

[21] Atomic Host image running on AWS us-west-2

[22] Atomic Host running on AWS us-west-2 Two services failed to start: UNIT LOAD ACTIVE SUB DESCRIPTION var-lib-nfs-rpc_pipefs.mount loaded failed failed RPC Pipe File System kube-controller-manager.service loaded failed failed Kubernetes Controller Manager While the second is an Atomic test, the first is not.

[23] Atomic Host on AWS us-west-2

[24] Atomic Host on AWS us-west-2

[25] Atomic image

[26] Atomic image

[27] Atomic image

[28] Atomic image

[29] Atomic image

[30] Cloud base image

[31] Atomic image

[32] Cloud base image

[33] Atomic image

[34] Cloud base image

[35] Atomic image

[36] Cloud base image

[37] Atomic image

[38] Cloud base image

[39] Atomic image

[40] ud and atomic

[41] ud and atomic

[42] ud and atomic

[43] ud and atomic

[44] ud and atomic

[45] Atomic Host Image

[46] Cloud Image QCOW2

[47] Atomic image

[48] Cloud base image

[49] Cloud base image

[50] Atomic image

[51] Atomic image

[52] Cloud base image

[53] Atomic image

[54] Cloud base image

[55] Cloud base Image

[56] Cloud base image

[57] Cloud base

[58] Cloud base

[59] Cloud base

[1]

[2]

[3]

[1]

[2]

[3]

[4]

[5]

[1]

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[1]

[2]

[3]

[4]

[5]

[1]

[2]

[3]

[4]

[5]

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[1]

[2]

[3]

[4]

[5]

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[1]

[2]

[3]

[4]

[5]

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[1]

[1]

[1]

[2]

[1]

[1]

[2]

[1]

[2]

[1]

[2]

[1]

[2]

[3]

[4]

[5]

[6]

[1]

[2]

[3]

[1]

[2]

[3]

[4]

[5]

[6]

[1]

[2]

[3]

[1]

[2]

@@ Line 152: / Line 152: @@
 ! User
 ! Profile
-! [http://fedoraproject.org/wiki/QA:Testcase_base_startup Base startup]
+! [[QA:Testcase_base_startup|Base startup]]
-! [http://fedoraproject.org/wiki/QA:Testcase_base_system_logging System logging]
+! [[QA:Testcase_base_system_logging|System logging]]
 ! [http://fedoraproject.org/wiki/QA:Testcase_Services_start Services start]
-! [http://fedoraproject.org/wiki/QA:Testcase_base_selinux SELinux]
+! [[QA:Testcase_base_selinux|SELinux]]
 ! [http://fedoraproject.org/wiki/QA:Testcase_base_service_manipulation Service manipulation]
 ! References
@@ Line 294: / Line 294: @@
 ! User
 ! Profile
-! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Image_Boots Image boots]
+! [[User:Roshi/QA/AtomicTests/Atomic_Image_Boots|Image boots]]
-! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Upgrade Upgrade works]
+! [[User:Roshi/QA/AtomicTests/Atomic_Upgrade|Upgrade works]]
 ! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Rollback Rollback works]
 ! References
@@ Line 457: / Line 457: @@
 ! User
 ! Profile
-! [http://fedoraproject.org/wiki/QA/Draft/Testcase_Vagrant_eth0_naming eth0 naming]
+! [[QA/Draft/Testcase_Vagrant_eth0_naming|eth0 naming]]
 ! References

Search