Test Day:2015-05-07 Atomic: Difference between revisions

Revision as of 15:40, 18 September 2016

Fedora Test Days

Easily deploy and manage your Docker containers

Date	07 May 2015
Time	all day

Website	QA/Fedora_22_test_days
IRC	#atomic (webirc)
Mailing list	cloud

Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?

Today's installment of Fedora Test Day will focus on Fedora Atomic Host

Who's available

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

Cloud SIG - Dusty Mabe (dustymabe),
Quality Assurance - Roshi (roshi)
Cloud / Infra - David Gay (oddshocks)

Prerequisite for Test Day

You'll need to either have an AWS account or a system that's capable of running one of the Atomic images for KVM/OpenStack.

OpenStack installation [outside the scope of test day to set up!]
Virt-Manager or KVM setup to run the qcow2 image.
Run testCloud locally

A Beta RC3 image (TC1 builds failed so must use Beta RC3):
- 64 bit qcow2 [1]
- 64 bit raw.xz [2]

Links for "how to setup" for the Test Day

Refer quickstart guide for setup Atomic with Virt-manager or KVM
Don't know how to create cloud init iso? refer running-cloud-images-locally

AMIs for Test Day

Region	AMI name
us-east-1	ami-76cef41e
us-west-1	ami-6919fb2d
us-west-2	ami-2580aa15
eu-west-1	ami-817b1bf6
eu-central-1	ami-82c7fb9f
ap-southeast-1	ami-a6714cf4
ap-northeast-1	ami-f6a164f6
ap-southeast-2	ami-a97a0793
sa-east-1	ami-b79a1faa

How to test?

We need to test several things on the Fedora Atomic release before Fedora 22 Final.

Test with a variety of Docker images. We do want to test the Fedora images in particular, but also we need to test a wide variety of images to see if there are any hidden bugs or problems we might not have noticed yet.
Test Cockpit to make sure that managing Docker images and connecting multiple hosts works.
Try out Kubernetes and make sure those packages are working.
Test out the rpm-ostree/atomic update/rollback commands and other functions.
Try out docker-storage-config.
What is the image/package set missing? What is unnecessary?

Grab the Image

To test Fedora Atomic, we're going to use a beta image located here: [3]. You can also use one of the AMIs if you would prefer to do your testing on Amazon Web Services.

Test Cases

Fedora Cloud Working Group member Dusty Mabe has quite a few tests on this Gist. For other examples, see Category:Test_Cases.

For better worded test steps please refer to Mike's pages: User:Roshi/QA/AtomicTests

Additionally, many of the tests that are written for Cloud Base also apply to atomic. The tests are located here. If you don't know if the test applies to Atomic or not then feel free to ask in #fedora-cloud on freenode.

Test Results

If you are unsure about exactly how to file a bug report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the appropriate table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the result template to enter your result, as shown in the example result line.

Atomic Basic Cloud Tests

User	Hardware	Startup	System Logging	Services Start	SELinux	Service Manipulation	References
dustymabe	Openstack Juno on F21	pass dustymabe	pass dustymabe	fail dustymabe ^[1]	pass dustymabe	pass dustymabe	↑ Hit BZ#1216151
guohua	HP workstation with Fedora 22	-	-	-	-	-
maxamillion	ThinkPad T440s with Fedora Rawhide (KVM)	pass maxamillion	pass maxamillion	pass maxamillion	pass maxamillion	pass maxamillion
rtnpro	ThinkPad T440p with Fedora 21 (Vagrant: libvirt/KVM)	pass rtnpro	pass rtnpro	pass rtnpro	pass rtnpro	pass rtnpro
CAI Qian	ThinkPad T540p with Fedora 21 (KVM)	pass caiqian	pass caiqian	pass caiqian	pass caiqian	pass caiqian
oddshocks	AWS EC2	pass oddshocks	pass oddshocks	fail oddshocks ^[1]	pass oddshocks	pass oddshocks	↑ Hit BZ#1210419

Atomic Host Tests

For the Atomic Tests, download the latest image from here

User	Hardware	Image Boots	Upgrade Works	Rollback Works	References
dustymabe	Openstack Juno on F21	pass dustymabe	pass dustymabe	pass dustymabe
rtnpro	ThinkPad T440p with Fedora 21 (Vagrant-libvirt/KVM)	pass rtnpro	pass rtnpro	pass rtnpro
guohua	HP workstation with Fedora 22	-	-	-
maxamillion	ThinkPad T440s with Fedora Rawhide (KVM)	pass maxamillion	pass maxamillion	pass maxamillion
mmicene	Dell Latitude E6440 with Fedora 21 KVM	pass mmicene	pass mmicene	pass mmicene
oystercatcher	Intel dual core desktop fc22 kvm	pass oystercatcher	pass oystercatcher	pass oystercatcher
royboy626	...Atomic-20141203-21 on Fedora 21	pass royboy626 ^[1]	pass royboy626 ^[2]	pass royboy626	↑ See references Atomic Docker Tests ↑ All listed User Roshi tests passed
CAI Qian	ThinkPad T540p with Fedora 21 (KVM)	pass caiqian	pass caiqian ^[1]	pass caiqian	↑ That docker run command could hang like forever until I interrupted it, it might because of slow network here. Other time it could run successfully.

Atomic Docker Tests