m (internal link cleaning) |
|||
(8 intermediate revisions by 5 users not shown) | |||
Line 63: | Line 63: | ||
For better worded test steps please refer to Mike's pages: [[User:Roshi/QA/AtomicTests]] | For better worded test steps please refer to Mike's pages: [[User:Roshi/QA/AtomicTests]] | ||
Additionally, many of the tests that are written for Cloud Base also apply to atomic. The tests are located [ | Additionally, many of the tests that are written for Cloud Base also apply to atomic. The tests are located [[Template:Cloud_test_matrix|here]]. If you don't know if the test applies to Atomic or not then feel free to ask in #fedora-cloud on freenode. | ||
== Test Results == | == Test Results == | ||
Line 75: | Line 75: | ||
! User | ! User | ||
! Hardware | ! Hardware | ||
! [ | ! [[QA:Testcase_base_startup|Startup]] | ||
! [ | ! [[QA:Testcase_base_system_logging|System Logging]] | ||
! [ | ! [[QA:Testcase_Services_start|Services Start]] | ||
! [ | ! [[QA:Testcase_base_selinux|SELinux]] | ||
! [ | ! [[QA:Testcase_base_service_manipulation|Service Manipulation]] | ||
! References | ! References | ||
|- | |- | ||
Line 116: | Line 116: | ||
| {{result|pass}} | | {{result|pass}} | ||
| {{result|none}} | | {{result|none}} | ||
| <references/> | |||
|- | |||
| [[User:jasonbrooks|jasonbrooks]] | |||
| t440s / libvirt / cloud-init iso | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:msrb|msrb]] | |||
| t430s / kvm | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:Adimania|adimania]] | |||
| Thinkpad x250 / QEMU/KVM | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| <references/> | | <references/> | ||
|} | |} | ||
Line 126: | Line 153: | ||
! User | ! User | ||
! Hardware | ! Hardware | ||
! [ | ! [[User:Roshi/QA/AtomicTests/Atomic_Image_Boots|Image Boots]] | ||
! [ | ! [[User:Roshi/QA/AtomicTests/Atomic_Upgrade|Upgrade Works]] | ||
! [ | ! [[User:Roshi/QA/AtomicTests/Atomic_Rollback|Rollback Works]] | ||
! References | ! References | ||
|- | |- | ||
Line 147: | Line 174: | ||
! User | ! User | ||
! Hardware | ! Hardware | ||
! [ | ! [[User:Roshi/QA/AtomicTests/Atomic_Docker_Storage_Setup|docker-storage-setup]] | ||
! [ | ! [[User:Roshi/QA/AtomicTests/Atomic_Docker_Lifecycle|Docker Lifecycle]] | ||
! [ | ! [[User:Roshi/QA/AtomicTests/Atomic_Docker_ImageTest|Docker Image Test]] | ||
! References | ! References | ||
|- | |- | ||
Line 171: | Line 198: | ||
| {{result|pass|dustymabe}} | | {{result|pass|dustymabe}} | ||
| {{result|pass|dustymabe}} | | {{result|pass|dustymabe}} | ||
| <references/> | |||
|- | |||
| [[User:roshi|roshi]] | |||
| testcloud local dev branch | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:jasonbrooks|jasonbrooks]] | |||
| t440s / libvirt / cloud-init iso | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:msrb|msrb]] | |||
| t430s / kvm | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:Adimania|adimania]] | |||
| Thinkpad x250 / qemu/kvm | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| <references/> | | <references/> | ||
|- | |- |
Latest revision as of 21:44, 19 September 2016
Fedora Test Days | |
---|---|
Easily deploy and manage your Docker containers | |
Date | 22 Sep 2015 |
Time | all day |
Website | QA/Fedora_23_test_days |
IRC | #atomic (webirc) |
Mailing list | cloud |
What to test?[edit]
Today's installment of Fedora Test Day will focus on Fedora Atomic
NOTE: There is a known bug (BZ#1195761) in the Fedora Beta Atomic images, please use the patched image linked in the Test_Day:2015-09-22_Fedora_Cloud_Atomic#Grab_the_Image section.
Who's available[edit]
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
- Cloud SIG - Dusty Mabe (dustymabe),
- Quality Assurance - Roshi (roshi)
- Cloud / Infra - Adam Miller (maxamillion)
Prerequisite for Test Day[edit]
You'll need to either have an AWS account or a system that's capable of running one of the Atomic images for KVM/OpenStack.
- OpenStack installation [outside the scope of test day to set up!]
- Virt-Manager or KVM setup to run the qcow2 image.
- Run testcloud locally
We need to add links to images here.
Links for "how to setup" for the Test Day[edit]
- Refer quickstart guide for setup Atomic with Virt-manager or KVM
- Don't know how to create cloud init iso? refer running-cloud-images-locally
How to test?[edit]
We need to test several things on the Fedora Atomic release before Fedora 23 Final.
- Test with a variety of Docker images. We do want to test the Fedora images in particular, but also we need to test a wide variety of images to see if there are any hidden bugs or problems we might not have noticed yet.
- Test Cockpit to make sure that managing Docker images and connecting multiple hosts works.
- Try out Kubernetes and make sure those packages are working.
- Test out the rpm-ostree/atomic update/rollback commands and other functions.
- Try out docker-storage-config.
- What is the image/package set missing? What is unnecessary?
Grab the Image[edit]
Update the image links here
To test Fedora Atomic, we're going to use a beta image located here: [1].
Test Cases[edit]
Fedora Cloud Working Group member Dusty Mabe has quite a few tests on this Gist. For other examples, see Category:Test_Cases.
For better worded test steps please refer to Mike's pages: User:Roshi/QA/AtomicTests
Additionally, many of the tests that are written for Cloud Base also apply to atomic. The tests are located here. If you don't know if the test applies to Atomic or not then feel free to ask in #fedora-cloud on freenode.
Test Results[edit]
If you are unsure about exactly how to file a bug report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the appropriate table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the result template to enter your result, as shown in the example result line.
Atomic Basic Cloud Tests[edit]
User | Hardware | Startup | System Logging | Services Start | SELinux | Service Manipulation | References |
---|---|---|---|---|---|---|---|
Example User | Example Hardware | ||||||
maxamillion | ThinkPad T440s running testcloud from git checkout (master@9da7bf08c) | ||||||
dustymabe | Openstack Juno on F21 on Dell Laptop | ||||||
roshi | testcloud dev branch | ||||||
jasonbrooks | t440s / libvirt / cloud-init iso | ||||||
msrb | t430s / kvm | ||||||
adimania | Thinkpad x250 / QEMU/KVM |
Atomic Host Tests DO NOT EXECUTE THESE TESTS - NO UPDATE TREES ARE AVAILABLE[edit]
For the Atomic Tests, download the latest image from and execute tests
User | Hardware | Image Boots | Upgrade Works | Rollback Works | References |
---|---|---|---|---|---|
Example | Example Hardware |
Atomic Docker Tests[edit]
For the Atomic Tests, download the latest image from and execute tests
User | Hardware | docker-storage-setup | Docker Lifecycle | Docker Image Test | References |
---|---|---|---|---|---|
Example Username | Example hardware | ||||
maxamillion | ThinkPad T440s running testcloud from git checkout (master@9da7bf08c) | ||||
dustymabe | Openstack Juno on F21 on Dell Laptop | ||||
roshi | testcloud local dev branch | ||||
jasonbrooks | t440s / libvirt / cloud-init iso | ||||
msrb | t430s / kvm | ||||
adimania | Thinkpad x250 / qemu/kvm |
Bugs filled during Test Day (22nd September 2015)[edit]
BZ1265295[2] GitHub projectatomic/atomic #166[3]