From Fedora Project Wiki

Line 732: Line 732:
! References
! References
|-
|-
Heat functionality:
Heat functionality:
{|
! User
! [[QA:Testcase_run_Tempest_tests|Tempest tests]]
! [[QA:Testcase_build_an_OpenStack_guest_image_with_Oz|Build an image with Oz]]
! [[QA:Testcase_run_the_OpenStack_smoke_tests|Smoke tests]]
! References


|-
|-
Line 750: Line 743:
|-
|-


{|
! User
! [[QA:Testcase_run_Tempest_tests|Tempest tests]]
! [[QA:Testcase_build_an_OpenStack_guest_image_with_Oz|Build an image with Oz]]
! [[QA:Testcase_run_the_OpenStack_smoke_tests|Smoke tests]]
! References


|-
|-

Revision as of 15:10, 25 September 2012

OpenStack Test Days
}}}

Date 2012-09-18 and 2012-09-25
Time all day

IRC #fedora-openstack (webirc)


This test day is being rerun on Tue 2012-09-25 (using this same page)
Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

Who's available

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

Prerequisite for Test Day

  • Hardware virtualization support (e.g. Intel VT or AMD-V).
  • Up to 10-20Gb free disk space. Guest images take up a lot of space.
Hardware Requirements
You can do basic testing of OpenStack in a virtual machine, which is auto detected by the install script below

This is a Fedora 18 test day, but we have OpenStack Folsom packages available for both Fedora 18 and Fedora 17.

Fedora 18

Fedora 18 Alpha live image can be used to install a bare metal or virtual machine. Please record common Fedora 18 issues here:

  • Video doesn't work in a VM unless video type is set to 'vga' #848930
  • Auto partitioning wipes the disk without warning #855976
  • The installing packages step can take over 30 minutes #856993
  • The "swipe to remove" screen lock causes X corruption #857017

Alternatively, try updating from Fedora 17 to Fedora 18 using yum.

Fedora 17

Recent Fedora 17 live image respins can be used to install a bare metal or virtual machine.

How to test?

Follow the steps below to prepare the machine, then follow each of the test cases in order.

Configure sudo

Add your account to sudoers, which can be done from a root prompt like:

 (umask 337; echo "non_root_user ALL = (ALL) NOPASSWD: ALL" > /etc/sudoers.d/testday)

Update your machine

Make sure you have all the current updates for it installed:

 sudo yum --enablerepo=updates-testing clean all
 sudo yum update -y

Optionally Load nbd

If you don't perform this optional step, then libguestfs will be used to inject files into qcow2 images. Note however that is slower, especially if testing openstack within a VM

sudo modprobe nbd
echo nbd | sudo tee -a /etc/modules-load.d/nbd.conf

Put SELinux into Permissive Mode

While SELinux mostly works with OpenStack services there are a few issues

sudo sed -i 's/^SELINUX=.*/SELINUX=permissive/' /etc/selinux/config
sudo setenforce permissive

Please do note any AVC _denials_ you see in /var/log/audit/audit.log and file them in bugzilla, and update this list:

  • RHBZ #856548 general - Intermittent failures adding users to groups
  • RHBZ #856653 glance - api can't access mysql
  • RHBZ #837330 glance - 'name_connect' accesses on the tcp_socket
  • RHBZ #809198 rsync/swift replicator - rsync restricted by selinux

Install and setup all Openstack services on a single node

 sudo curl http://repos.fedorapeople.org/repos/openstack/openstack-folsom/fedora-openstack-folsom.repo -o /etc/yum.repos.d/fedora-openstack-folsom.repo

FEDORA 18 ONLY To avoid issues with stale libvirt, netcf, virt-viewer packages in official Fedora 18 repositories please enable this side repository containing the latest such packages:

 sudo curl http://repos.fedorapeople.org/repos/openstack/f18-testing/f18-testing.repo -o /etc/yum.repos.d/fedora-testing.repo

FEDORA 18 ONLY To workaround RHBZ #858311 issue with libvirtd auth:

 sudo yum install -y libvirt-daemon
 sudo sed -i 's/#\(auth_unix_r[ow] = "none"\)/\1/' /etc/libvirt/libvirtd.conf

FEDORA 18 ONLY There is a SELinux bug RHBZ #860201 causing openstack-demo-install to exit early, when installing withing a VM. Please apply this workaround only if installing within a VM:

 sudo yum install -y openstack-utils
 sudo sed -i 's/setsebool -P/setsebool/' /usr/bin/openstack-demo-install

To avoid issues with yum hanging on futex RHBZ #860120 when installing the package after openstack-dashboard, please ensure it's installed independently:

 sudo yum remove -y openstack-dashboard
 sudo yum install -y openstack-dashboard

So now the yum repositories are in place, so we'll install the openstack-demo-install script. This script will install all OpenStack services on a single node, including: nova, glance, quantum, cinder, swift, keystone, dashboard. Note it configures and enables all but the quantum service at this time:

 sudo yum install -y openstack-utils
 sudo openstack-demo-install

Note this is a major test in itself, so please record any issues encountered.

Now copy the keystonerc file created by the install script above to your home directory, so that it can be easily sourced to provide the credentials used by the various OpenStack command line utilities.

 sudo cp /root/keystonerc ~

Known issues

Setup OpenStack volumes

The OpenStack volume service provides persistent block level storage to instances.

This is a commonly used service, so please enable using

Setup Cinder Volumes

Install and setup Quantum on a single node

As an option, you can replace the network manager internal to the OpenStack Nova project with Quantum.

Enable Quantum networking

Test Cases

Basic setup:

  1. Add SSH keypair
  2. Register guest images
  3. Create nova network

Core functionality:

  1. Launch an instance
  2. Attach a volume
  3. Floating IPs
  4. Separate compute node

Nova boot-from-volume:

  1. Create a builder instance
  2. Create and boot from a bootable volume
  3. Create an image from a running volume-backed instance

Quantum functionality:

  1. Configure and use a network topology in Quantum

Swift functionality:

  1. Upload and download files
  2. Upload Segmented File
  3. Test Auditor/Replicator
  4. Add Storage Device to ring

Dashboard functionality:

  1. Basic dashboard setup and login
  2. Launch/terminate an instance with the dashboard
  3. Managing projects and users with the dashboard
  4. VNC access to instances through the dashboard

Heat basic functionality (recommended for all developers):

  1. Basic heat setup and configuration
  2. Launch a basic wordpress stack
  3. Stop Heat services and uninstall Heat

Heat advanced functionality (recommended for heat developers):

  1. Run nose unit tests
  2. Run Load Balancing testcase
  3. Run Relational Database service testcase
  4. Run EIP testcase
  5. Run EBS testcase
  6. Run EBS and EIP testcase
  7. Run Single Instance Wordpress testcase
  8. Run Compsed Instances testcase
  9. Run 2 instance EBS testcase
  10. Run 2 instances with EBS and EIP
  11. Run 2 instance Wordpress testcase
  12. Run HAProxy Single Instance testcase
  13. Run CFN API actions testcase
  14. Run AutoScaling testcase

Extra credit:

  1. Tempest tests
  2. Build an image with Oz
  3. Smoke tests

Test Results

If you have problems with any of the tests, report a bug to Bugzilla usually for one of the openstack-nova, openstack-glance, openstack-keystone, openstack-cinder,openstack-quantum, openstack-swift or heat components. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you.

Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the result template to enter your result, as shown in the example result line.

Basic setup:

User openstack-demo-install Create Cinder Volumes Add SSH keypair Register images Create nova network References
Sample User
none
none
Pass pass
Warning warn
[1]
Fail fail
[2]
  1. Test pass, but also encountered RHBZ #54321
  2. RHBZ #12345
Gary Kotton
Pass pass
none
Pass pass
[1]
Pass pass
[2]
  1. Missing package euca2ools, and old keystone syntax.
  2. Test pass, whilst in state SAVING command glance image-list takes a very long time (f16 image)
Jan van Eldik
Pass pass
[1]
Pass pass
Pass pass
Pass pass
[2] [3]
Pass pass
  1. Typo in openstack-status script RHBZ #858174
  2. Test pass, whilst in state SAVING command glance image-list takes a very long time (f16 image)
  3. upload of ami-tty leaves image in state "queued" (with size 0)
Jan van Eldik (2)
Pass pass
Pass pass
Pass pass
[1]
Pass pass
Pass pass
  1. Encountered RHBZ #858372
Jaroslav Henner
Pass pass
Pass pass
Pass pass
Inprogress inprogress
Inprogress inprogress
Pádraig Brady
Pass pass
[1]
Pass pass
Pass pass
[2]
Pass pass
Pass pass
  1. On an F17 VM and F18 bare metal
  2. Updated test to address issues mentioned by Gary Kotton
Pádraig Brady(2)
Warning warn
[1]
  1. Encountered RHBZ #860120
Nikola Đipanov
Pass pass
[1]
Fail fail
[2]
Pass pass
Pass pass
Pass pass
  1. On an F17 VM
  2. RHBZ #858256
Derek Higgins
Pass pass
[1]
Pass pass
Pass pass
Pass pass
Pass pass
  1. On F17 vm
Derek Higgins
Pass pass
[1]
Pass pass
Pass pass
Pass pass
Pass pass
  1. On F18 Alpha vm
Eoghan Glynn
Pass pass
Fail fail
[1]
Pass pass
Pass pass
Pass pass
  1. RHBZ #858256
Eoghan Glynn (day2)
Pass pass
Warning warn
[1]
Pass pass
Pass pass
Pass pass
  1. with tgtd.conf workaround
Nuno Santos
Pass pass
[1]
Pass pass
Pass pass
Pass pass
Pass pass
  1. On F17
Russell Bryant
Pass pass
[1]
Pass pass
Pass pass
Fail fail
[2]
Pass pass
  1. On F17
  2. RHBZ #858372
Pete Zaitcev
Pass pass
none
Pass pass
Pass pass
Pass pass
Steve Baker
Pass pass
[1]
Pass pass
Pass pass
Warning warn
[2]
Pass pass
  1. On F17 bare metal
  2. RHBZ #858372
Mark McLoughlin
Warning warn
[1] [2] [3]
none
none
none
none
  1. On F18
  2. RHBZ #858188
  3. RHBZ #858311
Mark McLoughlin (2)
Warning warn
[1]
Warning warn
[2]
Pass pass
Warning warn
[3]
Pass pass
  1. RHBZ #858311
  2. RHBZ #860162
  3. RHBZ #858372
Bertrand Juglas
Pass pass
[1]
none
none
none
none
  1. On F17 bare metal
Gabriel Staicu
Pass pass
[1]
none
none
none
Fail fail
[2]
  1. On F17 x64 VM hosted on openstack essex ..:)
  2. 859358
Steve Hardy
Pass pass
[1]
Pass pass
Pass pass
Pass pass
Pass pass
  1. On F18 Alpha bare metal
Derek Higgins (TD2)
Warning warn
[1][2]
Warning warn
[3]
Pass pass
Pass pass
Pass pass
  1. on F18 vm
  2. needed setsebool workaround RHBZ #860127
  3. needed workaround described on cinder page
Steven Dake
Warning warn
[1][2]
Warning warn
[3]
  1. on F18 vm
  2. needed setsebool workaround RHBZ #860127
  3. needed workaround described on cinder page
Core functionality:
User Launch an instance Attach a volume Floating IPs Separate compute node References
Eoghan Glynn
Pass pass
[1]
Fail fail
[2]
Pass pass
  1. See issue with libvirt_cpu_mode RHBZ #858216
  2. RHBZ #858256
Eoghan Glynn (day2)
Pass pass
Warning warn
[1]
Pass pass
  1. Volume detach fails due to: RHBZ #860227, should work with re-built python-cinderclient package
Nikola Dipanov
Pass pass
[1]
Fail fail
Pass pass
  1. Worked but had to restart nova-scheduler, see RHBZ #858237
Jan van Eldik
Pass pass
Fail fail
[1]
  1. RHBZ #858256
Jan van Eldik (2)
Pass pass
Pass pass
Nuno Santos
Pass pass
Fail fail
[1]
Pass pass
  1. RHBZ #858256
Pádraig Brady
Pass pass
[1]
  1. F17 VM. F18 worked too after avoiding RHBZ #858311
Russell Bryant
Pass pass
none
[1]
Pass pass
  1. Skipped since it was broken for everyone else already
Derek Higgins
Warning warn
[1]
  1. worked on both f17 and f18 (RHBZ #858311 on f18)
Pete Zaitcev
Fail fail
[1]
none
none
  1. Same as Nikola's RHBZ #858237, but restart does not help.
Eoghan Glynn
Warning warn
[1]
Fail fail
[2] [3] [4]
Pass pass
  1. RHBZ #858216
  2. RHBZ #858256
  3. RHBZ #860227
  4. Also saw (a) volume attached as /dev/vdc and (b) hd errors in tty guest running mkfs
Nova boot-from-volume:
User Create a builder instance Create and boot from a bootable volume Create an image from a running volume-backed instance References
Nikola Đipanov
Pass pass
Fail fail
[1]
  1. RHBZ #858256
Nuno Santos
Pass pass
Fail fail
[1]
  1. RHBZ #858256
Eoghan Glynn (day2)
Pass pass
Warning warn
[1]
Pass pass
  1. Volume detach fails due to: RHBZ #860227, should work with re-built python-cinderclient package
Quantum functionality:
User Configure and use a network topology in Quantum References
Gabriel Staicu
Pass pass
[1]
  1. Fedora17 x64 VM
Swift functionality:
User Upload and download files Upload Segmented File Test Auditor/Replicator Add Storage Device to ring References
Jan van Eldik
Pass pass
Pass pass
Pass pass
Pass pass
Pádraig Brady
Pass pass
Pass pass
Pass pass
Pass pass
Eoghan Glynn
Pass pass
Pass pass
Pass pass
Pass pass
Derek Higgins
Pass pass
[1]
Pass pass
Pass pass
Pass pass
  1. F18
Derek Higgins (TD2)
Pass pass
Pass pass
Warning warn
[1]
Pass pass
  1. rsync selinux AVC's RHBZ #809198
Dashboard functionality:
User Basic dashboard setup and login Launch/terminate an instance with the dashboard Managing projects and users with the dashboard VNC access to instances through the dashboard References
Jan van Eldik
Fail fail
[1] [2]
  1. Access and Security unavailable
  2. Firewall not open on HTTP port (80)
Jan van Eldik (2)
Pass pass
[1]
  1. Sign out seems to misbehave, investigating...
Eoghan Glynn
Pass pass
[1]
  1. Access and Security available
Gabriel Staicu
Pass pass
Pass pass
Fail fail
[1]
  1. Fedora17 x64 RHBZ #859127
Heat functionality:
User Basic heat setup and login Launch a basic wordpress stack Managing projects and users with the dashboard References
Steven Dake
Warning warn
[1]
  1. Had to apply all workarounds listed in wiki
Extra credit: Bugs found: https://bugzilla.redhat.com/show_bug.cgi?id=858297
User Tempest tests Build an image with Oz Smoke tests References
Nuno Santos
Fail fail
[1]