From Fedora Project Wiki

(Drop direct Test Days category membership)
 
(38 intermediate revisions by 15 users not shown)
Line 1: Line 1:
{{Infobox_group
{{Infobox_group
| name = Fedora Test Days
| name = Fedora Test Days
| image = [[File:Echo-testing-48px.png|link=QA/Fedora_16_test_days]]
| image = [[File:Echo-testing-48px.png|link=QA/Fedora_18_test_days]]
| caption = Virtualization Test Day
| caption = Virtualization Test Day
| date = 2012-11-01
| date = 2012-11-01
| time = all day
| time = all day
| website = [[Virtualization]]
| website = [[Virtualization]]
| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc] [http://meetbot.fedoraproject.org/fedora-test-day/2012-11-01/fedora-test-day.2012-11-01-12.25.log.txt IRC logs])
| fedora_mailing_list = virt}}
| fedora_mailing_list = virt}}


Line 20: Line 20:
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
<!--
<!--
Use one of these formats:
Use this format:
* Developer - [[User:<yourfedoracct>|<your name>]] (irc: <your nick>)
* [[User:<yourfedoracct>|<your name>]] (<your irc nick>)
* Tester - [[User:<yourfedoracct>|<your name>]] (irc: <your nick>)
-->
-->
* Developer - [[User:berrange|Daniel Berrange]] (irc: danpb)
* [[User:berrange|Daniel Berrange]] (danpb)
* Developer - [[User:rjones|Richard W.M. Jones]] (irc: rwmjones)
* [[User:rjones|Richard W.M. Jones]] (rwmjones)
* Developer - [[User:crobinso|Cole Robinson]] (irc: crobinso)
* [[User:crobinso|Cole Robinson]] (crobinso)
* Developer - [[User:stefanha|Stefan Hajnoczi]] (irc: stefanha)
* [[User:stefanha|Stefan Hajnoczi]] (stefanha)
* Developer - [[User:mrezanin|Miroslav Rezanina]] (irc: mrezanin)
* [[User:mrezanin|Miroslav Rezanina]] (mrezanin)
* Developer - [[User:ericb|Eric Blake]] (irc: eblake)
* [[User:ericb|Eric Blake]] (eblake)
* Developer - [[User:laine|Laine Stump]] (irc: laine)
* [[User:laine|Laine Stump]] (laine)


== Known issues ==
== Known issues ==
Line 49: Line 48:
* Hardware virtualization support (e.g. Intel VT or AMD-V) (see [[How_to_debug_Virtualization_problems#Is_My_Guest_Using_KVM.3F|Is My Guest Using KVM?]]).  If unavailable, you can still help with testing QEMU support.
* Hardware virtualization support (e.g. Intel VT or AMD-V) (see [[How_to_debug_Virtualization_problems#Is_My_Guest_Using_KVM.3F|Is My Guest Using KVM?]]).  If unavailable, you can still help with testing QEMU support.
* Up to 10-20Gb free disk space. Guest images take up a lot of space.
* Up to 10-20Gb free disk space. Guest images take up a lot of space.
* Get the packages with <br><pre>yum groupinstall virtualization</pre>


As for getting the latest virt packages, you have a few options:
As for getting the latest virt packages, you have a few options:
Line 73: Line 73:


Do you have a new machine with a ton of ram and storage space, running Fedora 17? Nested virt might be an option!
Do you have a new machine with a ton of ram and storage space, running Fedora 17? Nested virt might be an option!
This allows you to create KVM guests _inside_ a Fedora 18 VM. You'll want to install the latest virt packages from
This allows you to create KVM guests _inside_ a Fedora 18 VM.
virt-preview (linked above). Install a Fedora 18 guest (there are test cases below that walk you through it).
 
Then use virt-manager to 'copy host CPU' for your VM. Boot the VM, yum groupinstall @virtualization, and
# Install the latest virt packages from virt-preview using the instructions above.
verify that nested virt is working (sudo virt-host-validate).
# Install a Fedora 18 guest using one of the test cases below.
# Use virt-manager to 'copy host CPU' for your VM. Boot the VM, install virtualization packages, and verify that nested virt is working by running the following command as root: <br><pre>virt-host-validate</pre>
 
Some notes on nested virt with AMD and Intel:
 
* http://kashyapc.wordpress.com/2012/01/18/nested-virtualization-with-kvm-and-amd/
* http://kashyapc.wordpress.com/2012/01/14/nested-virtualization-with-kvm-intel/
* http://kashyapc.wordpress.com/2012/07/28/nested-virtualization-with-intel-take-2-with-fedora-17/


== Areas to test ==
== Areas to test ==


=== Do these first! ===
=== '''VM Install''' ===
 
Record your results for these test cases in the '''[[#Test Results |Test Results]]''' section.


If you don't already have a VM available, run through one of these test cases. A fully functioning VM is required for every other test case!
If you don't already have a VM available, run through one of these test cases. A fully functioning VM is required for every other test case!


* [[QA:Testcase Virtualization URL Guest Install]]
* [[QA:Testcase Virtualization CDROM Guest Install| Guest install via CDROM]]
* [[QA:Testcase Virtualization CDROM Guest Install]]
* [[QA:Testcase Virtualization URL Guest Install| Guest install via URL]]
 
Next give this a run through, which should ensure things aren't broken in some obvious manner:
 
* [[QA:Testcase Virtualization Virt Manager Lifecycle|VM Lifecycle (start, stop, save, delete, ...)]]
 
=== '''New tests and features''' ===


Next give this a run through, which should ensure things aren't broken in some obvious manner
Record your results for these test cases in the '''[[#Test Results|Test Results]]''' section.


* [[QA:Testcase Virtualization Virt Manager Lifecycle]]
* [[QA:Testcase Virtualization Live Backup|Live VM disk backup]]
* [[QA:Testcase Virtualization Guest Suspend Hibernate|VM suspend/hibernate]]
* [[QA:Testcase Virtualization Seccomp Sandboxing|VM sandboxing w/ syscall filters]]
* [[QA:Testcase Virtualization IO Throttling|VM IO throttling]]
* [[QA:Testcase Virtualization PV EOI|VM PV EOI performance optimization]]
* [[QA:Testcase Virtualization USB3 Device Passthrough|USB3 device assignment]]
* [[QA:Testcase Virtualization USB Redirection|USB Redirection]]


=== News tests and features ===
=== libguestfs and tools ===


* [[QA:Testcase Virtualization Live Backup]]
You will need Fedora 18 (host) and at least one guest (but the more the merrier).
* [[QA:Testcase Virtualization Guest Suspend Hibernate]]
 
* [[QA:Testcase Virtualization Seccomp Sandboxing]]
Install libguestfs:
* [[QA:Testcase Virtualization IO Throttling]]
 
* [[QA:Testcase Virtualization PV EOI]]
# yum install '*guestf*'
* [[QA:Testcase Virtualization USB3 Device Passthrough]]
 
* [[QA:Testcase Virtualization USB Redirection]]
and run through the tests here: http://libguestfs.org/guestfs-testing.1.html
 
In Fedora 18, we are using [http://libvirt.org libvirt] to launch the appliance, and [http://selinuxproject.org/page/SVirt sVirt] + SELinux to make everything [http://libguestfs.org/guestfs.3.html#security much more secure].  Therefore it's better (though not required) if you can run these tests with SELinux set to enforcing.


=== Previous test cases ===
=== Previous test cases ===
Line 105: Line 128:
Some test cases used in previous test days. Still useful to test for regressions!
Some test cases used in previous test days. Still useful to test for regressions!


==== Migration ====
Migration:
 
* [[QA:Testcase Live Migration using libvirt/virsh|Live migration with virsh]]
* [[QA:Testcase Offline (paused) Migration using libvirt/virsh|Offline migration with virsh]]
 
Hotplug:
 
* [[QA:Testcase Virtualization NIC Hotplug virsh attach detach|NIC hotplug with virsh]]
* [[QA:Testcase Virtualization Attach/Detach a SCSI device to guest|SCSI hotplug with virsh]]
* [[QA:Testcase Virtualization Hotplug USB device to guest|USB hotplug with virsh]]
 
virtio-scsi:
 
* [[QA:Testcase Virtualization Virtio SCSI Install|Virtio SCSI install]]
* [[QA:Testcase Virtualization Virtio SCSI Hotplug|Virtio SCSI hotplug]]
 
 
== Test Results ==


* [[QA:Testcase Live Migration using libvirt/virsh]]
Each tester should add a row for their results.
* [[QA:Testcase Offline (paused) Migration using libvirt/virsh]]


==== Spice ====
If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla]. If you have any questions about what component to file against,
just shout in the IRC channel and we can help you out. Same goes for any selinux alerts you might see!


* [[QA:Testcase Virtualization Check SPICE password support]]
<!-- Don't touch this part! -->
* [[QA:Testcase Virtualization Manually set spice listening port with TLS port set]]
{|
* [[QA:Testcase Virtualization Setting up a VM with Spice]]
! User
* [[QA:Testcase Virtualization Spice listen on all public network interfaces]]
! VM Install
! [[QA:Testcase Virtualization Virt Manager Lifecycle|VM Lifecycle]]
! [[QA:Testcase Virtualization Live Backup|Live Backup]]
! [[QA:Testcase Virtualization Guest Suspend Hibernate|Suspend]]
! [[QA:Testcase Virtualization Seccomp Sandboxing|Seccomp]]
! [[QA:Testcase Virtualization IO Throttling|IO Throttling]]
! [[QA:Testcase Virtualization PV EOI|PV EOI]]
! [[QA:Testcase Virtualization USB3 Device Passthrough|USB3]]
! [[QA:Testcase Virtualization USB Redirection|USB Redir]]
! References
|-


==== libvirt ====


* [[QA:Testcase Virtualization libvirt create a logical pool]]
<!-- Copy the block below as a template
* [[QA:Testcase Virtualization libvirt save and restore with svirt]]
* [[QA:Testcase Virtualization libvirt set guest memory]]


==== Hotplug ====
| [[User:SampleUser|SampleUser]]
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-


* [[QA:Testcase Virtualization Attach/Detach a SCSI device to guest]]
-->
* [[QA:Testcase Virtualization Hotplug USB device to guest]]
* [[QA:Testcase Virtualization NIC Hotplug virsh attach detach]]


==== virtio-scsi ====
| [[User:crobinso|crobinso]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|fail}} <ref>Guest fails to start {{bz|855162}}</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|warn}} <ref>USB Device didn't appear in lsusb -t in guest</ref>
| {{result|done}}
| <references/>
|-


* [[QA:Testcase Virtualization Virtio SCSI Install]]
| [[User:kashyapc|Kashyap Chamarthy]]
* [[QA:Testcase Virtualization Virtio SCSI Hotplug]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-


==== libguestfs and tools ====


You will need Fedora 18 (host) and at least one guest (but the more the merrier).
| [[User:mkrizek|mkrizek]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}} <ref>Reduced only from approx. 15.000 to 12.000</ref>
| {{result|none}}
| {{result|pass}}
| <references/>
|-


Install libguestfs:
| [[User:mrezanin|mrezanin]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| <references/>
|-
| [[User:pschindl|pschindl]]
| {{result|warn||872162}}
| {{result|fail||869607}}
|
| {{result|pass}} <ref>I tested only guest functionality, when I try agent I got 'Error starting domain: Unable to read from monitor: Connection reset by peer'</ref>
|
|
|
|
|
| <references/>
|-
| [[User:stefanha|Stefan Hajnoczi]]
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass}} <ref group="long">Throttling works but virsh blkdeviotune reports incorrect results.  I have sent patches here: https://www.redhat.com/archives/libvir-list/2012-November/msg00095.html {{bz|872582}}</ref>
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>


# yum install '*guestf*'
|-
| [[User:ericb|Eric Blake]]
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|inprogress}} <ref>{{bz|872292}} found by inspection based on an IRC question, latent bug which affects snapshots, among other operations</ref>
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|inprogress}}
| <references/>


and run through the tests here: http://libguestfs.org/guestfs-testing.1.html
|-
| [[User:Sagarun|Arun S A G]]
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|pass}}<ref>{{bz|872343}} Cannot resume RHEL6 vm running at runlevel 3  </ref>
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-


In Fedora 18, we are using [http://libvirt.org libvirt] to launch the appliance, and [http://selinuxproject.org/page/SVirt sVirt] + SELinux to make everything [http://libguestfs.org/guestfs.3.html#security much more secure].  Therefore it's better (though not required) if you can run these tests with SELinux set to enforcing.
| [[User:kparal|kparal]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|fail||872573}}
| {{result|none}}
| {{result|fail||872582}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|
|-
| [[User:knoel|Karen Noel]]
| {{result|pass}} <ref>Installed RHEL6.3 and F18 guests</ref>
| {{result|inprogress}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-


==== GuestOS compatibility ====
|}


* [[Test_Day:2012-04-12_Virtualization_Test_Day-GuestOS | GuestOS compatibility]] <br>&mdash; test installation of as many different guest operating system as as possible. (You will need a KVM bare metal host & lots of disk space)
== Long comments ==
<references group="long" />


[[Category:Fedora 18 Test Days]]
  [[Category:Fedora 18 Test Days]]
[[Category:Virtualization]]
[[Category:Virtualization]]

Latest revision as of 19:42, 26 June 2015

Fedora Test Days
Virtualization Test Day

Date 2012-11-01
Time all day

Website Virtualization
IRC #fedora-test-day (webirc IRC logs)
Mailing list virt


Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.


What to test?[edit]

Today's installment of Fedora Test Day will focus on Virtualization in Fedora 18. Test cases will basic virtualization workflow, some cool functionality, as well as new features introduced in Fedora 18.

Who's available[edit]

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

Known issues[edit]

Before you begin testing, there are a few known bugs that should be taken into account:

  • Pausing a KVM guest can crash that guest. Might be specific to guests using a QXL video device (the default created by virt-manager): bug 870811
  • running libvirtd inside a guest can break that guests networking. you can work around this by using 'sudo virsh net-edit default' inside the VM, and change all instances of 192.168.122 to 192.168.123 and restarting the VM: bug 811967
  • qemu + libvirt + seccomp doesn't work, the qemu guests fail to even start: bug 855162
  • some graphical corruption if using cirrus virtual card for guests: bug 871247
  • virt-manager will backtrace trying to show guests in the 'suspended' state bug 871237
  • Closing a graphical window triggers a guest resume bug 871240
  • ctrl-alt-f2,3,4 don't have effect in guests (unless xserver is restarted): bug 871241

What's needed to test[edit]

For starters, your physical machine should have:

  • Hardware virtualization support (e.g. Intel VT or AMD-V) (see Is My Guest Using KVM?). If unavailable, you can still help with testing QEMU support.
  • Up to 10-20Gb free disk space. Guest images take up a lot of space.
  • Get the packages with
    yum groupinstall virtualization

As for getting the latest virt packages, you have a few options:

Fedora 18 on a physical machine[edit]

The preferred testing platform is a fully updated Fedora 18 machine. You have a few options for getting the Fedora 18 bits:

  • Upgrade from Fedora 17

Fedora 18 virt packages on Fedora 17[edit]

If you aren't ready to make the jump to Fedora 18, this is the next best thing! Run latest virt packages on Fedora 17 from the virt-preview repo:

http://fedoraproject.org/wiki/Virtualization_Preview_Repository

Run Fedora 18 in a VM with nested virtualization[edit]

Do you have a new machine with a ton of ram and storage space, running Fedora 17? Nested virt might be an option! This allows you to create KVM guests _inside_ a Fedora 18 VM.

  1. Install the latest virt packages from virt-preview using the instructions above.
  2. Install a Fedora 18 guest using one of the test cases below.
  3. Use virt-manager to 'copy host CPU' for your VM. Boot the VM, install virtualization packages, and verify that nested virt is working by running the following command as root:
    virt-host-validate

Some notes on nested virt with AMD and Intel:

Areas to test[edit]

VM Install[edit]

Record your results for these test cases in the Test Results section.

If you don't already have a VM available, run through one of these test cases. A fully functioning VM is required for every other test case!

Next give this a run through, which should ensure things aren't broken in some obvious manner:

New tests and features[edit]

Record your results for these test cases in the Test Results section.

libguestfs and tools[edit]

You will need Fedora 18 (host) and at least one guest (but the more the merrier).

Install libguestfs:

# yum install '*guestf*'

and run through the tests here: http://libguestfs.org/guestfs-testing.1.html

In Fedora 18, we are using libvirt to launch the appliance, and sVirt + SELinux to make everything much more secure. Therefore it's better (though not required) if you can run these tests with SELinux set to enforcing.

Previous test cases[edit]

Some test cases used in previous test days. Still useful to test for regressions!

Migration:

Hotplug:

virtio-scsi:


Test Results[edit]

Each tester should add a row for their results.

If you have problems with any of the tests, report a bug to Bugzilla. If you have any questions about what component to file against, just shout in the IRC channel and we can help you out. Same goes for any selinux alerts you might see!

User VM Install VM Lifecycle Live Backup Suspend Seccomp IO Throttling PV EOI USB3 USB Redir References
crobinso
Pass pass
Pass pass
Pass pass
Pass pass
Fail fail
[1]
Pass pass
Pass pass
Warning warn
[2]
done
  1. Guest fails to start RHBZ #855162
  2. USB Device didn't appear in lsusb -t in guest
Kashyap Chamarthy
Pass pass
Pass pass
Pass pass
none
none
none
none
none
none
mkrizek
Pass pass
Pass pass
Pass pass
Pass pass
none
Pass pass
Pass pass
[1]
none
Pass pass
  1. Reduced only from approx. 15.000 to 12.000
mrezanin
Pass pass
Pass pass
Pass pass
Pass pass
none
Pass pass
none
none
Pass pass
pschindl
Warning warn [1]
Fail fail [2]
Pass pass
[3]
  1. RHBZ #872162
  2. RHBZ #869607
  3. I tested only guest functionality, when I try agent I got 'Error starting domain: Unable to read from monitor: Connection reset by peer'
Stefan Hajnoczi
Pass pass
none
none
none
none
Pass pass
[long 1]
none
none
none
Eric Blake
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
[1]
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
  1. RHBZ #872292 found by inspection based on an IRC question, latent bug which affects snapshots, among other operations
Arun S A G
Pass pass
Pass pass
none
Pass pass
[1]
none
none
none
none
none
  1. RHBZ #872343 Cannot resume RHEL6 vm running at runlevel 3
kparal
Pass pass
Pass pass
Pass pass
Fail fail [1]
none
Fail fail [2]
none
none
none
  1. RHBZ #872573
  2. RHBZ #872582
Karen Noel
Pass pass
[1]
Inprogress inprogress
none
none
none
none
none
none
none
  1. Installed RHEL6.3 and F18 guests

Long comments[edit]

  1. Throttling works but virsh blkdeviotune reports incorrect results. I have sent patches here: https://www.redhat.com/archives/libvir-list/2012-November/msg00095.html RHBZ #872582