From Fedora Project Wiki

(having test day pages directly in the test day category isn't a good idea)
(Add test results)
Line 167: Line 167:
== Test Results ==
== Test Results ==
<!-- metadata: https://fedoraproject.org/wiki/User:Crobinso/Sandbox:F21VirtTestAppMetadata
<!-- metadata: https://fedoraproject.org/wiki/User:Crobinso/Sandbox:F21VirtTestAppMetadata
     To update the results tool, put the metadata in the following form and submit: http://testdays.qa.fedoraproject.org/testdays/admin/update_testday -->
     To update the results tool, put the metadata in the following form and submit: http://testdays.qa.fedoraproject.org/testdays/admin/update_testday  
 
'''We are tracking test results in a web application [http://testdays.qa.fedoraproject.org/testdays/show_event?event_id=19 over here]'''
'''We are tracking test results in a web application [http://testdays.qa.fedoraproject.org/testdays/show_event?event_id=19 over here]'''


Results from this web application will be automatically transferred to the Wiki a week after the test day, and the reporting system will be shutdown. Feel free to continue testing and filling the wiki even after this date.
Results from this web application will be automatically transferred to the Wiki a week after the test day, and the reporting system will be shutdown. Feel free to continue testing and filling the wiki even after this date.
-->
Results originally entered into the test day tool [http://testdays.qa.fedoraproject.org/testdays/show_event?event_id=19 over here]. Copied below for reference.
=== VM Install ===
{|
! User
! Hardware
! [http://fedoraproject.org/wiki/QA:Testcase_Virtualization_CDROM_Guest_Install Guest Install via CDROM]
! [http://fedoraproject.org/wiki/QA:Testcase_Virtualization_URL_Guest_Install Guest Install via url]
! [http://fedoraproject.org/wiki/QA:Testcase_Virtualization_Import_Guest_Install Import VM]
! References
|-
| [[User:znmeb|znmeb]]
| AMD Eight-core 32 GB workstation
| {{result|fail}}  <ref>{{bz|1146232}}</ref><ref>Using default NAT networking, which is my normal modus operandi with Virtual Machine Manager. Guest can't see the Internet.</ref>
|
|
| <references/>
|-
| [[User:Hapoofesgeli|Hapoofesgeli]]
| Intel 4770K
| {{result|warn}}  <ref>{{bz|1146232}}</ref><ref>No internet connection without "virsh net-destroy default".</ref>
|
|
| <references/>
|-
| [[User:roshi|roshi]]
| Lenovo W530
| {{result|pass}} 
| {{result|pass}} 
|
| <references/>
|-
| [[User:hhuang|hhuang]]
| Lenovo T500
| {{result|warn}}  <ref>Installed F21 guest from LiveCD with mixed results.
On the first attempt, virt-manager "lost contact" with qemu, so all the VMs disappeared!
On the second attempt, the guest froze during installation, and the system would not respond to any keys or mouse clicks.
On the third attemp the f21 guest installation succeeded. </ref>
| {{result|warn}}  <ref>Guest installed over network correctly.
However, at the very end of the install,
reboot did NOT work. 
The guest never came back up.
Attempts to start, restart, shutdown, reset,
force shutdown the guest were unsuccessful.
Had to shutdown the virt-manager. After the
virt-manager re-start, was able to boot the guest.</ref>
|
| <references/>
|-
| [[User:royboy626|royboy626]]
| MSI_P965
|
|
| {{result|pass}} 
| <references/>
|-
| [[User:haai|haai]]
| Intel i7-3520M
|
| {{result|pass}}  <ref>1. testing on fed20 with fedora-virt-preview.repo
2. virt-install from URL from test/21-Alpha/Workstation/x86_64/os with defaults and encrypt hdd option
3. installation works fine
4. after reboot gnome shows wired connection as connected but with a '?' symbol. remote communication works. after reboot vm shows proper symbol in gnome.</ref>
|
| <references/>
|-
| [[User:crobinso|crobinso]]
| AMD FX8150
| {{result|pass}}  <ref>Server installed fine with virt-manager</ref>
| {{result|pass}}  <ref>virt-manager and virt-install worked fine</ref>
| {{result|warn}}  <ref>{{bz|1146275}}</ref><ref>Import succeeds, but virt-customize/virt-builder doesn't work for setting passwords.</ref>
| <references/>
|-
| [[User:pgmassey|pgmassey]]
| Dell Inc. Inspiron 5520/04G65K
| {{result|pass}}  <ref>Notes - Did not detect CentOS 6.5, Ubuntu 14.04, or FreeBSD 10 isos.</ref>
|
|
| <references/>
|-
| [[User:anishjp|anishjp]]
| Intel Core i3-2100 CPU @ 3.10GHz x 4
| {{result|fail}}  <ref>Detected OS type and version before copying the ISO to /var/lib/libvirt/images location. UI cannot detect the OS type and version after copying the ISO to /var/lib/libvirt/images location. Installation completed without issues. Guest (F20) is bootable after installation. When I checked the resource utilization in my host machine, Memory 2.7GiB of 7.8GiB and Swap 5.8MiB of 7.9GiB. Why is it going to swap space when I have lot of memory left in my main memory?</ref>
|
|
| <references/>
|-
|}
=== Standard Features ===
{|
! User
! Hardware
! [http://fedoraproject.org/wiki/QA:Testcase_Virtualization_Virt_Manager_Lifecycle VM Lifecycle]
! [http://fedoraproject.org/wiki/QA:Testcase_Virt_Snapshot_UI VM snapshots]
! [http://fedoraproject.org/wiki/QA:Testcase_Virtualization_Spice_Features Spice features]
! [http://fedoraproject.org/wiki/QA:Testcase_Virt_Change_CDROM_Media Change CDROM media for running VM]
! [http://fedoraproject.org/wiki/QA:Testcase_Virtualization_Hotplug_USB_device_to_guest Host USB device hotplug]
! [http://fedoraproject.org/wiki/QA:Testcase_Virtualization_KVM_PCI_Device_Assignment Host PCI device assignment]
! [http://fedoraproject.org/wiki/QA:Testcase_KVM_nested_virt Nested virt]
! [http://fedoraproject.org/wiki/QA:Testcase_Live_Migration_using_libvirt/virsh Live migration]
! [http://fedoraproject.org/wiki/QA:Testcase_Virt_ARM_on_x86 Fedora ARM VM on x86]
! References
|-
| [[User:znmeb|znmeb]]
| AMD Eight-core 32 GB workstation
|
|
|
|
|
|
| {{result|pass}}  <ref>  QEMU: Checking for hardware virtualization                                : PASS
  QEMU: Checking for device /dev/kvm                                        : PASS
  QEMU: Checking for device /dev/vhost-net                                  : PASS
  QEMU: Checking for device /dev/net/tun                                    : PASS
  LXC: Checking for Linux >= 2.6.26                                        : PASS
I went further - created a VM and installed Fedora 20 on it. This is a use case I'd never do in real life, but it's nice to know it's there. I'd be much more likely to deploy some tiny server in LXC or Docker with a Firefox client than a full VM-inside-a-VM.</ref>
|
|
| <references/>
|-
| [[User:Hapoofesgeli|Hapoofesgeli]]
| Intel 4770K
| {{result|pass}}  {{result|pass}}  <ref>Results seem fine.</ref>
| {{result|warn}}  <ref>Shutting down the VM brings a black screen in Fedora 21 and VM keeps running with a low CPU usage.</ref>
| {{result|pass}} 
| {{result|pass}}  <ref>Tested virt-manager.</ref>
|
|
|
|
|
| <references/>
|-
| [[User:kashyapc|kashyapc]]
| IBM System x3550 M2 -[794632A]-
|
|
|
|
|
|
| {{result|pass}}  <ref>I tested nested virt with `virsh` and `virt-xml` as the procedure outlined below:
https://kashyapc.fedorapeople.org/virt/procedure-to-enable-nested-virt-on-intel-machines.txt
</ref>
|
|
| <references/>
|-
| [[User:roshi|roshi]]
| Lenovo W530
| {{result|fail}}  <ref>{{bz|1146731}}</ref>
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}}  <ref>Disconnecting from virt-manager while the drive is mounted in the guest gives a notice that "This will take effect after next guest shutdown."</ref>
| {{result|pass}} 
|
| {{result|pass}}  <ref>http://fpaste.org/136772/74701014/</ref>
|
| {{result|pass}} 
| <references/>
|-
| [[User:hhuang|hhuang]]
| Lenovo T500
| {{result|warn}}  <ref>Issuing the "Shutdown" operation from the virt-manager procuded inconsistent results.
On a RHEL7.0 guest, the shutdown operation worked.
On a RHEL6.5 guest, the shutdown operation had no effect on the guest.</ref>{{result|warn}}  <ref>When the guest is running, attempt to reboot
the guest from the virt-manager failed with the following error message: "Guest agent not responding..."</ref>
|
|
|
|
|
|
|
|
| <references/>
|-
| [[User:royboy626|royboy626]]
| MSI_P965
| {{result|pass}}  <ref>{{bz|1146277}}</ref><ref>Otherwise OK</ref>
| {{result|pass}}  <ref>Interface suggestion; Inactivate "play" icon when in snapshot GUI. Not clear how to run/delete snapshot (right click). Perhaps a hover tooltip or run:delete icons in toolbar tied to highlighted snapshot</ref>
| {{result|pass}}  <ref>Non RPM virtual OS running XFCE. Autoresolution fail. USB use OK. Drag file from host to virtual placed on desktop (~/Desktop). Should command listed on page be piped to grep? -> ps axwww | spice-vdagent</ref>
|
|
|
|
|
|
| <references/>
|-
| [[User:haai|haai]]
| Intel i7-3520M
|
| {{result|pass}}  <ref>snapshot during firefox load makes em slooow</ref>{{result|pass}} 
| {{result|pass}} 
|
|
|
|
|
|
| <references/>
|-
| [[User:crobinso|crobinso]]
| AMD FX8150
| {{result|warn}}  <ref>{{bz|1146277}}</ref><ref>Generally fine, but after a lot of messing around virt-manager lost track of a VMs run state.</ref>
| {{result|pass}} 
| {{result|warn}}  <ref>{{bz|1146289}}</ref><ref>USB Redirection: fine. Auto Resize: Fine with RHEL6 guest as indicated. Copy/Paste: fine. Drag+Drop: works, but doesn't launch nautilus on first try (bug 1146289)</ref>
| {{result|pass}}  <ref>Worked from UI and command line. On --eject, sometimes needs to be passed twice, might see an error about tray being locked. Also, the virsh responses are incoherent, someone should file a bug about that...</ref>
| {{result|warn}}  <ref>{{bz|1146297}}</ref><ref>Worked with virt-xml. virt-manager UI has bug 1146297, but after applying the fix it worked fine.</ref>
| {{result|warn}}  <ref>{{bz|1146297}}</ref><ref>Worked with virt-xml. virt-manager UI has bug 1146297, but after applying the fix it worked fine.</ref>
| {{result|pass}}  <ref>Passed with a brief test, kicking off a trivial KVM VM</ref>
|
| {{result|pass}}  <ref>Works, but sloooooww :)</ref>
| <references/>
|-
| [[User:pgmassey|pgmassey]]
| Dell Inc. Inspiron 5520/04G65K
| {{result|pass}}  <ref>Ubuntu 14.04 test VM appears to respond to all commands correctly</ref>
| {{result|pass}} 
| {{result|warn}}  <ref>File drop works to Ubuntu 14.04 VM.
Copy-Paste works
Resolution does not change.  Same problem as Fedora 21 maybe?</ref>
| {{result|pass}}  <ref>Passed from virt-manager</ref>
| {{result|pass}}  <ref>Redirected Webcam from Fedora host to Ubuntu guest, via window opened from.  Webcam appears functional in guest.</ref>
|
|
|
|
| <references/>
|-
| [[User:anishjp|anishjp]]
| Intel Core i3-2100 CPU @ 3.10GHz x 4
| {{result|pass}}  <ref>Works as expected.</ref>
|
|
|
|
|
|
|
|
| <references/>
|-
|}
=== New features ===
{|
! User
! Hardware
! [http://fedoraproject.org/wiki/QA:Testcase_Virtualization_Q35_Chipset Q35 Chipset]
! [http://fedoraproject.org/wiki/QA:Testcase_Virt_AArch64_on_x86 AArch64 VM on x86]
! [http://fedoraproject.org/wiki/QA:Testcase_Virtualization_UEFI Install VM using OVMF/UEFI]
! References
|-
| [[User:royboy626|royboy626]]
| MSI_P965
|
| {{result|warn}}  <ref>Wasn't smart enough to use GUI. virt-install worked and booted into the host terminal where virt-install executed. Did config including root and another user. Booted to login but WAS NOT able to successfully enter password for either created user or root (hidden chars?). Hard to believe I screwed up passwords twice (however...)</ref>
|
| <references/>
|-
| [[User:crobinso|crobinso]]
| AMD FX8150
| {{result|pass}}  <ref>Worked with virt-install for F21 server install</ref>
| {{result|pass}} 
| {{result|pass}}  <ref>Worked for F21 server install</ref>
| <references/>
|-
|}


[[Category:Fedora 21 Test Days]]
[[Category:Fedora 21 Test Days]]

Revision as of 23:07, 28 September 2014

Fedora Test Days
Virtualization Test Day

Date Thursday 2014-09-25
Time all day

Website Virtualization
IRC #fedora-test-day

(webirc IRC logs)

Mailing list virt
Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule [on Fedocal] and see if a similar but more recent Test Day is planned or has already happened.

What to test?

Today's installment of Fedora Test Day will focus on Virtualization in Fedora 21. Test cases will basic virtualization workflow, some cool functionality, as well as new features introduced in Fedora 21.

Who's available

The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion.

Known issues

  • Fedora 21 Workstation media is not detected as Fedora 21 by boxes/virt-manager: bug 1145264
  • SPICE auto guest resize isn't working: bug 1146175
  • Latest virt-customize/virt-builder seem to have issues setting passwords bug 1146275
  • virt-manager can lose track of guest state, think VM is running when it's actually stopped bug 1146277
  • F21 workstation livecd in a VM has no network connectivity, conflicts with host 'default' network 1146232
  • spice-vdagent: drag + drop doesn't open nautilus right away: bug 1146289
  • virt-manager: UI error when trying to hotplug USB/PCI: bug 1146297

What's needed to test

For starters, your physical machine should have:

  • Hardware virtualization support (e.g. Intel VT or AMD-V) (see Is My Guest Using KVM?).
  • Up to 10-20Gb free disk space. Guest images take up a lot of space.
  • Get the packages with: yum groupinstall virtualization

As for getting the latest virt packages, you have a few options:

Fedora 21 on a physical machine

The preferred testing platform is a fully updated Fedora 21 machine. You have a few options for getting the Fedora 21 bits:

Install with CD/DVD

You can download the Fedora 21 Alpha in various formats here.

Upgrade from Fedora 20

Run Fedora 21 in a VM with nested virtualization

Do you have a new machine with a ton of ram and storage space, running Fedora 21? Nested virt might be an option! This allows you to create KVM guests inside a Fedora 21 VM.

Use the virt-preview instructions below, install a guest using one of the install test cases, and follow the nested virt test case to finish the setup and verify things are working correctly.

Fedora 21 virt packages on Fedora 20

If you aren't ready to make the jump to Fedora 21, this is the next best thing! Run latest virt packages on Fedora 20 from the virt-preview repo:

http://fedoraproject.org/wiki/Virtualization_Preview_Repository

Areas to test

All these tests have an entry in the Test Results table, please record them there.

Ensure you are using the latest virt packages!

Several updated packages were pushed to Fedora 21 only recently. The recommended versions are:

  • qemu-system-x86-2.1.1-2.fc21 (same version for all qemu* packages)
  • libvirt-daemon-1.2.8-6.fc21
  • virt-manager-common-1.1.0-3.git310f6527.fc21

If a 'yum update' isn't pulling these packages in, try 'sudo yum clean all', then 'sudo yum update'.

VM Install

If you don't already have a VM available, run through one of these test cases. A fully functioning VM is required for every other test case!

Standard features

These are recurring tests of standard virt features, they ensure nothing obvious is broken.

New features

Extra tests

These tests aren't listed in the 'test results' table, but consider giving them a spin and reporting any issues on IRC or bugzilla.

libguestfs and tools

You will need Fedora 21 (host) and at least one guest (but the more the merrier).

Install libguestfs: # yum install '*guestf*'

and run through the tests here: http://libguestfs.org/guestfs-testing.1.html

Previous test cases

Some test cases used in previous test days. Still useful to test for regressions!

Fedora 20 features:

Fedora 19 features:

Fedora 18 features:

Misc tests:

All tests:

OpenVZ

Debugging

Test Results

Results originally entered into the test day tool over here. Copied below for reference.

VM Install

User Hardware Guest Install via CDROM Guest Install via url Import VM References
znmeb AMD Eight-core 32 GB workstation
Fail fail
[1][2]
  1. RHBZ #1146232
  2. Using default NAT networking, which is my normal modus operandi with Virtual Machine Manager. Guest can't see the Internet.
Hapoofesgeli Intel 4770K
Warning warn
[1][2]
  1. RHBZ #1146232
  2. No internet connection without "virsh net-destroy default".
roshi Lenovo W530
Pass pass
Pass pass
hhuang Lenovo T500
Warning warn
[1]
Warning warn
[2]
  1. Installed F21 guest from LiveCD with mixed results. On the first attempt, virt-manager "lost contact" with qemu, so all the VMs disappeared! On the second attempt, the guest froze during installation, and the system would not respond to any keys or mouse clicks. On the third attemp the f21 guest installation succeeded.
  2. Guest installed over network correctly. However, at the very end of the install, reboot did NOT work. The guest never came back up. Attempts to start, restart, shutdown, reset, force shutdown the guest were unsuccessful. Had to shutdown the virt-manager. After the virt-manager re-start, was able to boot the guest.
royboy626 MSI_P965
Pass pass
haai Intel i7-3520M
Pass pass
[1]
  1. 1. testing on fed20 with fedora-virt-preview.repo 2. virt-install from URL from test/21-Alpha/Workstation/x86_64/os with defaults and encrypt hdd option 3. installation works fine 4. after reboot gnome shows wired connection as connected but with a '?' symbol. remote communication works. after reboot vm shows proper symbol in gnome.
crobinso AMD FX8150
Pass pass
[1]
Pass pass
[2]
Warning warn
[3][4]
  1. Server installed fine with virt-manager
  2. virt-manager and virt-install worked fine
  3. RHBZ #1146275
  4. Import succeeds, but virt-customize/virt-builder doesn't work for setting passwords.
pgmassey Dell Inc. Inspiron 5520/04G65K
Pass pass
[1]
  1. Notes - Did not detect CentOS 6.5, Ubuntu 14.04, or FreeBSD 10 isos.
anishjp Intel Core i3-2100 CPU @ 3.10GHz x 4
Fail fail
[1]
  1. Detected OS type and version before copying the ISO to /var/lib/libvirt/images location. UI cannot detect the OS type and version after copying the ISO to /var/lib/libvirt/images location. Installation completed without issues. Guest (F20) is bootable after installation. When I checked the resource utilization in my host machine, Memory 2.7GiB of 7.8GiB and Swap 5.8MiB of 7.9GiB. Why is it going to swap space when I have lot of memory left in my main memory?


Standard Features

User Hardware VM Lifecycle VM snapshots Spice features Change CDROM media for running VM Host USB device hotplug Host PCI device assignment Nested virt Live migration Fedora ARM VM on x86 References
znmeb AMD Eight-core 32 GB workstation
Pass pass
[1]
  1. QEMU: Checking for hardware virtualization  : PASS QEMU: Checking for device /dev/kvm  : PASS QEMU: Checking for device /dev/vhost-net  : PASS QEMU: Checking for device /dev/net/tun  : PASS LXC: Checking for Linux >= 2.6.26  : PASS I went further - created a VM and installed Fedora 20 on it. This is a use case I'd never do in real life, but it's nice to know it's there. I'd be much more likely to deploy some tiny server in LXC or Docker with a Firefox client than a full VM-inside-a-VM.
Hapoofesgeli Intel 4770K
Pass pass
Pass pass
[1]
Warning warn
[2]
Pass pass
Pass pass
[3]
  1. Results seem fine.
  2. Shutting down the VM brings a black screen in Fedora 21 and VM keeps running with a low CPU usage.
  3. Tested virt-manager.
kashyapc IBM System x3550 M2 -[794632A]-
Pass pass
[1]
  1. I tested nested virt with virsh and virt-xml as the procedure outlined below: https://kashyapc.fedorapeople.org/virt/procedure-to-enable-nested-virt-on-intel-machines.txt
roshi Lenovo W530
Fail fail
[1]
Pass pass
Pass pass
Pass pass
[2]
Pass pass
Pass pass
[3]
Pass pass
  1. RHBZ #1146731
  2. Disconnecting from virt-manager while the drive is mounted in the guest gives a notice that "This will take effect after next guest shutdown."
  3. http://fpaste.org/136772/74701014/
hhuang Lenovo T500
Warning warn
[1]
Warning warn
[2]
  1. Issuing the "Shutdown" operation from the virt-manager procuded inconsistent results. On a RHEL7.0 guest, the shutdown operation worked. On a RHEL6.5 guest, the shutdown operation had no effect on the guest.
  2. When the guest is running, attempt to reboot the guest from the virt-manager failed with the following error message: "Guest agent not responding..."
royboy626 MSI_P965
Pass pass
[1][2]
Pass pass
[3]
Pass pass
[4]
  1. RHBZ #1146277
  2. Otherwise OK
  3. Interface suggestion; Inactivate "play" icon when in snapshot GUI. Not clear how to run/delete snapshot (right click). Perhaps a hover tooltip or run:delete icons in toolbar tied to highlighted snapshot
  4. Non RPM virtual OS running XFCE. Autoresolution fail. USB use OK. Drag file from host to virtual placed on desktop (~/Desktop). Should command listed on page be piped to grep? -> ps axwww | spice-vdagent
haai Intel i7-3520M
Pass pass
[1]
Pass pass
Pass pass
  1. snapshot during firefox load makes em slooow
crobinso AMD FX8150
Warning warn
[1][2]
Pass pass
Warning warn
[3][4]
Pass pass
[5]
Warning warn
[6][7]
Warning warn
[8][9]
Pass pass
[10]
Pass pass
[11]
  1. RHBZ #1146277
  2. Generally fine, but after a lot of messing around virt-manager lost track of a VMs run state.
  3. RHBZ #1146289
  4. USB Redirection: fine. Auto Resize: Fine with RHEL6 guest as indicated. Copy/Paste: fine. Drag+Drop: works, but doesn't launch nautilus on first try (bug 1146289)
  5. Worked from UI and command line. On --eject, sometimes needs to be passed twice, might see an error about tray being locked. Also, the virsh responses are incoherent, someone should file a bug about that...
  6. RHBZ #1146297
  7. Worked with virt-xml. virt-manager UI has bug 1146297, but after applying the fix it worked fine.
  8. RHBZ #1146297
  9. Worked with virt-xml. virt-manager UI has bug 1146297, but after applying the fix it worked fine.
  10. Passed with a brief test, kicking off a trivial KVM VM
  11. Works, but sloooooww :)
pgmassey Dell Inc. Inspiron 5520/04G65K
Pass pass
[1]
Pass pass
Warning warn
[2]
Pass pass
[3]
Pass pass
[4]
  1. Ubuntu 14.04 test VM appears to respond to all commands correctly
  2. File drop works to Ubuntu 14.04 VM. Copy-Paste works Resolution does not change. Same problem as Fedora 21 maybe?
  3. Passed from virt-manager
  4. Redirected Webcam from Fedora host to Ubuntu guest, via window opened from. Webcam appears functional in guest.
anishjp Intel Core i3-2100 CPU @ 3.10GHz x 4
Pass pass
[1]
  1. Works as expected.


New features

User Hardware Q35 Chipset AArch64 VM on x86 Install VM using OVMF/UEFI References
royboy626 MSI_P965
Warning warn
[1]
  1. Wasn't smart enough to use GUI. virt-install worked and booted into the host terminal where virt-install executed. Did config including root and another user. Booted to login but WAS NOT able to successfully enter password for either created user or root (hidden chars?). Hard to believe I screwed up passwords twice (however...)
crobinso AMD FX8150
Pass pass
[1]
Pass pass
Pass pass
[2]
  1. Worked with virt-install for F21 server install
  2. Worked for F21 server install