FWN/Beats/Virtualization

Virtualization

In this section, we cover discussion of Fedora virtualization technologies on the @et-mgmnt-tools-list, @fedora-xen-list, @libvirt-list and @ovirt-devel-list lists.

Contributing Writer: Dale Bewley

Enterprise Management Tools List

This section contains the discussion happening on the et-mgmt-tools list

More Device Support in virt-manager 'Add Hardware' Wizard

Cole Robinson patched virt-manager to implement adding of virtual video devices in the 'Add Hardware' wizard. Cole also implemented attaching serial and parallel devices.

Both these features were added to virt-install. Serial ports can be directed to sockets listening on remote hosts. For example: --serial udp,host=192.168.10.20:4444. That may come in handy for the F12 Hostinfo feature.

Xen, Windows, and ACPI

Guido Günther noted that virt-install disables ACPI and APIC for Windows XP guests. Adding, that it seems "that Windows XP is working fine with acpi/apic enabled which has the immediate advantage that poweroff via ACPI works as expected. So does it make sense to handle winxp the same win2k3?". Windows 2003 guests have ACPI enabled.

Pasi Kärkkäinen went to the xen-devel list and confirmed and relayed "Keir Fraser replied that ACPI with Windows has been working properly at least since Xen 3.1.0 days". Pasi then updated the Xen wiki page.

Fedora Virtualization List

This section contains the discussion happening on the fedora-virt list.

New Mailing List and New Releases of libguestfs

Richard Jones announced the creation of a new list dedicated to "libguestfs/guestfish/virt-inspector discussion/development".

The current release is now 1.0.57, but Richard is so fast that may change by the time you read this.

Recent new features:

• virt-df - like 'df' for virtual machines
• New Perl library called Sys::Guestfs::Lib
• Now available for EPEL
• Tab completion in guestfish now completes files and devices
• Big change to the code generator
• Lots more regression tests
• guestfish commands: time, glob, more, less
• new commands: readdir, mknod*, umask, du, df*, head*, tail*, wc*, mkdtemp, scrub, sh, sh-lines.
• Debian native (debootstrap, debirf) support

See previous release announcement for 1.0.14 in FWN#179 and be sure to see the project homepage for extensive usage examples.

Fedora Virt Status Update

Mark McLoughlin posted another Fedora Virt Status Update reminding that Fedora 12 is quickly approaching with the Feature Freeze on 2009-07-28.

Also mentioned were:

• Details of a fix for "a dramatic slowdown in virtio-blk performance in F-11 guests"
• Note on Xen Dom0 support.
• New wiki pages created.
• Detailed run-down of current virt bugs.

USB Passthrough to Virtual Machines

Mark McLoughlin posted instructions for attaching a USB device to a guest using virt-manager in Fedora 11. This could previously (FWN#165) be accomplished only on the command line.

Unfortunately, those wishing to manage their iPhone or newer iPods in a guest (yours truly included), KVM does not yet support the required USB 2.

Libvirt List

This section contains the discussion happening on the libvir-list.

New Release libvirt 0.6.5

Daniel Veillard announced a new libvirt release, version 0.6.5. "This is mostly a bug fix release, though it includes some serious improvements for storage/NPIV and on the OpenNebula driver."

New features:

• create storage columes on disk backend (Henrik Persson)
• drop of capabilities based on libcap-ng when possible (Daniel Berrange)

Improvements:

• create and destroy NPIV support (David Allan)
• networking in UML driver (Daniel Berrange)
• HAL driver restart thread safety (Daniel Berrange)
• capabilities and nodeinfo APIs for LXC (Daniel Berrange)
• iNUMA API for VBox (Daniel Berrange)
• dynamically search and use kvm-img qemu-img or qcow-create (Doug Goldstein)
• fix qemu and kvm version parsing (Mark McLoughlin)
• serial number for HAL storage (Dave Allan)
• improve error reporting for virConnectOpen URIs (Daniel Berrange)
• include OS driver name in device XML (Daniel Berrange)
• fix qemu command flags fetching (Cole Robinson)
• check that qemu support -drive format= (Cole Robinson)
• improve emulator detection (Cole Robinson)
• changes to config parser to accomodate VMX syntax (Matthias Bolte)
• update network schemas and driver for missing elements (Satoru SATOH)
• avoid changing file context if not needed (Tim Waugh)
• skip labelling if no src path (Cole Robinson)
• add arm emulation if qemu-system-arm is present (C.J. Adams-Collier)

libvirt 0.6.4 was released on May 29. Daniel Veillard is "shooting for a slightly smaller development cycle, in order to be able to push the next version in time for Fedora 12 Beta, this means a new release at the end of July, so only a bit more than a couple of weeks for pushing the changes, I really hope we will be able to include a first version of the ESX driver and Power Hyprvisor, if it's the case I think it will be worth bumping the release name to 0.7.0."

libvirt Repositories Mirrored on Gitorious

Development of libvirt recently moved to git as the source control management system. Daniel Berrange announced "I have created a libvirt project on gitorious which has a mirror of the master branch of the libvirt.git repository. This mirror is *readonly* and updated automatically every 15 minutes. The purpose of this mirror is to allow people to easily publish their personal libvirt working repos to the world. The master upstream repository for libvirt does not change".

The Role of libvirtd

Hugh Brock described a client's desire to make "libvirtd be a one-stop shop for everything they need to do on a virtualization host, including things we have traditionally held out-of-scope for libvirt. A partial list of those things would include:"

• In-depth multipath config management
• Hardware lifecycle management (power-off, reboot, etc.)
• HA configuration

Hugh then asked "why *not* expand the scope of libvirtd to be a one-stop shop for managing a node? Is there a really good reason it shouldn't have the remaining capabilities libvirt users want?"

Daniel Berrange replied "This is essentially suggesting that libvirtd become a general purpose RPC layer for all remote management tasks. At which point you have just re-invented QPid/AMQP or CIM or any number of other general purpose message buses. libvirtd has a core well defined goal:"

• Provide a remote proxy for libvirt API calls

"If you want todo anything more than that you should be considering an alternative remote management system. We already have 2 good ones to choose from supported with libvirt"

• QPid/AMQP, with libvirt-qpid agent + your own custom agents
• CIM, with libvirt-CIM + your own custom CIM providers

"Furthermore, adding more plugins to libvirtd means we will never be able to reduce its privileges to an acceptable level, because we'll never know what capabilities the plugins may want."

Hugh countered "given a libvirt-qpid daemon on the node that handles RPC over QMF (for example), is there not some value in having libvirt expose a consistent API for the operations people want to do on a host regardless of whether they have directly to do with managing a virtual machine or not?"

Daniel Berrange didn't "really see any value in that" "You're just putting in another abstraction layer where none need exist. Just have whatever QMF agent you write talk directly to the thing you need to manage."

Hugh "I will note that when I presented the large client with the option of QMF talking to multiple agents on the node but exposing (effectively) a single API and a single connection, they seemed much happier. So perhaps the right way to attack this is with the ovirt-qpid daemon we are currently working on."

Daniel Veillard was "a bit synpathetic to the suggestion though." "I think libvirt API should help run those virtualization nodes, I would not open the gate like completely, but if we could provide all APIs needed to manage the node on a day by day basis then I think this is not really beyond our scope. I think that netcf(FWN#170) is an example of such API where we start to add admin services for the purpose of running virtualization. Things like rebooting or shutting down the node would fit in this, maybe editing a drive partition too."

"Basically if we take the idea of a stripped down Node used only for virtualization, then except for operations which are first time setup options or maintainance, I think we should try to cover the requirements of normal operations of that node. To some extend that means we would step on the toes of CIM, but we would stick to a subset that's sure."

virsh Dump for QEMU Guests

Paolo Bonzini submitted a patch that "uses a stop/migrate/cont combination to implement "virsh dump" for QEMU guests RHBZ #507551. The code is mostly based on qemudDomainSave , except that the XML prolog is not included as it is not needed to examine the dump with e.g. crash."

F11 and KVM Migrations

Scott Baker tried "to do a 'migration' from one host to another and I'm getting an error." "Where can I look next to figure out why it didn't work?"

virsh # migrate --live Narwhal qemu+ssh://10.1.1.1/system
error: operation failed: failed to start listening VM

Daniel Veillard suggested checking /var/log/libvirt/qemu/Narwhal.log on the target server. It came out that one server was running x86_64 while the other was i586. Chris Lalancette said "that's just not going to work. In theory it might work, but it's never been tested, so I'm not surprised it doesn't. In general migration is extremely finicky when it comes to CPU versions, and versions of the software." And suggested trying again after starting libvirtd by hand with debugging turned up. LIBVIRT_DEBUG=1 /usr/sbin/libvirtd --verbose --listen

Storage cloning for LVM and Disk backends

Cole Robinson submitted a patch series which "implements cloning for LVM and disk backends. Most of the functionality is already here, it just needed some reorganization to be accessible for every backend."

"I verified the following scenarios produced a bootable image:"

• Clone within a disk pool
• Clone within a logical pool
• Clone a raw file to a disk pool
• Clone a disk pool to a logical pool

Fedora-Xen List

This section contains the discussion happening on the fedora-xen list.

Xen dom0 Forward Ported to Latest Kernel

Previously, Xen dom0 support in Fedora was provided by forward porting the Xensource patches from kernel 2.6.18 to the version found in the Fedora release at the time. This consumed developer resources and led to separate kernel and kernel-xen packages for a time. As of Fedora 9 this practice was deamed untenable, and support for hosting Xen guests was dropped from Fedora.

Work has since focused on creating a paravirt operations dom0 kernel based on the most recent upstream vanilla kernel. This work is incomplete and not expected to be done before F12 or even F13. However, experimental dom0 kernels have been created for the adventurous.

Pasi Kärkkäinen tells us the Xen 2.6.18 patches have now been forward-ported to the current 2.6.29 and 2.6.30 kernel. "Forward-porting has been done by Novell for OpenSUSE. Novell also has a forward-port to 2.6.27 for SLES11."

The patches can be found here here and here.

Pasi added "These patches are still more stable and mature than the pv_ops dom0 code.. Also, these patches have the full Xen feature set (pv_ops still lacks some features)."

More history is avilable.