numad - Non-Uniform Memory Alignment Daemon
Summary
A user-level daemon that monitors NUMA topology and processes resource consumption to facilitate good NUMA resource alignment of applications/virtual machines to improve performance and minimize cost of remote memory latencies.
Owner
- Name: Bill Burns
- Email: bburns@redhat.com
Current status
- Targeted release: Fedora 17
- Last updated: 2012-02-23
- Percentage of completion: 100%
Detailed Description
The daemon will attempt to match significant resource consumers with available memory and CPU resources in order to reduce cross node traffic. It will attempt to do some load balancing across NUMA nodes, and will provide a pre-placement advisory interface (to entities like libvirt), so significant processes can be pre-bound to nodes with sufficient available resources.
Benefit to Fedora
Fedora users will accrue performance benefits from automatic NUMA affinity grouping, without needing to explicitly place and bind processes themselves. This should improve the out-of-the-box performance experience on NUMA systems. With more and more systems, even at the low end, presenting NUMA topologies there is a real need to address the performance vagarities that such systems present.
Scope
The tool will be supplied in a new package, and will be a new, stand-alone daemon perhaps with an associated library. Wide spread system effects are unexpected. The daemon will discover the system NUMA topology and provide access to NUMA advice via command line and/or API to query for pre-placement, as well as do some load balancing of significant resource consuming processes directly via existing system interfaces. Some mechanisms for process participation election or exclusion will be provided.
How To Test
Basic function: Start significant workloads with long-running processes on a system with NUMA topology using no bindings and compare to the same when using binding indicated or automated by the daemon. Performance: Utilize the above with measurable workloads and compare the performance of the workloads.
Dependencies
None.
Contingency Plan
The daemon can be disabled and manual determination of optimal NUMA assignement can be performed.
Documentation
Documentation will be included as part of the package. A man page will describe the daemon and it's interfaces.
Release Notes
TBS.