From Fedora Project Wiki
(add owners and status)
 
(42 intermediate revisions by 5 users not shown)
Line 1: Line 1:
= Cluster =
= Updated Cluster Stack with Enhanced Failover Support =


== Summary ==
== Summary ==


Update the corosync/openais/cluster/clvm stack to the latest stable releases.
This is a significant update to the clustering stack - both for high availability and load balancing.
The new upstream versions brings a new and more powerful cluster stack to the end user.


== Owner ==
== Owner ==
 
* Name: [[User:fabbione| FabioMassimoDiNitto]]
* Name: [[User:lon]|LonHohberger]
* email: fdinitto@redhat.com
* Name: [[User:lon|LonHohberger]]
* email: lhh@redhat.com
* email: lhh@redhat.com
* Name: [[User:fabbione| FabioMassimoDiNitto]]
* email: fabbione@redhat.com


== Current status ==
== Current status ==
* Targeted release: [[Releases/{{FedoraVersion||next}} | {{FedoraVersion|long|next}} ]]  
* Targeted release: [[Releases/{{FedoraVersion||next}} | {{FedoraVersion|long|next}} ]]  
* Last updated: 9 Jul 2009
* Last updated: 26 Mar 2012
* Percentage of completion: 99%
* Percentage of completion: 100%


<!-- CHANGE THE "FedoraVersion" TEMPLATES ABOVE TO PLAIN NUMBERS WHEN YOU COMPLETE YOUR PAGE. -->
== Detailed Description ==
Upstream has been developing a new version of the cluster stack which is currently shipped with Fedora 16.  The major features are:
* Improved quorum subsystem which is integrated in to the Corosync Cluster Engine (95% complete)
* A new command-line interface for administration of both the Corosync Cluster Engine and the Pacemaker Cluster Resource Manager as well as monitoring (50% complete)
* Convergence on a single set of resource agents from the Linux clustering community
* Enhanced fencing support provided by stonith-ng, which is part of the Pacemaker project.
* Separation of GFS2-specific utilities in to a separate project (100%)
* Separation of DLM-specific utilities in to a separate project (90%)


== Detailed Description ==
Note that this transition includes deprecations:
<!-- Expand on the summary, if appropriate.  A couple sentences suffices to explain the goal, but the more details you can provide the better. -->
* The cluster package, including CMAN, DLM utilities, GFS2 utilities, fenced, and all associated libraries.
* The rgmanager package.  All users are advised to use Pacemaker for their failover needs.
* The openais package.  This provided some of the SA Forum AIS APIs, which were rarely used.
* The heartbeat package. Upstream development has stopped and equivalent or superior functionality is provided by the [http://corosync.org Corosync] package.
* The piranha package.  Superior functionality is provided by the [http://keepalived.org Keepalived] package.
* The ricci package.  Similar agent-style communication can be provided by Matahari or other projects.
* The luci package.  This will be replaced by Sunzi, although it is not clear this part will make Fedora 17.
* The clustermon package.  This was part of the ricci/luci administration stack and is no longer required.
* Several agents in the resource-agents package which previously relied on examination of cluster.conf at run-time.


== Benefit to Fedora ==
== Benefit to Fedora ==
The increased reliability and versatility of the cluster components included in Fedora 17 allow administrators to deploy Fedora in environments where greater availability and clustered file systems are required.
<!-- What is the benefit to the platform?  If this is a major capability update, what has changed?  If this is a new feature, what capabilities does it bring? Why will Fedora become a better distribution or project because of this feature?-->
<!-- What is the benefit to the platform?  If this is a major capability update, what has changed?  If this is a new feature, what capabilities does it bring? Why will Fedora become a better distribution or project because of this feature?-->
Removal of rgmanager matches the capabilities offered by several other Linux distributions and allows the Fedora community to consort efforts on a single failover stack.


== Scope ==
== Scope ==
<!-- What work do the developers have to accomplish to complete the feature in time for release?  Is it a large change affecting many parts of the distribution or is it a very isolated change? What are those changes?-->
<!-- What work do the developers have to accomplish to complete the feature in time for release?  Is it a large change affecting many parts of the distribution or is it a very isolated change? What are those changes?-->
This change impacts several utilities and other applications, including:
* The DLM, which used AIS Checkpoints to replicate data about POSIX locks (100% complete)
* Clustered LVM, which used CMAN APIs, will need to be ported to corosync. (?% complete)
* Fence-virt, which used CMAN APIs and AIS Checkpoints, will need to be ported to corosync. (0% complete)
* Pacemaker, which used CMAN APIs, will need to be ported to corosync (100% complete)
* Clustered mirroring, which uses AIS Checkpoints will need to be ported to corosync (?% complete)
* QPid, which used CMAN APIs, will need to be ported to corosync (?% complete)


== How To Test ==
== How To Test ==
Line 43: Line 65:
3. What are the expected results of those actions?
3. What are the expected results of those actions?
-->
-->
The initial use cases required for high availability are documented in the [http://clusterlabs.org/doc/en-US/Pacemaker/1.1-pcs/html/Clusters_from_Scratch/ Clusters from Scratch] manual.
Information about how to run GFS2 in standalone mode will be provided as development nears completion.


== User Experience ==
== User Experience ==
<!-- If this feature is noticeable by its target audience, how will their experiences change as a result?  Describe what they will see or notice. -->
<!-- If this feature is noticeable by its target audience, how will their experiences change as a result?  Describe what they will see or notice. -->
Some differences will be noticeable by users:
* Users of the rgmanager package will need to learn the Pacemaker package, which is a more dynamic, complex, full-featured cluster resource manager.
* Users who relied on cluster.conf (whether using ccs, luci, or hand-editing) will need to learn:
** The crm and/or pcs commands and become familiar with the CIB, which is an XML database of the failover resource configuration combined with some run-time state information.
** The layout, syntax, and use of corosync.conf
* Users who relied on the clustat command will need to learn the following commands:
** cibadmin
** crm_mon
** crm_resource


== Dependencies ==
== Dependencies ==
<!-- What other packages (RPMs) depend on this package?  Are there changes outside the developers' control on which completion of this feature depends?  In other words, completion of another feature owned by someone else and might cause you to not be able to finish on time or that you would need to coordinate?  Other upstream projects like the kernel (if this is not a kernel feature)? -->
 
* corosync (2.0)
* pacemaker
* cluster-glue
* dlm (in review currently)
* libqb
* pcs (in review currently)
 
All packagers and upstreams have been informed upfront and worked together to achieve this goal.


== Contingency Plan ==
== Contingency Plan ==
<!-- If you cannot complete your feature by the final development freeze, what is the backup plan?  This might be as simple as "None necessary, revert to previous release behaviour."  Or it might not.  If you feature is not completed in time we want to assure others that other parts of Fedora will not be in jeopardy.  -->
 
None necessary


== Documentation ==
== Documentation ==
<!-- Is there upstream documentation on this feature, or notes you have written yourself?  Link to that material here so other interested developers can get involved. -->
 
*
* [http://www.clusterlabs.org/doc/en-US/Pacemaker/1.1-pcs/html/Clusters_from_Scratch/ Clusters from Scratch]
* [http://corosync.org/doku.php?id=faq Corosync FAQ]


== Release Notes ==
== Release Notes ==
<!-- The Fedora Release Notes inform end-users about what is new in the release. Examples of past release notes are here: http://docs.fedoraproject.org/release-notes/ -->
* The update to version 2.0 (needle) of the [http://www.corosync.org/doku.php Corosync Cluster Engine] offers:
<!-- The release notes also help users know how to deal with platform changes such as ABIs/APIs, configuration or data file formats, or upgrade concerns. If there are any such changes involved in this feature, indicate them here. You can also link to upstream documentation if it satisfies this need. This information forms the basis of the release notes edited by the documentation team and shipped with the release. -->
** API stability guarantees for the duration of Corosync 2.0's lifetime
*
** High performance, cluster-wide messaging.
*** The performance of corosync 2.0 is nearly 10 times that of corosync 1.x for smaller (<64kb) message sizes
*** The CPU utilization of corosync 2.0 is approximately 1/5th of corosync 1.x
** Improved quorum subsystem
** The confdb API has been replaced with the cmap API for configuration management.
* The update to version 1.1.7 of the Pacemaker Cluster Resource Manager offers:
** Improved fencing subsystem which can be used in either GFS2 standalone environments or resource-driven clusters (which may or may not include GFS2)
** Improved logging via the libqb framework


== Comments and Discussion ==
== Comments and Discussion ==
* See [[Talk:Features/YourFeatureName]] <!-- This adds a link to the "discussion" tab associated with your page.  This provides the ability to have ongoing comments or conversation without bogging down the main feature page -->
* See [[Talk:Features/Cluster]]
 
 
[[Category:FeaturePageIncomplete]]
<!-- When your feature page is completed and ready for review -->
<!-- remove Category:FeaturePageIncomplete and change it to Category:FeatureReadyForWrangler -->
<!-- After review, the feature wrangler will move your page to Category:FeatureReadyForFesco... if it still needs more work it will move back to Category:FeaturePageIncomplete-->
<!-- A pretty picture of the page category usage is at: https://fedoraproject.org/wiki/Features/Policy/Process -->
 


<!-- Note that the current Feature guidelines require useful Scope and Test Plans at certain milestones; QA is responsible for checking these, and will change this category as needed. -->
[[Category:FeatureAcceptedF17]]

Latest revision as of 19:21, 27 February 2013

Updated Cluster Stack with Enhanced Failover Support

Summary

This is a significant update to the clustering stack - both for high availability and load balancing.

Owner

Current status

  • Targeted release: Fedora 42
  • Last updated: 26 Mar 2012
  • Percentage of completion: 100%

Detailed Description

Upstream has been developing a new version of the cluster stack which is currently shipped with Fedora 16. The major features are:

  • Improved quorum subsystem which is integrated in to the Corosync Cluster Engine (95% complete)
  • A new command-line interface for administration of both the Corosync Cluster Engine and the Pacemaker Cluster Resource Manager as well as monitoring (50% complete)
  • Convergence on a single set of resource agents from the Linux clustering community
  • Enhanced fencing support provided by stonith-ng, which is part of the Pacemaker project.
  • Separation of GFS2-specific utilities in to a separate project (100%)
  • Separation of DLM-specific utilities in to a separate project (90%)

Note that this transition includes deprecations:

  • The cluster package, including CMAN, DLM utilities, GFS2 utilities, fenced, and all associated libraries.
  • The rgmanager package. All users are advised to use Pacemaker for their failover needs.
  • The openais package. This provided some of the SA Forum AIS APIs, which were rarely used.
  • The heartbeat package. Upstream development has stopped and equivalent or superior functionality is provided by the Corosync package.
  • The piranha package. Superior functionality is provided by the Keepalived package.
  • The ricci package. Similar agent-style communication can be provided by Matahari or other projects.
  • The luci package. This will be replaced by Sunzi, although it is not clear this part will make Fedora 17.
  • The clustermon package. This was part of the ricci/luci administration stack and is no longer required.
  • Several agents in the resource-agents package which previously relied on examination of cluster.conf at run-time.

Benefit to Fedora

The increased reliability and versatility of the cluster components included in Fedora 17 allow administrators to deploy Fedora in environments where greater availability and clustered file systems are required. Removal of rgmanager matches the capabilities offered by several other Linux distributions and allows the Fedora community to consort efforts on a single failover stack.

Scope

This change impacts several utilities and other applications, including:

  • The DLM, which used AIS Checkpoints to replicate data about POSIX locks (100% complete)
  • Clustered LVM, which used CMAN APIs, will need to be ported to corosync. (?% complete)
  • Fence-virt, which used CMAN APIs and AIS Checkpoints, will need to be ported to corosync. (0% complete)
  • Pacemaker, which used CMAN APIs, will need to be ported to corosync (100% complete)
  • Clustered mirroring, which uses AIS Checkpoints will need to be ported to corosync (?% complete)
  • QPid, which used CMAN APIs, will need to be ported to corosync (?% complete)

How To Test

The initial use cases required for high availability are documented in the Clusters from Scratch manual.

Information about how to run GFS2 in standalone mode will be provided as development nears completion.

User Experience

Some differences will be noticeable by users:

  • Users of the rgmanager package will need to learn the Pacemaker package, which is a more dynamic, complex, full-featured cluster resource manager.
  • Users who relied on cluster.conf (whether using ccs, luci, or hand-editing) will need to learn:
    • The crm and/or pcs commands and become familiar with the CIB, which is an XML database of the failover resource configuration combined with some run-time state information.
    • The layout, syntax, and use of corosync.conf
  • Users who relied on the clustat command will need to learn the following commands:
    • cibadmin
    • crm_mon
    • crm_resource

Dependencies

  • corosync (2.0)
  • pacemaker
  • cluster-glue
  • dlm (in review currently)
  • libqb
  • pcs (in review currently)

All packagers and upstreams have been informed upfront and worked together to achieve this goal.

Contingency Plan

None necessary

Documentation

Release Notes

  • The update to version 2.0 (needle) of the Corosync Cluster Engine offers:
    • API stability guarantees for the duration of Corosync 2.0's lifetime
    • High performance, cluster-wide messaging.
      • The performance of corosync 2.0 is nearly 10 times that of corosync 1.x for smaller (<64kb) message sizes
      • The CPU utilization of corosync 2.0 is approximately 1/5th of corosync 1.x
    • Improved quorum subsystem
    • The confdb API has been replaced with the cmap API for configuration management.
  • The update to version 1.1.7 of the Pacemaker Cluster Resource Manager offers:
    • Improved fencing subsystem which can be used in either GFS2 standalone environments or resource-driven clusters (which may or may not include GFS2)
    • Improved logging via the libqb framework

Comments and Discussion

Retrieved from "https://fedoraproject.org/w/index.php?title=Features/Cluster&oldid=324777"