From Fedora Project Wiki
(→‎Yum or Dnf from existing stable install: "Upgrading_Fedora_using_yum" change to "Upgrading Fedora using package manager")
(revise for pungi 4 nightlies, openqa testing and the nightly image finder)
Line 3: Line 3:
= Branched =
= Branched =


Branched is the name given to a version of Fedora that has "branched" from the rolling [[Releases/Rawhide|Rawhide]] tree and will become the next stable Fedora release. It consists of [http://download.fedoraproject.org/pub/fedora/linux/development/{{FedoraVersionNumber|next}} a Fedora development release tree]<ref>Link will only work when a Branched release currently exists.</ref> named after the Fedora release it will become. It contains builds of all Fedora packages updated by maintainers with the goal of stabilizing before release and fixing any release [[Changes/Policy|Changes]]. Nightly live and disk image builds are also [https://apps.fedoraproject.org/releng-dash/ produced], and installer, upgrade and PXE boot images may be available within the tree.
Branched is the name given to a version of Fedora that has "branched" from the rolling [[Releases/Rawhide|Rawhide]] tree and will become the next stable Fedora release. It consists of [http://download.fedoraproject.org/pub/fedora/linux/development/{{FedoraVersionNumber|next}} a Fedora development release tree]<ref>Link will only work when a Branched release currently exists.</ref> named after the Fedora release it will become. It contains builds of all Fedora packages updated by maintainers with the goal of stabilizing before release and fixing any release [[Changes/Policy|Changes]]. Full nightly composes are also produced each night when a Branched release exists, usually containing all images and installer trees (minus any which fail to build).


Branched may be referred to by the Fedora release it will become, e.g. "{{FedoraVersion|long|next}} Branched".
Branched may be referred to by the Fedora release it will become, e.g. "{{FedoraVersion|long|next}} Branched".
Line 36: Line 36:


If the above doesn't match you, you may wish to instead follow the [[Releases/Rawhide|Rawhide]] release (depending on the point in the [[Releases/{{FedoraVersion||next}}/Schedule|release cycle]]) or use regular stable Fedora releases.
If the above doesn't match you, you may wish to instead follow the [[Releases/Rawhide|Rawhide]] release (depending on the point in the [[Releases/{{FedoraVersion||next}}/Schedule|release cycle]]) or use regular stable Fedora releases.
=== Live media ===
After the [[Releases/{{FedoraVersion||next}}|Branch event]], but before the Fedora stable release,  [https://apps.fedoraproject.org/releng-dash/ nightly live image builds] will be composed from Branched. You may be able to use these images to boot and test Branched. These images are automatically composed and not tested by [[QA]].


=== Virtual instances  ===
=== Virtual instances  ===
Line 49: Line 45:
=== Getting a Branched install ===
=== Getting a Branched install ===


The [[Repositories#product|Product trees]] within the Branched tree should be directly installable (barring problems).
==== Install from nightly composes ====
 
==== Install a pre-release ====


If the Branched release has already spawned an Alpha or Beta release, you can simply install that - it should be available from [https://fedoraproject.org/get-prerelease a Fedora download page] - and then update as usual. Installing a pre-release and following normal update procedures will result in your installation tracking the Branched release.
Each day (or sometimes more than once per day) that Branched exists, a full 'compose' of the tree is attempted. This will usually result in the creation of all or most of the usual install, live and disk images, installer trees and so forth. The composes are synced to the {{code|/fedora/linux/development/}} directory on the mirrors, and you can find the images there.


Before each of the above milestones, [[QA:SOP_compose_request#Test_composes|test compose and release candidate]] images are sometimes available. These are produced as part of the [[QA:Release_validation_test_plan|process of validating releases]].
Each successful compose is tested by [https://openqa.fedoraproject.org openQA] and a mail summarizing the results is sent to the {{fplist|devel}} and {{fplist|test}} mailing lists, so you can check the openQA interface or the 'compose check report' emails to check whether that day's compose is installable. You may also use the [https://www.happyassassin.net/nightlies.html nightly image finder] tool maintained and hosted by a [[User:Adamwill|Fedora QA team member]], which conveniently offers the last completed build for each image and the last that passed all tests, for openQA or [https://apps.fedoraproject.org/autocloud/jobs/ Autocloud]-tested images.


TC images may or may not install correctly.  
Using nightlies in the past was a fragile way to install Branched, but with improved compose processes since Fedora 24 and automated testing since Fedora 23, their quality has improved substantially and this will often result in the best experience.


RC images may or may not install correctly, but you can usually find the [http://qa.fedoraproject.org/blockerbugs/current list of known blockers] to see if they affect you.
==== Install a pre-release ====


==== Install from nightly live or disk media ====
If the Branched release has already spawned an Alpha or Beta release, you can simply install that. It should be available from [https://getfedora.org/ the Fedora download page] - if an Alpha or Beta is available, you should see mentions of it around the site. Install and then update as usual. Installing a pre-release and following normal update procedures will result in your installation tracking the Branched release.


If Live media are being composed from Branched (see above), you may be able to download the Live media, copy it to local media, boot and install Branched. In the same place, you will find nightly builds of the disk images for [[Architectures/ARM|ARM]] and [[Cloud]] platforms.
Pre-releases undergo somewhat more intensive testing than nightly composes, but on the other hand, a nightly compose a few days before the Beta release may well work much better than the Alpha release did. Alpha releases can be expected to meet the Alpha [[Fedora Release Criteria]], and Beta releases to meet the Beta criteria.


This is the most fragile way to get a Branched install, as Live media are only produced at some points in the cycle, sometimes does not compose, and when it does, may not install correctly.  
Before each of the above milestones, [[QA:SOP_compose_request|'candidate' compose]] images are sometimes available. These are produced as part of the [[QA:Release_validation_test_plan|process of validating releases]]. These images may or may not install correctly, but you can usually find the [http://qa.fedoraproject.org/blockerbugs/current list of known blockers] to see if they affect you. You can also refer to the validation results page for the compose to see how well it works, according to the QA testers.


==== Point installer to Branched ====
==== Point installer to Branched ====


You can sometimes install Branched by using a stable install media and pointing it to the Branched repositories for packages to install.
You can sometimes install Branched by using a stable install media and pointing it to the Branched repositories for packages to install. In the past this was sometimes considered a more reliable method than using a Branched compose, but with improvements to the compose and test process in the last few years this is rarely likely to be a good choice any longer. If you wish to try it, however, you can:


# Download the latest stable or branched install media (network install or offline ("DVD") installer image)
# Download the latest stable or branched install media (network install or offline ("DVD") installer image)
# Copy to local media ([[How_to_create_and_use_Live_USB|USB]] or [https://docs.fedoraproject.org/en-US/Fedora/{{FedoraVersionNumber}}/html/Burning_ISO_images_to_disc/index.html DVD or CD])
# Copy to local media ([[How_to_create_and_use_Live_USB|USB]] or [https://docs.fedoraproject.org/en-US/Fedora/{{FedoraVersionNumber}}/html/Burning_ISO_images_to_disc/index.html DVD or CD])
# Boot media and go to the 'Installation Source' screen and manually enter: {{filename|https://download.fedoraproject.org/pub/fedora/linux/development/{{FedoraVersionNumber|next}}/x86_64/os/}}(or i386 for 32-bit)
# Boot media and go to the 'Installation Source' screen and manually enter: {{filename|https://download.fedoraproject.org/pub/fedora/linux/development/{{FedoraVersionNumber|next}}/Everything/x86_64/os/}}(or i386 for 32-bit)
# Finish the install as normal.  
# Finish the install as normal.  


For this method to work, there should be no major changes in Branched that the installer is not ready for, such as packages it depends on being retired or other similar situations.
For this method to work, there should be no major changes in Branched that the installer is not ready for, such as packages it depends on being retired or other similar situations.


==== Yum or Dnf from existing stable install ====
==== Upgrade from existing stable install ====
 
You may use yum or dnf to upgrade from the most recent stable release. You will need to have such an install in place and should likely update to the newest updates before starting.


See [[Upgrading_Fedora_using_package_manager#To_Fedora_{{FedoraVersionNumber|next}}_pre-release|Upgrading Fedora using package manager Branched info]]
You may use [[DNF_system_upgrade]] to upgrade from the most recent stable release. You will need to have such an install in place and should likely update to the newest updates before starting.


This method may fail if there are upgrade path issues (newer packages in stable or than Branched), or broken dependencies.
This method may fail if there are upgrade path issues (newer packages in stable or than Branched), or broken dependencies.
Line 106: Line 98:
== Producing Branched ==
== Producing Branched ==


The Branched compose runs every day starting at 09:15UTC. All branched builds at that time that are marked as [[Repositories#stable|''stable']] are composed and synced out. Note that during freezes there will be many days where 0 packages are added to the compose. The Branched tree is under {{filename|development/VERSION}} on the mirrors. You can find a local "{{FedoraVersionNumber|next}}" mirror [http://mirrors.fedoraproject.org/publiclist/Fedora/{{FedoraVersionNumber|next}}/ on the public mirror list]. Compose time varies depending on number of changes but is typically between 5 and 8 hours.  
The Branched compose runs every day starting at 09:15UTC. All branched package builds at that time that are marked as [[Repositories#stable|''stable']] are composed and synced out. Note that during freezes there will be many days where 0 packages are added to the compose. The Branched tree is under {{filename|development/VERSION}} on the mirrors. You can find a local "{{FedoraVersionNumber|next}}" mirror [http://mirrors.fedoraproject.org/publiclist/Fedora/{{FedoraVersionNumber|next}}/ on the public mirror list]. Compose time varies depending on number of changes but is typically between 5 and 8 hours.  


Branched is subject to various [[:Category:Policy|policies]] during its life cycle. For most of its existence, it is subject to the [[Updates Policy]] and package updates for it are gated through the [[Bodhi]] package review process. At various points of the [[Fedora Release Life Cycle]], other freezes, policies and requirements come into effect, including the [[Software String Freeze Policy]], the [[Milestone freezes]], and the [[Changes/Policy|Change freezes]]. See all the above links for more details on exactly what changes may occur in the Branched tree under what conditions at what times.
Branched is subject to various [[:Category:Policy|policies]] during its life cycle. For most of its existence, it is subject to the [[Updates Policy]] and package updates for it are gated through the [[Bodhi]] package review process. At various points of the [[Fedora Release Life Cycle]], other freezes, policies and requirements come into effect, including the [[Software String Freeze Policy]], the [[Milestone freezes]], and the [[Changes/Policy|Change freezes]]. See all the above links for more details on exactly what changes may occur in the Branched tree under what conditions at what times.


Composes are done in a chroot using the 'mash' tool called from a [http://git.fedorahosted.org/cgit/releng/tree/scripts/buildrawhide script maintained by Fedora Release engineering].  If the base set of packages needed to compose are broken, the daily compose may fail.  
Composes are done using the 'mash' and [https://pagure.io/pungi Pungi] tools called from a [http://git.fedorahosted.org/cgit/releng/tree/scripts/buildrawhide script maintained by Fedora Release engineering].  If the base set of packages needed to compose are broken, the daily compose may fail.  


A report for each Branched compose is sent to to the {{fplist|test}} and the {{fplist|devel}} lists. This report contains output from the 'repodiff' tool from the previous compose as well as a broken dependency report for packages with broken dependencies. Additionally, private email is sent to maintainers with packages containing broken dependencies.  
A report for each Branched compose is sent to to the {{fplist|test}} and the {{fplist|devel}} lists. This report contains output from the [https://pagure.io/compose-utils compose-changelog] tool from the previous compose as well as a broken dependency report for packages with broken dependencies. Additionally, private email is sent to maintainers with packages containing broken dependencies.  


Package maintainers should read and follow the [[Updates_Policy#Branched_release|Branched release updates policy]] for building any packages in Branched.
Package maintainers should read and follow the [[Updates_Policy#Branched_release|Branched release updates policy]] for building any packages in Branched.
Line 122: Line 114:
'''Q:''' So Branched is very stable and we can all use it?  
'''Q:''' So Branched is very stable and we can all use it?  


A: No. See audience above. There are things that break from time to time, but if you are able to downgrade or troubleshoot such issues aren't too severe, however most users should stick to stable Fedora releases.  
A: Not quite, though it has improved substantially in recent years. Still, see audience above. There are things that break from time to time, but if you are able to downgrade or troubleshoot such issues aren't too severe, however most users should stick to stable Fedora releases.  


'''Q:''' I'm using a stable Fedora release, but I want the newer package for foo thats only available in Branched. Can I just yum|dnf install it?
'''Q:''' I'm using a stable Fedora release, but I want the newer package for foo thats only available in Branched. Can I just yum|dnf install it?

Revision as of 23:15, 25 April 2016

Branched

Branched is the name given to a version of Fedora that has "branched" from the rolling Rawhide tree and will become the next stable Fedora release. It consists of a Fedora development release tree[1] named after the Fedora release it will become. It contains builds of all Fedora packages updated by maintainers with the goal of stabilizing before release and fixing any release Changes. Full nightly composes are also produced each night when a Branched release exists, usually containing all images and installer trees (minus any which fail to build).

Branched may be referred to by the Fedora release it will become, e.g. "Fedora 42 Branched".

  1. Link will only work when a Branched release currently exists.

Goals

Branched has the following goals:

  • To allow package maintainers to integrate their packages into Fedora for a stable release.
  • To allow advanced users access to the newer packages than stable releases typically provide.
  • To identify and fix issues with packages before they reach a stable release of Fedora.

Using Branched

This section discusses Branched target users and how to test Branched with Live media, within a virtual installation or on a bare metal installation.

Audience

Branched is targeted at advanced users, testers and package maintainers.

As a branched consumer, you should:

  • Be willing to update often. Branched doesn't get as many updates as rawhide (and at times they are frozen), but it still gets a larger amount than a Stable release.
  • Be willing and able to troubleshoot problems. From time to time there are problems with Branched packages, and you will need strong troubleshooting skills and the ability to gather information for bug reports. You need a good understanding of yum or dnf and how to downgrade packages, as well as boot time troubleshooting.
  • Frequent reboots to test new kernel versions and confirm functionality of the boot process. If you can't reboot often, consider using a stable release instead.
  • Be willing and able to report bugs as you find them and help maintainers gather information to fix them.

If the above doesn't match you, you may wish to instead follow the Rawhide release (depending on the point in the release cycle) or use regular stable Fedora releases.

Virtual instances

You may wish to install and run Branched in a virtual machine (VM) instance. This allows you to test when not running Linux, or avoid any impact to your day-to-day workflow.

See the section below on setting up a Branched install.

Getting a Branched install

Install from nightly composes

Each day (or sometimes more than once per day) that Branched exists, a full 'compose' of the tree is attempted. This will usually result in the creation of all or most of the usual install, live and disk images, installer trees and so forth. The composes are synced to the /fedora/linux/development/ directory on the mirrors, and you can find the images there.

Each successful compose is tested by openQA and a mail summarizing the results is sent to the devel and test mailing lists, so you can check the openQA interface or the 'compose check report' emails to check whether that day's compose is installable. You may also use the nightly image finder tool maintained and hosted by a Fedora QA team member, which conveniently offers the last completed build for each image and the last that passed all tests, for openQA or Autocloud-tested images.

Using nightlies in the past was a fragile way to install Branched, but with improved compose processes since Fedora 24 and automated testing since Fedora 23, their quality has improved substantially and this will often result in the best experience.

Install a pre-release

If the Branched release has already spawned an Alpha or Beta release, you can simply install that. It should be available from the Fedora download page - if an Alpha or Beta is available, you should see mentions of it around the site. Install and then update as usual. Installing a pre-release and following normal update procedures will result in your installation tracking the Branched release.

Pre-releases undergo somewhat more intensive testing than nightly composes, but on the other hand, a nightly compose a few days before the Beta release may well work much better than the Alpha release did. Alpha releases can be expected to meet the Alpha Fedora Release Criteria, and Beta releases to meet the Beta criteria.

Before each of the above milestones, 'candidate' compose images are sometimes available. These are produced as part of the process of validating releases. These images may or may not install correctly, but you can usually find the list of known blockers to see if they affect you. You can also refer to the validation results page for the compose to see how well it works, according to the QA testers.

Point installer to Branched

You can sometimes install Branched by using a stable install media and pointing it to the Branched repositories for packages to install. In the past this was sometimes considered a more reliable method than using a Branched compose, but with improvements to the compose and test process in the last few years this is rarely likely to be a good choice any longer. If you wish to try it, however, you can:

  1. Download the latest stable or branched install media (network install or offline ("DVD") installer image)
  2. Copy to local media (USB or DVD or CD)
  3. Boot media and go to the 'Installation Source' screen and manually enter: https://download.fedoraproject.org/pub/fedora/linux/development/42/Everything/x86_64/os/(or i386 for 32-bit)
  4. Finish the install as normal.

For this method to work, there should be no major changes in Branched that the installer is not ready for, such as packages it depends on being retired or other similar situations.

Upgrade from existing stable install

You may use DNF_system_upgrade to upgrade from the most recent stable release. You will need to have such an install in place and should likely update to the newest updates before starting.

This method may fail if there are upgrade path issues (newer packages in stable or than Branched), or broken dependencies.

Communicating

There are a number of ways to communicate with other Branched users:

IRC

Branched discussion is on topic and welcome in both the #fedora-devel and #fedora-qa IRC channels.

Mailing Lists

Branched discussion is on topic and welcome in both the test and devel lists.

Bugzilla

Branched bugs should be reported against the Fedora Product, and version that this branched will become and the affected component. Please do follow best practices when filing. Remember that IRC and mailing lists are useful to help narrow down if some behavior is a bug or where to report it, but are themselves not bug reporting channels. Always file bugs in Bugzilla.

Note that broken dependencies are mailed to maintainers for each daily Branched compose where a package has such broken dependencies. Therefore, it's usually not worth filing a bug for broken dependencies unless they don't appear in the daily report, or you have a fix or improvement to suggest.

Producing Branched

The Branched compose runs every day starting at 09:15UTC. All branched package builds at that time that are marked as stable' are composed and synced out. Note that during freezes there will be many days where 0 packages are added to the compose. The Branched tree is under development/VERSION on the mirrors. You can find a local "42" mirror on the public mirror list. Compose time varies depending on number of changes but is typically between 5 and 8 hours.

Branched is subject to various policies during its life cycle. For most of its existence, it is subject to the Updates Policy and package updates for it are gated through the Bodhi package review process. At various points of the Fedora Release Life Cycle, other freezes, policies and requirements come into effect, including the Software String Freeze Policy, the Milestone freezes, and the Change freezes. See all the above links for more details on exactly what changes may occur in the Branched tree under what conditions at what times.

Composes are done using the 'mash' and Pungi tools called from a script maintained by Fedora Release engineering. If the base set of packages needed to compose are broken, the daily compose may fail.

A report for each Branched compose is sent to to the test and the devel lists. This report contains output from the compose-changelog tool from the previous compose as well as a broken dependency report for packages with broken dependencies. Additionally, private email is sent to maintainers with packages containing broken dependencies.

Package maintainers should read and follow the Branched release updates policy for building any packages in Branched.

Until the Bodhi enabling point, you cannot expect all packages in the Branched tree to be signed. To use Branched at these times, GPG signature checking in your package management tool must be disabled.

Questions and Answers

Q: So Branched is very stable and we can all use it?

A: Not quite, though it has improved substantially in recent years. Still, see audience above. There are things that break from time to time, but if you are able to downgrade or troubleshoot such issues aren't too severe, however most users should stick to stable Fedora releases.

Q: I'm using a stable Fedora release, but I want the newer package for foo thats only available in Branched. Can I just yum|dnf install it?

A: No. Mixing releases like this is a very bad idea. Better options are:

  • Obtain the src.rpm for the package you wish and try and mock rebuild it (which may or may not work depending on dependencies)
  • Ask the Fedora maintainer in a bug report to update the stable version if permitted by policy.

Q: How can I tell when the branched compose for the day has finished?

A: You can see the reports it sends to the test and the devel lists. You can also watch fedmsg for the messages that rawhide compose has finished.

Hints and Tips

  • Your package management system can be of great help in diagnosing and working around issues you find. Do read up and understand: 'yum|dnf downgrade' 'yum|dnf history' 'yum update --skip-broken' or 'dnf upgrade' 'koji download-build'.
  • You should update frequently (preferably every day). This allows you to more easily narrow down when a problem or issue appeared. If you apply a week of Branched updates at once you have many more packages to examine to narrow down issues.
  • Reboot often (preferably whenever new kernels arrive). This allows you to test the boot up process and packages related to it, as well as newer kernels. Read and understand the Dracut troubleshooting steps.
  • Follow the test and the devel lists for Branched issues, try and at least skim them before doing your daily Branched updates. Look for '[branched]' or '[42]' subjects or reports of issues. Additionally if you find a problem and are not sure what to file bugs against you can open a discussion there.
  • At some times, Branched kernels are made with a large amount of debugging enabled. You can often gain a good deal of performance by passing "slub_debug=-" to your kernel boot line in /etc/grub2.cfg. Additionally, you can run kernels in the Rawhide Kernel Nodebug repo that have all debugging disabled.
  • If you are using a graphical desktop environment in your Branched install, you may wish to install several of them. This allows you to still login and troubleshoot when your primary desktop environment is not working for some reason.
  • Have a rescue media handy of the current stable Fedora release for emergencies.

History

Branched was created as part of the "No frozen Rawhide" proposals: